Pay $2.00 for 1,000 results
Zillow Search Scraper
Pay $2.00 for 1,000 results
Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.
Multiple failed requests
Closed
I have run the crawler with multiple search URLs, given within a text file, and learned that 14 out of my 47 requests have failed. Is there a way to see which requests exactly failed? Maybe rerun only these ones?
How to handle these failures?
Thanks.
Hi, thanks for your patience. I'm gonna find out and let you know if it's possible!
Hi @itai-wand, we have had some issues with Zillow blocking our scrapers during February and March, but we thing the situation is now stable, and I have just pushed these improvements to this scraper as well. The scraper should now be more resistant against Zillow's blocking, so requests shouldn't be failing anymore. If you again encounter high percentage of failed requests (20% and more), please open a new ticket.
As for seeing which requests failed, you can check this by opening the Actor run's request queue, and using the Get all requests endpoint to list the requests. However, due to the way this scraper is structured, this doesn't exactly correlate to the URLs that you provided on input - each input URL can produce many entries in the internal request queue, and only some of these might fail, which means that just a part of some search has failed. Also, there are multiple reasons why requests could fail - it could be Zillow blocking, but it could also mean that some input URL was invalid. This is why we currently don't support rerunning only failed requests in an automated way.
I hope this information helps.
Maximillian Copelli- 111 monthly users
- 91.6% runs succeeded
- 2.1 days response time
- Created in Dec 2023
- Modified 2 days ago
