Zillow Search Scraper avatar
Zillow Search Scraper
Try for free

Pay $2.00 for 1,000 results

View all Actors
Zillow Search Scraper

Zillow Search Scraper

maxcopell/zillow-scraper
Try for free

Pay $2.00 for 1,000 results

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

User avatar

Multiple failed requests

Closed

itai-wand opened this issue
3 months ago

I have run the crawler with multiple search URLs, given within a text file, and learned that 14 out of my 47 requests have failed. Is there a way to see which requests exactly failed? Maybe rerun only these ones?

How to handle these failures?

Thanks.

User avatar

Hi, thanks for your patience. I'm gonna find out and let you know if it's possible!

User avatar

Hi @itai-wand, we have had some issues with Zillow blocking our scrapers during February and March, but we thing the situation is now stable, and I have just pushed these improvements to this scraper as well. The scraper should now be more resistant against Zillow's blocking, so requests shouldn't be failing anymore. If you again encounter high percentage of failed requests (20% and more), please open a new ticket.

As for seeing which requests failed, you can check this by opening the Actor run's request queue, and using the Get all requests endpoint to list the requests. However, due to the way this scraper is structured, this doesn't exactly correlate to the URLs that you provided on input - each input URL can produce many entries in the internal request queue, and only some of these might fail, which means that just a part of some search has failed. Also, there are multiple reasons why requests could fail - it could be Zillow blocking, but it could also mean that some input URL was invalid. This is why we currently don't support rerunning only failed requests in an automated way.

I hope this information helps.

Developer
Maintained by Apify
Actor metrics
  • 112 monthly users
  • 87.0% runs succeeded
  • 11.6 days response time
  • Created in Dec 2023
  • Modified 18 days ago
Categories