Zillow Search Scraper avatar
Zillow Search Scraper

Pricing

$2.00 / 1,000 results

Go to Store
Zillow Search Scraper

Zillow Search Scraper

Developed by

Maximillian Copelli

Maximillian Copelli

Maintained by Apify

Extract data about properties for sale and rent on Zillow using the Zillow API, but with no daily call limits. Scrape millions of listings and download your data as HTML, JSON, CSV, Excel, XML. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

4.0 (9)

Pricing

$2.00 / 1,000 results

75

Total users

1.9k

Monthly users

317

Runs succeeded

98%

Issues response

25 days

Last modified

3 months ago

EV

How to avoid duplicate listings between actor runs?

Closed

evee opened this issue
2 months ago

I'm using this actor to collect rental listings and running it periodically. Currently I'm receiving the same listings in subsequent runs, which is costing extra credits and creating duplicates in my database.

Is there a configuration option or parameter that would allow me to only receive new listings that haven't been collected in previous runs? Ideally I'd like a solution that doesn't require code modifications.

Thanks a ton!

zuzka avatar

Hey, it is not possible to avoid the cost for scraping the same places again because the Actor actually has to go through all the results again as well, but it is possible to run the dataset with this Actor: https://console.apify.com/actors/WbkBysyU2pIYfjURX/.

lhotanok avatar

Hi, you can also set up an automated integration with this Actor: Merge, Dedup & Transform Datasets

You can use the following link to add a new integration: https://console.apify.com/actors/X46xKaa20oUA1fRiP/integrations/actor/ou2buPCN9hYdGLVdT/add

This would help with removing duplicates before saving the results into your database. But it wouldn't save you any platform credits, that's not possible unfortunately

EV

evee

2 months ago

Thanks! Are you not able to use a key-value store as a cache so the scraper can skip detail pages it has already processed? I’ve seen other scrapers do this on Apify, it seems it would be doable with this Actor too.