Propertyfinder Scraper avatar

Propertyfinder Scraper

Try for free

3 days trial then $30.00/month - No credit card required now

Go to Store
Propertyfinder Scraper

Propertyfinder Scraper

dhrumil/propertyfinder-scraper
Try for free

3 days trial then $30.00/month - No credit card required now

Scrape Propertyfinder.ae to crawl millions of sale/rent real estate properties from UAE Our real estate scraper also lets you monitor specific listing for new updates/listing. You can provide multiple search result listings to scrape/monitor properties in Dubai, Abu Dhabi, Sharjah, Ajman and more

PO

Flagging Expired Property

Closed

powermetrics opened this issue
a year ago

We wanted to maintain our properties scraped using your actor , in such case the feature of delta crawls in your actor is really helfull. It would be really usefull if there could be a way to mark/flag already scraped listings if expired or not.

dhrumil avatar

I am afraid there is no way to track which listings you already have consumed as previous batch (can be daily, can be weekly or can be from even last month! ). Basically that data is residing some where outside the Apify inside your own database. That's why it's not possible to do delta crawls in reverse to find out what's delisted from your database.

Although, I have 2 ideas for the same :

1 - Instead of running the crawler in delta mode, run it in full mode. That way you have always latest snapshot of all data with site and you can compare it with existing database while loading and find out what in your database is not on site anymore. This way you can delist it 2 - This crawler also support direct property page scraping. You can launch cralwer directly with properties urls you already have and find out which property is no longer listed anymore

Developer
Maintained by Community

Actor Metrics

  • 44 monthly users

  • 7 stars

  • >99% runs succeeded

  • Created in Mar 2023

  • Modified 2 months ago