Google Maps Scraper avatar
Google Maps Scraper
Try for free

No credit card required

View all Actors
Google Maps Scraper

Google Maps Scraper

compass/crawler-google-places
Try for free

No credit card required

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
YU

Can I enable incremental scraping?

Closed

yuchuy opened this issue
2 months ago

Hi team, I would like to know if it is possible to enable incremental scraping. I have read that setting a queue name explicitly can enable incremental scraping. Can this be done for this actor?

zuzka avatar

Hey, what exactly do you mean by incremental scraping? Do you mean like scraping the city in January and then re-scrape it in June but only the places that you didnt catch last time? Or do you mean when you abort the Actor or the Actor times out, to ressurect the run? And where did you read it, would you know?

YU

yuchuy

2 months ago

Hi, thank you for responding. I was trying to scrape reviews for 1 specific place. And I'd like to be able to update the latest reviews to my database. Right now what I can do is just running the task again and again, each time scraping a complete full list of all reviews. I was wondering if I can scrape only the latest reviews after the first run. The article I've read is here: https://blog.apify.com/new-apify-request-queue/#request-lifecycle-made-right

ondrejklinovsky avatar

Hey,

you can scrape only the latest reviews by using reviewsStartDate input field: Let's say you scrape the reviews of the place weekly, then all you need to do is to set the value to 1 week:

1// rest of your input
2    "reviewsSort": "newest",
3    "reviewsStartDate": "1 week"

With this input, actor will scrape reviews and it will stop once it finds a review older than 1 week.

Let us know if this helps.

Developer
Maintained by Apify
Actor metrics
  • 3k monthly users
  • 366 stars
  • 97.8% runs succeeded
  • 3.1 days response time
  • Created in Nov 2018
  • Modified 2 days ago