Google Maps Scraper avatar
Google Maps Scraper
Try for free

No credit card required

View all Actors
Google Maps Scraper

Google Maps Scraper

compass/crawler-google-places
Try for free

No credit card required

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

User avatar

urgent - $2,000 wasted?

Closed

nico_v opened this issue
2 months ago

Hi Team,

Yesterday I launched 21 runs and at some point realised none was generating any results anymore, all at the same time, despite running through thousands of requests.

What made me realising it was the few last runs that were giving strictly 0 results in total, despite running about 1h each, on 5k to 9k requests. I then pursued to check all other ongoing runs and none of them was giving results anymore (or only a very few - I鈥檓 not 100% sure), which I never saw happening before.

What I saw in all these runs鈥 logs is the endless repetition of the following message (cf. attachements): Didn't find next page cursor, stopping.

All in all, it feels like I鈥檝e spent $2,000+ on a single day, yet the runs are incomplete to say the least.

Could you confirm:

  1. When will the scraper be fixed ? (I quickly resurrected run #GQQKdEh2DVe2ytMBq today and it still is not giving any results)

  2. Will you re-credit all of my runs from yesterday so I can re-launch them? Here are their IDs:

  • LQPv0H3WaL8x0pDpM
  • 0b9av6RMAq9ngtyFk
  • GFvucFf5uXQ1zhrOt
  • H7dPb1VpaeNbLaHvY
  • 47YKTzR1dMB6YgYsX
  • 8xYDgbeJNvpFggFha
  • cQn8NRkEcvPjVbdn6
  • UmL1H8kQkPoGIy7hA
  • SPnJijL6bkGqHV2zw
  • NZr9Fv6btuIzpJiRg
  • UaerHzAyfOcgqS41g
  • lntm3rFt0BlUg1M4B
  • qJEVXX8ma07YPkyIo
  • QKZbQonHZQx9vrJyy
  • lz6KZwcJ5lUTvue8c
  • SrpsBp0qXUMpVtnuD
  • bSxNyz3TPPmZNtyAP
  • RkVVFtzuOHbdPGIDh
  • oQkJC7xj4NHygurnp
  • GQQKdEh2DVe2ytMBq
  1. Could you extend my current subscription period by the number of days it will take to fix this? (I don鈥檛 want to be re-charged $1,000+ subscription just because the actor wasn鈥檛 working for a few days at the very end of my subscription period, plus I still have contact details extractor to run on top of these).

Feel free to reach out via email or phone if that helps.

Thank you in advance for your help.

User avatar

Hey, thanks for the report, we will have a look asap.

User avatar

Hello,

Thanks a lot for the report, we will resolve it today.

  1. The problem for this run GQQKdEh2DVe2ytMBq is that you have hamburg as the first search term for which Google just shows the city of Hamburg, nothing else. This feels like a typo on your end? This was previously handled well but with new handling slipped back to repeated scrape. I notified the developer to handle this gracefully, e.g. just output the single place and throw away the scanning.
User avatar

nico_v

2 months ago

Hello Luk谩拧,

Thank you for reverting back to me quickly.

  1. Indeed you're right: on the following 6 runs I made a typo of adding Hamburg: GQQKdEh2DVe2ytMBq / oQkJC7xj4NHygurnp / RkVVFtzuOHbdPGIDh / bSxNyz3TPPmZNtyAP / SrpsBp0qXUMpVtnuD / lz6KZwcJ5lUTvue8c.

For these 6, do you confirm simply re-launching them from scratch would now work, should I remove the "hamburg" mention from search terms? (no need for a compensation given that it was my mistake) not sure the scraper works though, given my following comment.

For the other runs, I also see the mention of "Finishing scroll - didn't find the cursor for the next page" in their log, (e.g. lntm3rFt0BlUg1M4B) despite no typo in the inputted search terms. On other past runs, I didn't come across such mention in their log (e.g. jMtwHxzP1yJCsor4W).

Could you confirm what went wrong?

Thank you.

User avatar

Hey,

  1. Please wait with the launch until the dev investigates the other point. But yes please remove the hamburg search term and keep the other real terms.

We will get back to you asap today for the other problems.

User avatar

Coming up with the resolution of the issue.

The developer analyzed the runs and there is no bug, just the log message is written in a confusing way which will be fixed. Basically, the scraper splits the area into "map chunks" and for each of the chunks it uses the "Search this area" feature to only get places at that location to increase the capture rate. Unless you are searching in cities or for very common terms, most areas don't contain anything which is why it seems like the scraper is stuck, it still finds something once in a while though. For some runs you shared, the $/place ratio is quite good but for some, it is not ideal - this depends mostly on the density of the searched area and how frequent the type of the place is.

We are working on a more optimized approach that will start on lower zoom and zoom in only when needed but it is not yet ready.

Would you expect very different number of places for some of the searches you did? We can explore these manually.

User avatar

nico_v

2 months ago

Hello back Luk谩拧 , thank you very much for your help here, very clear and nothing to add on my end. I will re-run the typo-ed ones & keep the other ones as they are then. Thank you and please do ping me whenever that update is done, I'd love to give it a try on past scraped runs.

User avatar

Hey, I am closing the issue for now, but dont hesitate to reopen it if you need anything else.

Developer
Maintained by Apify
Actor metrics
  • 4.6k monthly users
  • 97.6% runs succeeded
  • 2.8 days response time
  • Created in Nov 2018
  • Modified 3 days ago