Google Maps Scraper

Hello,

In some of your runs, you did overflow account memory for OCR analysis. The team will fix it so it doesn't require extra actor run on your account.

OK awesome thank you.

Separate question: I don't see a contact email field in the results - can that be added or would I need to use a different scraper?

Google Maps don't have email data. You need to pass the dataset from Google Maps Scraper to the dedicated Email Extractor which goes to each website and tries to find it there.

Awesome thanks Lukas

When will I know when the original issue is fixed so I can run it again?

For now try to run it one by one to limit the problem with max memory. We will resolve the potential problem later today.

What do you mean one by one? Sorry, I’m new to this.

The problem I mentioned happened when the Google Maps Scraper tried to use the OCR actor which is needed for getting all pins and requires 128 MB but your account no longer had any available memory. If you run a single Google Map Scraper with 16 GB and nothing else, it will be fine, the problem will not happen.

That’s odd because I switched it to 16GB and it seemed to still happen. The last few runs I had the memory set to 16GB. Am I missing something?

The problem occurred earlier when you ran the 32 GB runs. We will check why the latest runs possibly missed places.

Great, thank you!

Hi Lukas, is it good to go now?

Just tried to run it again and I'm still missing results from runs with smaller radiuses and I am missing places that I searched on Google Maps myself that are definitely in the search radius (eg, https://www.google.com/maps/place/CC+Massage+Therapy/@49.2494665,-123.1280256,15z/data=!4m6!3m5!1s0x548673924d781853:0x33dafae27a38dd28!8m2!3d49.2494665!4d-123.1280256!16s%2Fg%2F11h7gs128f?entry=ttu)

Hi Lukas, just checking in here - thanks!

Hello,

We have found a new way to extract there and will release it in upcoming days, hopefully asap.

Thanks for the feedback

Hello,

There was also a bug unrelated to the new way and your input now gives more than 2x more places, see https://console.apify.com/view/runs/mABGgm6QHYtC5XudC.

I will update you about the new way which should be even better

Great, thanks Lukas!

I will just wait until the newer version is done.

When I really start working through my project, I don't plan to use the radius method, but rather subdividing the city into rectangles or odd shapes. Will this new version work for that as well?

Yes, that should not impact it. The scraper actually generates rectangles based on the user area so most people just need to use cities or countries. Odd-shaped small polygons are not ideal because you have to split them into overlapping rectangles anyway and then most places might be outside of the polygon and thrown away (just a small waste of compute)

Hi Lukas, checking in - is the new version close to ready?

Hello,

Sorry for the late notice. The lead dev is off this week so we will probably not release it until next week. The current version should still work reasonably well. I'm now doing some test runs on New York, I will post the comparison to you evening/tomorrow.

Thanks Lukas. I’d prefer to wait until it is fixed. Next week is fine.

Here is your input with a new version - https://console.apify.com/view/runs/MhmFhAyd06DskwHBZ. 31 -> 44 places. We saw a similar % increase in the case of the New York scrape. So that feels like a realistic target.

We will be validating a bit more but if you see place it didn't capture, let us know please.

Great, thanks Lukas.