Google Maps Scraper avatar
Google Maps Scraper

Pricing

Pay per event

Go to Store
Google Maps Scraper

Google Maps Scraper

Developed by

Compass

Compass

Maintained by Apify

Extract data from thousands of Google Maps locations and businesses. Get Google Maps data including reviews, reviewer details, images, contact info, opening hours, location, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

4.1 (57)

Pricing

Pay per event

1154

Total users

98.4k

Monthly users

9.4k

Runs succeeded

98%

Response time

4.2 days

Last modified

10 hours ago

LT

Crawler didn't complete

Closed

linen_torch opened this issue
a year ago

Time kept ticking but this just kept getting printed in the logs, does this mean it collected all the places i requested or it stalled?

2024-02-28T14:06:28.357Z INFO [STATS]: failed: 0 | ok: 212 | outOfPolygon: 110 | places: 198 | maps: 11 2024-02-28T14:06:39.567Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":17623,"requestsFinishedPerMinute":9,"requestsFailedPerMinute":0,"requestTotalDurationMillis":3771347,"requestsTotal":214,"crawlerRuntimeMillis":1380237,"retryHistogram":[214]} 2024-02-28T14:06:40.356Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0.019},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.37},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-02-28T14:07:28.386Z INFO [STATS]: failed: 0 | ok: 224 | outOfPolygon: 110 | places: 198 | maps: 11 2024-02-28T14:07:39.567Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":17255,"requestsFinishedPerMinute":9,"requestsFailedPerMinute":0,"requestTotalDurationMillis":3916825,"requestsTotal":227,"crawlerRuntimeMillis":1440236,"retryHistogram":[227]}

ondrejklinovsky avatar

Hi, this is a bug in the actor: when it collects enough results (in your case "maxCrawledPlacesPerSearch": 200), then he starts discarding all the remaining requests and prints only the stats. We are already working on this so it should be fixed soon. We'll also investigate why the actor skipped two places: 198/200. Thanks for the report.

CL

content_legume

a year ago

Fallido ENTRADA NO VÁLIDA: Las categorías actualmente funcionan solo para el idioma inglés.

CL

content_legume

a year ago

No work

ondrejklinovsky avatar

Hey,

we made some improvements that should prevent these bugs from happening. I'm gonna close the issue but feel free to reopen in case it happens again