Advanced Google Maps Reviews Scraper avatar
Advanced Google Maps Reviews Scraper
Try for free

3 days trial then $10.00/month - No credit card required now

View all Actors
Advanced Google Maps Reviews Scraper

Advanced Google Maps Reviews Scraper

slash-scrape/advanced-google-maps-reviews-scraper
Try for free

3 days trial then $10.00/month - No credit card required now

This Google Maps Reviews scraper lets you collect reviews for places from public Google Maps pages. You can get the star rating, review text, photos and images, response from the place, and (optionally) some details about the reviewer like their name and a link to their profile.

BM

Crawler did not run at all

Open

bilingual_machine opened this issue
2 months ago

I configured the run with the URL and it just kept failing; can you help? Thanks

slash-scrape avatar

Do you have an error message or similar? It's very hard to debug from the message you've sent

BM

bilingual_machine

2 months ago

I can understand the difficulty in identifying the problem.

Here's the full log:

2024-05-13T10:14:05.591Z ACTOR: Pulling Docker image of build 4MOmd62h2fPm5NI1Z from repository. 2024-05-13T10:14:08.507Z ACTOR: Creating Docker container. 2024-05-13T10:14:08.785Z ACTOR: Starting Docker container. 2024-05-13T10:14:09.495Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2024-05-13T10:14:09.496Z Executing main command 2024-05-13T10:14:12.241Z INFO System info {"apifyVersion":"3.1.14","apifyClientVersion":"2.8.4","crawleeVersion":"3.6.2","osType":"Linux","nodeVersion":"v18.19.1"} 2024-05-13T10:14:13.180Z INFO PlaywrightCrawler: Starting the crawler. 2024-05-13T10:14:24.879Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. locator.textContent: Timeout 5000ms exceeded. 2024-05-13T10:14:24.880Z Call log: 2024-05-13T10:14:24.882Z - waiting for locator('h1:not([aria-label^="Sponsored"])').filter({ hasNotText: /^Before you continue to Google$/ }) 2024-05-13T10:14:24.883Z 2024-05-13T10:14:24.884Z at /home/myuser/dist/routes.js:23:39 {"id":"FYfVqunjBJAwlmR","url":"https://www.google.pt/maps/place/Igreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto/@41.1410065,-8.6186113,17z/data=!4m16!1m7!3m6!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!2sIgreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto!8m2!3d41.1410065!4d-8.616031!16zL20vMGczN2sy!3m7!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!8m2!3d41.1410065!4d-8.616031!9m1!1b1!16zL20vMGczN2sy?entry=ttu","retryCount":1} 2024-05-13T10:14:37.961Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. locator.textContent: Timeout 5000ms exceeded. 2024-05-13T10:14:37.963Z Call log: 2024-05-13T10:14:37.965Z - waiting for locator('h1:not([aria-label^="Sponsored"])').filter({ hasNotText: /^Before you continue to Google$/ }) 2024-05-13T10:14:37.966Z 2024-05-13T10:14:37.967Z at /home/myuser/dist/routes.js:23:39 {"id":"FYfVqunjBJAwlmR","url":"https://www.google.pt/maps/place/Igreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto/@41.1410065,-8.6186113,17z/data=!4m16!1m7!3m6!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!2sIgreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto!8m2!3d41.1410065!4d-8.616031!16zL20vMGczN2sy!3m7!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!8m2!3d41.1410065!4d-8.616031!9m1!1b1!16zL20vMGczN2sy?entry=ttu","retryCount":2} 2024-05-13T10:14:50.905Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. locator.textContent: Timeout 5000ms exceeded. 2024-05-13T10:14:50.907Z Call log: 2024-05-13T10:14:50.908Z - waiting for locator('h1:not([aria-label^="Sponsored"])').filter({ hasNotText: /^Before you continue to Google$/ }) 2024-05-13T10:14:50.910Z 2024-05-13T10:14:50.911Z at /home/myuser/dist/routes.js:23:39 {"id":"FYfVqunjBJAwlmR","url":"https://www.google.pt/maps/place/Igreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto/@41.1410065,-8.6186113,17z/data=!4m16!1m7!3m6!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!2sIgreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto!8m2!3d41.1410065!4d-8.616031!16zL20vMGczN2sy!3m7!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!8m2!3d41.1410065!4d-8.616031!9m1!1b1!16zL20vMGczN2sy?entry=ttu","retryCount":3} 2024-05-13T10:15:04.420Z ERROR PlaywrightCrawler: Request failed and reached maximum retries. locator.textContent: Timeout 5000ms exceeded. 2024-05-13T10:15:04.422Z Call log: 2024-05-13T10:15:04.423Z - waiting for locator('h1:not([aria-label^="Sponsored"])').filter({ hasNotText: /^Before you continue to Google$/ }) 2024-05-13T10:15:04.424Z 2024-05-13T10:15:04.426Z at /home/myuser/dist/routes.js:23:39 2024-05-13T10:15:04.427Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"FYfVqunjBJAwlmR","url":"https://www.google.pt/maps/place/Igreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto/@41.1410065,-8.6186113,17z/data=!4m16!1m7!3m6!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!2sIgreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto!8m2!3d41.1410065!4d-8.616031!16zL20vMGczN2sy!3m7!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!8m2!3d41.1410065!4d-8.616031!9m1!1b1!16zL20vMGczN2sy?entry=ttu","method":"GET","uniqueKey":"https://www.google.pt/maps/place/Igreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto/@41.1410065,-8.6186113,17z/data=!4m16!1m7!3m6!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!2sIgreja+e+Museu+de+S%C3%A3o+Francisco+do+Porto!8m2!3d41.1410065!4d-8.616031!16zL20vMGczN2sy!3m7!1s0xd24651e2e1751f9:0xcae5f5a2cd96956c!8m2!3d41.1410065!4d-8.616031!9m1!1b1!16zL20vMGczN2sy?entry=ttu"} 2024-05-13T10:15:04.491Z INFO PlaywrightCrawler: All requests from the queue have been processed, the crawler will shut down. 2024-05-13T10:15:04.925Z INFO PlaywrightCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,null,null,1],"requestAvgFailedDurationMillis":10401,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":1,"requestTotalDurationMillis":10401,"requestsTotal":1,"crawlerRuntimeMillis":51891} 2024-05-13T10:15:04.927Z INFO PlaywrightCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: locator.textContent: Timeout 5000ms exceeded. (at /home/myuser/dist/routes.js:23:39)"]} 2024-05-13T10:15:04.930Z INFO PlaywrightCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true}

slash-scrape avatar

This crawler is designed to work with the labels on the English language version of google; please use google.com instead of google.pt links and it should work.

Developer
Maintained by Community
Actor metrics
  • 11 monthly users
  • 1 star
  • 98.4% runs succeeded
  • 79 days response time
  • Created in Dec 2023
  • Modified 5 months ago