No credit card required
Google Maps Scraper
No credit card required
Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.
Qustion about different request pages?
Closed
Hi, ALL I met a problem.
I used the same parameters to run Scraper in two location: London and Isle of Man where I only change the "locationQuery" in parameter.
Comparing to the area size of the two, where London is 1,572 km2 and Isle of Man is 572 km2, which means London is three times than the Isle of Man. But the REQUESTS of London only have the 1300 pages and Isle of Man is 925 pages. Is something wrong with the parameters? How to explain this?
{ "searchStringsArray": ["***"], "locationQuery": "London", "maxCrawledPlacesPerSearch": 9999999, "language": "en", "maxImages": 10, "maxReviews": 50, "maxQuestions": 5, "reviewSort": "newest", "countryCode": "gb", "allPlacesNoSearchAction": "", "deeperCityScrape": True, "scrapeImageAuthors": True, "zoom": 15, }
Hi, Thanks for your patience.
-
The overall number of requests include both search pages (maps generated for the area) and place details. That means that initially, with the same zoom level, more requests would be generated for the Isle of Man (914) than for London (288). But in the case of London, more places were found which led to more requests overall (1 request per place; 288 + 993 = 1281 ~ 1300).
-
The area is generated with OpenStreetMaps API. You can compare it here:
a. https://nominatim.openstreetmap.org/ui/search.html?q=London
b. https://nominatim.openstreetmap.org/ui/search.html?q=Isle+of+Man
c. These links and also the resolved areas in km^2 are printed at the beginning of the run's log.
-
In this case, the Isle of Man actually generated size of 4463 km^2 because it includes area in the sea. That is of course a bug, but a hard one to resolve generically for all places. In any case, you can draw your own polygon to work around shortcomings of the Actor's geolocation.
Compass- 4.1k monthly users
- 97.8% runs succeeded
- 2.7 days response time
- Created in Nov 2018
- Modified about 2 hours ago
