Tripadvisor Scraper
Pay $3.00 for 1,000 results
Tripadvisor Scraper
Pay $3.00 for 1,000 results
This unofficial Tripadvisor API is a data extraction tool able to get data on hotels, restaurants, things to do, vacation rentals, attractions, tours, and public trips. Get pricing, contact details, amenities, awards, ratings, and more. Download your data in Excel, JSON, CSV, and other formats.
Do you want to learn more about this Actor?
Get a demoOnly getting 10k results per location, minus a few hundred
Closed
I set the max results to 200k. I only get just below 10k results though per location. I scraped Australia, Italy, Ireland, UK etc. They all give me around 9500-9900 results. What's wrong?
Hi, thanks for opening this issue!
Unfortunately, this is a limitation of TripAdvisor itself. If you try searching for the results on their webpage, the furthest where you will get will be the 9990th result. They mention it their pagination - Showing results 1-30 of 10,000. Example URL for the last pagination: https://www.tripadvisor.com/Attractions-g186216-Activities-oa9960-United_Kingdom.html
If you wish to overcome this 10k results limit, then you can do so by individually scraping sub-regions of your desired location. So e.g., under UK you could search for London etc. It's not an ideal solution, but with the results limit set by TripAdvisor there is not much else that can be done. You can experiment with other filters which could narrow down the search results.
There seems to be an option to filter the sub-locations directly in the paginations page, which we could automate, but it doesn't seem to work from TripAdvisor's side. Upon clicking onto the location filter button, it just redirects me somewhere else...
Also to mention, the few hundred missing results are simply duplicate results that TripAdvisor is randomly repeating in their 10k search results for some reason. The scraper automatically ignores them.
I hope this helps, let me know if you find anything else related to this, which we could improve this scraper with. Thank you and happy scraping!
Maximillian Copelli- 617 monthly users
- 74 stars
- 97.7% runs succeeded
- 3.5 days response time
- Created in Nov 2019
- Modified 3 days ago
