Tripadvisor Scraper avatar

Tripadvisor Scraper

Try for free

Pay $3.00 for 1,000 results

Go to Store
Tripadvisor Scraper

Tripadvisor Scraper

maxcopell/tripadvisor
Try for free

Pay $3.00 for 1,000 results

This unofficial Tripadvisor API is a data extraction tool able to get data on hotels, restaurants, things to do, vacation rentals, attractions, tours, and public trips. Get pricing, contact details, amenities, awards, ratings, and more. Download your data in Excel, JSON, CSV, and other formats.

Do you want to learn more about this Actor?

Get a demo
CO

"Things to do" scrape produces significantly less output than it should.

Closed

conservation opened this issue
5 months ago

I have been trying to scrape Things To Do under the search "elephant". When I search it on TripAdvisor under "Things To Do" in an incognito window, 30 results show up on the the first page, and there are 1000 results total. When I use this scraper, both using that URL and just putting "elephant" in the search box on the scraper, I get at most 5 results for a scrape of max 100. I have tried other inputs, and I get 20ish results for those.

I was wondering if there was a way to get more than 5 results, and see the rest of the search results for this query?

Thank you!

lukas.prusa avatar

Hi, thanks for opening this issue!

The problem is our crawling implementation of the search page. Basically, as of right now the search page is only ever used to find the first destination type result and then continue onto scraping that one. In your case, it means that the search is handled for the destination location type and finds https://www.tripadvisor.com/Tourism-g469382-Addo_Elephant_National_Park_Greater_Addo_Eastern_Cape-Vacations.html as the first result. This page only has 5 things to do.

However, this is something we would definitely like to add to the scraper :) Though it will require a lot of work before it's done, because we will have to handle a new complex page type.

I've added this to our backlog and will keep you updated here with the progress, thanks and happy scraping!

lhotanok avatar

Hello, just a small update on this issue: The fix is almost finished and the update should be published during the next week 🤞

lhotanok avatar

Hi, the Actor now supports both location queries such as Paris and keyword queries like elephant. Simply use the new input field query to define a location or a keyword you want to search by 🔎

See the example run with elephant query 🐘: https://console.apify.com/view/runs/zNrCbWPaGH66ZnPSm

And the dataset preview with name and description fields containing the elephant substring: https://api.apify.com/v2/datasets/BDzJ9Pue49vcOep2o/items?clean=true&fields=name,description&format=json

Developer
Maintained by Apify

Actor Metrics

  • 319 monthly users

  • 78 stars

  • 97% runs succeeded

  • 6.2 days response time

  • Created in Nov 2019

  • Modified 17 days ago

Categories