TripAdvisor Scraper avatar
TripAdvisor Scraper

Pricing

$20.00/month + usage

Go to Store
TripAdvisor Scraper

TripAdvisor Scraper

Developed by

epctex

epctex

Maintained by Community

Explore with our Trip Advisor Scraper: an easy search for hotels, restaurants, attractions, and more by keywords or start URL. Enter check-in/out dates, and select currency and language. Promote locations, capture details, and retrieve emails and phone numbers if shared.

5.0 (1)

Pricing

$20.00/month + usage

9

Total users

582

Monthly users

29

Runs succeeded

>99%

Last modified

a day ago

GE

Getting "We got blocked" a LOT

Closed

agenthub opened this issue
a year ago
2024-04-18T16:24:25.007Z INFO BasicCrawler: Starting the crawler.
2024-04-18T16:24:25.739Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. RequestError: Stream closed with error code NGHTTP2_INTERNAL_ERROR
2024-04-18T16:24:25.741Z at file:///usr/src/app/src/main.js:51:19 {"id":"C3fNXPIwkGeg2je","url":"https://api.tripadvisor.com/api/internal/1.14/location/21342715?currency=USD&lang=en","retryCount":1}
2024-04-18T16:24:29.819Z INFO PHASE: -- Fetching place: https://www.tripadvisor.com/Hotel_Review-g189914-d21342715-Reviews-Vanha_Postitalo-Varkaus_Northern_Savonia.html
2024-04-18T16:24:30.590Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. We got blocked
2024-04-18T16:24:30.592Z at BasicCrawler.requestHandler (file:///usr/src/app/src/main.js:55:19) {"id":"BHiHD2BsASjaBmq","url":"https://www.tripadvisor.com/Hotel_Review-g189914-d21342715-Reviews-Vanha_Postitalo-Varkaus_Northern_Savonia.html","retryCount":1}
2024-04-18T16:24:34.774Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. We got blocked
2024-04-18T16:24:34.776Z at BasicCrawler.requestHandler (file:///usr/src/app/src/main.js:55:19) {"id":"BHiHD2BsASjaBmq","url":"https://www.tripadvisor.com/Hotel_Review-g189914-d21342715-Reviews-Vanha_Postitalo-Varkaus_Northern_Savonia.html","retryCount":2}
2024-04-18T16:24:38.118Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. We got blocked
2024-04-18T16:24:... [trimmed]
epctex avatar

epctex (epctex)

a year ago

Hey there!

Thank you very much for reaching out, using our actor, and letting us know about your problem. We checked the Run that you shared with us in detail and it seems like the problem is occurring due to the low qualified proxy IPs. By using the same queries with different proxy sets (or enriched), we retrieved the results without any problem.

At the current moment, you can kickstart the actor with the Residential Proxies to get better results. In the phase of Input, go to the Advanced Options and select Residential. Within that way, it should perform better.

Best