Shopee Scraper avatar
Shopee Scraper
Under maintenance
Try for free

7 days trial then $39.00/month - No credit card required now

View all Actors
This Actor is under maintenance.

This Actor may be unreliable while under maintenance. Would you like to try a similar Actor instead?

See alternative Actors
Shopee Scraper

Shopee Scraper

lukass/shopee-scraper
Try for free

7 days trial then $39.00/month - No credit card required now

Get product details from one of the largest ecommerce website there is, Shopee. Scrape prices, ids, brands, descriptions, ratings and other with the super efficient unofficial API.

User avatar

ERROR CheerioCrawler: handleRequestFunction failed

Closed

ankitsachdev04 opened this issue
2 years ago

Hi my runs on Malaysia store keeps timing - is this due to a setting? how can I improve the output and minimize the timeouts. I am not able to attach the log for some reason.

e.g. 2022-09-13T06:58:54.082Z ACTOR: Pulling Docker image from repository. 2022-09-13T06:58:54.924Z ACTOR: Creating Docker container. 2022-09-13T06:58:55.216Z ACTOR: Starting Docker container. 2022-09-13T06:58:55.780Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1280x720x16 -nolisten tcp 2022-09-13T06:58:55.782Z Executing main command 2022-09-13T06:58:57.034Z INFO System info {"apifyVersion":"2.3.2","apifyClientVersion":"2.3.1","osType":"Linux","nodeVersion":"v16.15.0"} 2022-09-13T06:58:58.874Z INFO Starting the crawl. 2022-09-13T06:58:58.943Z INFO CheerioCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.7,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}} 2022-09-13T06:59:02.381Z INFO Page opened. {"label":"KEYWORD_LIST","url":"https://shopee.com.my/api/v4/search/search_items?by=relevancy&keyword=Cups & Mugs&limit=60&newest=0&order=desc&page_type=search&scenario=PAGE_GLOBAL_SEARCH&version=2"} 2022-09-13T06:59:06.153Z INFO Page opened. {"label":"KEYWORD_LIST","url":"https://shopee.com.my/api/v4/search/search_items?by=relevancy&keyword=Cups & Mugs&limit=60&newest=60&order=desc&page_type=search&scenario=PAGE_GLOBAL_SEARCH&version=2"} 2022-09-13T06:59:10.973Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://shopee.com.my/api/v4/item/get?itemid=4762154741&shopid=118059163","retryCount":1,"id":"3BiGOFw78VKe32e"} 2022-09-13T06:59:10.975Z Error: Request blocked - received 403 status code 2022-09-13T06:59:10.977Z at CheerioCrawler._throwOnBlockedRequest (/home/myuser/node_modules/apify/build/crawlers/cheerio_crawler.js:792:19) 2022-09-13T06:59:10.979Z at CheerioCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/crawlers/cheerio_crawler.js:479:18) 2022-09-13T06:59:10.981Z at runMicrotasks (

User avatar

Hello, sorry for late response can you send me share link on your run to check inputs and settings?

Developer
Maintained by Community
Actor metrics
  • 26 monthly users
  • 95.7% runs succeeded
  • days response time
  • Created in May 2022
  • Modified 27 days ago
Categories