Puppeteer Scraper avatar
Puppeteer Scraper
Try for free

No credit card required

View all Actors
Puppeteer Scraper

Puppeteer Scraper

apify/puppeteer-scraper
Try for free

No credit card required

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

User avatar

always fail to get the content since last month

Closed

agent_ta opened this issue
7 months ago

I'm using this for getting Shopee similar product and it works just before last month. But it keep getting fail since then.

User avatar

Hello,

There are 2 separate issues:

  1. The wait until "networkidle2" now doesn't finish. Shopee probably added some tracking network. You just need to change it to "load"
  2. Seems you have scrolling for 5000 pixels. That can take time. You might wanna increase the page load and page function timeouts.

See here successful run https://console.apify.com/view/runs/zU8kNmCXDG34a3u87

User avatar

agent_ta

6 months ago

Just have the same issue as you can see here: https://console.apify.com/actors/runs/TERTZmUNH13saHyCg#log

It keep trying until $2 for nothing. The json are not loaded.

Developer
Maintained by Apify
Actor metrics
  • 284 monthly users
  • 99.8% runs succeeded
  • 15 days response time
  • Created in Apr 2019
  • Modified about 1 month ago