No credit card required
Puppeteer Scraper
No credit card required
Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.
I'm using this for getting Shopee similar product and it works just before last month. But it keep getting fail since then.
Hello,
There are 2 separate issues:
- The wait until "networkidle2" now doesn't finish. Shopee probably added some tracking network. You just need to change it to "load"
- Seems you have scrolling for 5000 pixels. That can take time. You might wanna increase the page load and page function timeouts.
See here successful run https://console.apify.com/view/runs/zU8kNmCXDG34a3u87
Just have the same issue as you can see here: https://console.apify.com/actors/runs/TERTZmUNH13saHyCg#log
It keep trying until $2 for nothing. The json are not loaded.
- 246 monthly users
- 99.8% runs succeeded
- 13 days response time
- Created in Apr 2019
- Modified about 1 month ago