Puppeteer Scraper avatar
Puppeteer Scraper

Pricing

Pay per usage

Go to Store
Puppeteer Scraper

Puppeteer Scraper

apify/puppeteer-scraper

Developed by

Apify

Maintained by Apify

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

5.0 (5)

Pricing

Pay per usage

116

Monthly users

605

Runs succeeded

>99%

Response time

30 days

Last modified

10 months ago

AT

always fail to get the content since last month

Closed
agent_ta opened this issue
a year ago

I'm using this for getting Shopee similar product and it works just before last month. But it keep getting fail since then.

lukaskrivka avatar

Hello,

There are 2 separate issues:

  1. The wait until "networkidle2" now doesn't finish. Shopee probably added some tracking network. You just need to change it to "load"
  2. Seems you have scrolling for 5000 pixels. That can take time. You might wanna increase the page load and page function timeouts.

See here successful run https://console.apify.com/view/runs/zU8kNmCXDG34a3u87

AT

agent_ta

a year ago

Just have the same issue as you can see here: https://console.apify.com/actors/runs/TERTZmUNH13saHyCg#log

It keep trying until $2 for nothing. The json are not loaded.

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.