No credit card required

Puppeteer Scraper

apify/puppeteer-scraper

No credit card required

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Back to issues Create new issue

always fail to get the content since last month

Closed

agent_ta opened this issue

I'm using this for getting Shopee similar product and it works just before last month. But it keep getting fail since then.

Lukáš Křivka (lukaskrivka)

Hello,

There are 2 separate issues:

The wait until "networkidle2" now doesn't finish. Shopee probably added some tracking network. You just need to change it to "load"
Seems you have scrolling for 5000 pixels. That can take time. You might wanna increase the page load and page function timeouts.

See here successful run https://console.apify.com/view/runs/zU8kNmCXDG34a3u87

agent_ta

Just have the same issue as you can see here: https://console.apify.com/actors/runs/TERTZmUNH13saHyCg#log

It keep trying until $2 for nothing. The json are not loaded.

Add comment

Developer

Apify

Actor Metrics

446 monthly users
96 bookmarks
>99% runs succeeded
Created in Apr 2019
Modified 8 months ago

Categories

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

121

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

459

Instagram follower scraper

bhansalisoft/instagram-follower-scraper

Instagram follower scraper- Scrap Instagram followers from any Instagram profiles.

bhansalisoft

916

Simple Contact Info and Social Media Scraper

pajoe/simple-contact-info-and-social-media-scraper

This Apify actor is designed to crawl web pages and extract social media handles, emails, and phone numbers using Puppeteer. It can handle dynamic content and navigate through multiple pages, making it suitable for comprehensive data extraction tasks.

va-gasd

Cloudflare Web Scraper

dtrungtin/cloudflare-web-scraper

Prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems

Tin Duong

Redfin Fast Scraper

mantisus/redfin-fast-scraper

Redfin: Scrape fast, stay light! Skip bloated browser tools. My Redfin scraper extracts property data in a flash, no heavy lifting is needed. Scrape/monitor listings with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Thefork Fast Scraper

mantisus/thefork-fast-scraper

Scrape TheFork.com quickly and easily! Skip bloated browser tools. This scraper extracts restaurant data in a flash, no heavy lifting is needed. Scrape and monitor data with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Redfin Fast Scraper Per Results

mantisus/redfin-fast-scraper-per-results

Maksym Bohomolov

Thefork Fast Scraper Per Result

mantisus/thefork-fast-scraper-per-result

Maksym Bohomolov

Google Direction Scraper

dev_bodex/google-direction-scraper

This actor automates extracting route directions from Google Maps. Using Node.js and Puppeteer, it retrieves travel routes, distances, and estimated times for various transport modes, offering structured data for navigation, logistics, or travel planning applications.