No credit card required

Playwright Scraper

apify/playwright-scraper

No credit card required

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

Actor Stops Working at Page 16

Closed

YMF_Global opened this issue

Hello,

I built an actor that could scrape paginated content but for whatever reason, on the 16th page, it fails consistently. The error indicates the page function is timing out but when I increased from 360s to 720s the whole Actor now doesn't seem to be working at all.

It's now unable to complete any task that has a timeout function, eg waitForSelector etc. Any help would be greatly appreciated!

Add comment

Developer

Apify

Actor Metrics

81 monthly users
22 stars
99% runs succeeded
59 days response time
Created in Aug 2022
Modified 7 months ago

Categories

Developer tools

Open source

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

73.7k

332

Facebook Marketplace

shmlkv/facebook-marketplace

This is a simple scraper for Facebook Marketplace. It uses Playwright to scrape the data

Andre Sh

457

Redfin Fast Scraper

mantisus/redfin-fast-scraper

Redfin: Scrape fast, stay light! Skip bloated browser tools. My Redfin scraper extracts property data in a flash, no heavy lifting is needed. Scrape/monitor listings with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Thefork Fast Scraper

mantisus/thefork-fast-scraper

Scrape TheFork.com quickly and easily! Skip bloated browser tools. This scraper extracts restaurant data in a flash, no heavy lifting is needed. Scrape and monitor data with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Redfin Fast Scraper Per Results

mantisus/redfin-fast-scraper-per-results

Maksym Bohomolov

Thefork Fast Scraper Per Result

mantisus/thefork-fast-scraper-per-result

Maksym Bohomolov

X Crawler

lumen_limitless/x-crawler

This project is a web scraper designed to extract user data and tweets from X (formerly known as Twitter) using Crawlee and Playwright.

lumen limitless

Zalando Price Comparator

mantisus/zalando-price-comparator

Zalando: scrape without stressing! Skip the bloated browser-based tools. My Zalando scraper extracts price and stock data from all Zalando stores. Scrape prices and remainders, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

31.7k

852

Paris Fashion Week Calendar

runtime/paris-fashion-week-calendar

This crawler is designed to scrape detailed data from the Paris Fashion Week calendar using Playwright. It retrieves information about brands, event types, schedules, formats (e.g., physical or digital), and invitation modalities.