No credit card required

Playwright Scraper

apify/playwright-scraper

No credit card required

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Do you want to learn more about this Actor?

Get a demo

Change Log

1.0.11 (2023-08-22)

Updated Crawlee version to v3.5.2.
Updated Node.js version to v18.
Added new options:
- Dismiss cookie modals (closeCookieModals): Using the I don't care about cookies browser extension. When on, the crawler will automatically try to dismiss cookie consent modals. This can be useful when crawling European websites that show cookie consent modals.
- Maximum scrolling distance in pixels (maxScrollHeightPixels): The crawler will scroll down the page until all content is loaded or the maximum scrolling distance is reached. Setting this to 0 disables scrolling altogether.
- Exclude Glob Patterns (excludes): Glob patterns to match links in the page that you want to exclude from being enqueued.

1.0

Initial version built on Crawlee.
Proxy usage is now required.

Developer

Apify

Actor Metrics

68 monthly users
18 stars
>99% runs succeeded
54 days response time
Created in Aug 2022
Modified 6 months ago

Categories

Developer tools

Facebook Marketplace

shmlkv/facebook-marketplace

This is a simple scraper for Facebook Marketplace. It uses Playwright to scrape the data

Andre Sh

450

Redfin Fast Scraper

mantisus/redfin-fast-scraper

Redfin: Scrape fast, stay light! Skip bloated browser tools. My Redfin scraper extracts property data in a flash, no heavy lifting is needed. Scrape/monitor listings with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Thefork Fast Scraper

mantisus/thefork-fast-scraper

Scrape TheFork.com quickly and easily! Skip bloated browser tools. This scraper extracts restaurant data in a flash, no heavy lifting is needed. Scrape and monitor data with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Redfin Fast Scraper Per Results

mantisus/redfin-fast-scraper-per-results

Maksym Bohomolov

Zoopla.co.uk Fast Scraper

mantisus/zoopla-actor

Zoopla.co.uk: Scrape fast, stay light! Skip bloated browser tools. My Zoopla scraper extracts property data in a flash, no heavy lifting is needed. Scrape/monitor listings with ease, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Thefork Fast Scraper Per Result

mantisus/thefork-fast-scraper-per-result

Maksym Bohomolov

X Crawler

lumen_limitless/x-crawler

This project is a web scraper designed to extract user data and tweets from X (formerly known as Twitter) using Crawlee and Playwright.

lumen limitless

Zalando Price Comparator

mantisus/zalando-price-comparator

Zalando: scrape without stressing! Skip the bloated browser-based tools. My Zalando scraper extracts price and stock data from all Zalando stores. Scrape prices and remainders, all without Puppeteer or Playwright. ⚡️

Maksym Bohomolov

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.