Pricing

Pay per usage

Reliable Playwright Web Scraper - Python page function

Crawl any website with a headless browser and your own Python page function. Reliable runs, honest per-result pricing, clean flat output. Respects robots.txt.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Radosław Szal

Actor stats

Bookmarked

Total users

Monthly active users

an hour ago

Last modified

0.2 (2026-07-23) — G4 panel round 1 fixes (empirycznie zweryfikowane vs crawlee 1.8.3)

ConcurrencySettings: desired<=max (default desired=10 rzucał ValueError dla max<10 → limit cicho ignorowany → do 100 kontekstów Chromium → OOM na 4GB). Naprawione.
includeGlobs: Glob(g) zamiast surowych stringów (crawlee robił AttributeError → feature 100% martwy, zero linków enqueue). Naprawione.
robots.txt: natywny Crawlee respect_robots_txt_file — PRZED nawigacją (poprawnie), zamiast mojego buggy after-nav check. Usunięty robots.py (naprawia też httpx-poza-requirements).
FAIL-on-zero: odpala też gdy WSZYSTKIE requesty padły sieciowo (site down/blocked) — failed_request_handler. Wcześniej "Scraped 0" wyglądało jak sukces.
crawler.stop() na cap (nie ładuj kolejnych stron), guard push-loop, README (requestTimeoutSecs + model user-kodu). Testy 10/10 (page_function).

0.1 (2026-07-23)

First version: generic Playwright web crawler + user Python page function.
Reliability (weaponize the 2.7★ incumbent): per-page error isolation, retries, deterministic timeouts, request cap. Transparent PPE (per-result, fail-closed) + free mode. FAIL-on-zero.
Respects robots.txt / TDM reservation by default (legal condition). Link enqueueing via linkSelector + include globs. Proxy support.

Full Web Data Extractor via Playwright

mcheese/OneForAll

A powerful Python scraper built with Playwright and headless Chromium to search, extract, and collect all available data from any dynamic website or SPA. Handles Javascript rendering seamlessly.

Nguyễn Minh Chí

Rust Input Function Example

lukaskrivka/rust-input-function-example

Dynamically compile and run input-provided page function. Like Cheerio Scraper but in Rust.

Lukáš Křivka

python org

kudasav/python-org

An actor to scrape upcoming Python events from all around the world

Kuda Savanhu

Website to Markdown – Clean LLM & RAG Content Extractor

dataquarry/website-to-markdown

Convert any public web page to clean, LLM-ready Markdown with metadata — by URL, a list of URLs, or a whole-site crawl. Strips nav/ads/boilerplate, keeps headings/lists/tables/code. Respects robots.txt. No API key.

Daniel Brenner

LinkedIn Job Scraper – No Login Required, Detailed Job Data

dr.ollie/linkedin-job-scraper---no-login-required-detailed-job-data

Scrapes LinkedIn jobs without login or cookies. In a single run, it fetches title, company, location, posted date, full description, applicant count, and all job criteria (employment type, seniority, function, industries, etc.). Lightweight Python/BS4, no headless browser needed.

Dr. Ollie

Universal Web Scraper - Extract Any URL

lazymac/web-scraper-toolkit

Pay-per-result web scraper with JS rendering, CSS selector / XPath / regex extraction, schema validation, retry on failure. Use for product catalogs, competitor pricing, news aggregation, lead generation. Fast (<2s/page), respects robots.txt by default.

2x lazymac

Empty Python project

decent_nestling/fb-group-crawler-python

Empty project in Python.

Sa Ph

5.0

Dataset Processor in Python

drobnikj/dataset-processor-python

This actor utilizes Python to process the dataset.

Jakub Drobník

Python Scraper

sovanza.inc/python-scraper

Python Scraper extracts web page data using Requests and BeautifulSoup. It collects titles, meta tags, headings, links, images, Open Graph data, text snippets, and custom CSS selector fields, with exports to JSON, CSV, Excel, XML, or HTML.

Sovanza

5.0

PyPI Python Packages Scraper - Versions, Authors & Licenses

scrapers_lat/pypi-packages-scraper

Scrape Python packages by name or keyword: version, summary, author and maintainer contacts, license, repository links, requires-python, release date, keywords, classifiers and dependencies. Export to JSON, CSV or Excel.