Pricing

Pay per usage

Reliable Playwright Web Scraper - Python page function

Crawl any website with a headless browser and your own Python page function. Reliable runs, honest per-result pricing, clean flat output. Respects robots.txt.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Radosław Szal

Actor stats

Bookmarked

Total users

Monthly active users

29 minutes ago

Last modified

Reliable Playwright Web Scraper

🔗 Part of the Apify actors collection — 6 reliable, tested scrapers & data tools.

Crawl any site with a headless Chromium browser and your own Python page function.
Reliable runs, honest per‑result pricing, respects robots.txt by default.

Quick start

{
  "startUrls": [{ "url": "https://apify.com" }],
  "pageFunction": "async def page_function(page, context, request):\n    return {\n        \"url\": page.url,\n        \"title\": await page.title()\n    }"
}

Page function

Signature:

async def page_function(page, context, request):
    # page      – Playwright Page instance
    # context   – Actor context (key‑value store, dataset, etc.)
    # request   – Current Request object (url, userData, …)
    # Return a dict or a list of dicts; each dict becomes one result item.

Crawling

linkSelector – CSS selector for links to follow.
includeGlobs – Glob patterns that URLs must match to be enqueued.
maxRequestsPerCrawl – Hard limit on total requests for the run.

Input

Field	Type	Description
startUrls	array[object]	List of `{ "url": "…" }` to seed the crawl
pageFunction	string	Python source of the async page function
linkSelector	string	CSS selector for link discovery
includeGlobs	array[string]	URL glob patterns to follow
maxRequestsPerCrawl	integer	Max requests per run
maxConcurrency	integer	Parallel browser contexts (default 5)
requestTimeoutSecs	integer	Per-page timeout in seconds (default 45)
waitUntil	string	Playwright `waitUntil` (`load`, `domcontentloaded`, `networkidle`)
respectRobotsTxt	boolean	Obey `robots.txt` (default `true`)
proxyConfiguration	object	Apify proxy config
maxItems	integer	Stop after this many result items

Pricing

Pay per result item (flat rate).
First N items free (see actor pricing page).
No hidden fees; you only pay for data you actually receive.

Notes

robots.txt is respected by default (URLs disallowed for crawlers are skipped before they are visited). Turn respectRobotsTxt off only for sites you own.
Your page function runs inside your own run (your account, your data) — like any code you run on the platform. A per-page timeout bounds runaway code.
You are responsible for ensuring your scraping complies with applicable laws and the target site's terms of service.

Full Web Data Extractor via Playwright

mcheese/OneForAll

A powerful Python scraper built with Playwright and headless Chromium to search, extract, and collect all available data from any dynamic website or SPA. Handles Javascript rendering seamlessly.

Nguyễn Minh Chí

Rust Input Function Example

lukaskrivka/rust-input-function-example

Dynamically compile and run input-provided page function. Like Cheerio Scraper but in Rust.

Lukáš Křivka

python org

kudasav/python-org

An actor to scrape upcoming Python events from all around the world

Kuda Savanhu

Website to Markdown – Clean LLM & RAG Content Extractor

dataquarry/website-to-markdown

Convert any public web page to clean, LLM-ready Markdown with metadata — by URL, a list of URLs, or a whole-site crawl. Strips nav/ads/boilerplate, keeps headings/lists/tables/code. Respects robots.txt. No API key.

Daniel Brenner

LinkedIn Job Scraper – No Login Required, Detailed Job Data

dr.ollie/linkedin-job-scraper---no-login-required-detailed-job-data

Scrapes LinkedIn jobs without login or cookies. In a single run, it fetches title, company, location, posted date, full description, applicant count, and all job criteria (employment type, seniority, function, industries, etc.). Lightweight Python/BS4, no headless browser needed.

Dr. Ollie

Universal Web Scraper - Extract Any URL

lazymac/web-scraper-toolkit

Pay-per-result web scraper with JS rendering, CSS selector / XPath / regex extraction, schema validation, retry on failure. Use for product catalogs, competitor pricing, news aggregation, lead generation. Fast (<2s/page), respects robots.txt by default.

2x lazymac

Empty Python project

decent_nestling/fb-group-crawler-python

Empty project in Python.

Sa Ph

5.0

Dataset Processor in Python

drobnikj/dataset-processor-python

This actor utilizes Python to process the dataset.

Jakub Drobník

Python Scraper

sovanza.inc/python-scraper

Python Scraper extracts web page data using Requests and BeautifulSoup. It collects titles, meta tags, headings, links, images, Open Graph data, text snippets, and custom CSS selector fields, with exports to JSON, CSV, Excel, XML, or HTML.

Sovanza

5.0

PyPI Python Packages Scraper - Versions, Authors & Licenses

scrapers_lat/pypi-packages-scraper

Scrape Python packages by name or keyword: version, summary, author and maintainer contacts, license, repository links, requires-python, release date, keywords, classifiers and dependencies. Export to JSON, CSV or Excel.