Use fast HTTP extraction, browser rendering for JavaScript-heavy pages, or auto mode that tries HTTP first and falls back to browser for zero-content or JavaScript-shell pages and classified 401, 403, 429, or challenge responses.

Type:string

Default:http

Options:

httpbrowserauto

Maximum pages

maxPages

Optional

Maximum number of URLs to process from the input list. Keep this low for first tests, especially with browser rendering.

Type:integer

Minimum:1

Maximum:100

Default:10

Include links

includeLinks

Optional

Extract normalized links from each page.

Type:boolean

Default:true

Include images

includeImages

Optional

Extract normalized image URLs and alt text from each page.

Type:boolean

Default:false

Include source HTML

includeHtml

Optional

Store truncated page HTML in each dataset item. Useful for debugging, but increases output size.

Type:boolean

Default:false

Proxy configuration

proxyConfiguration

Optional

Optional standard proxy configuration used by both HTTP and Chromium requests. Leave disabled for direct access; enable Apify Proxy when a public site blocks the direct route.

Type:object

Default:

{
  "useApifyProxy": false
}

Wait for selector

waitForSelector

Optional

Optional CSS selector to wait for in browser mode before extracting content, for example main or article.

Type:string

Timeout per page (seconds)

timeoutSecs

Optional

Maximum time spent fetching or rendering one page.

Type:integer

Minimum:5

Maximum:60

Default:20

Maximum HTML bytes per page

maxBytes

Optional

Large pages are truncated before conversion to keep runs predictable and affordable.

Type:integer

Minimum:100000

Maximum:5000000

Content selector

contentSelector

Optional

Optional CSS selector for the exact content region to convert. If it does not match, the normal article extraction is used.

Type:string

Prefer main article content

onlyMainContent

Optional

Prefer the readable article region over navigation and page chrome when it can be identified.

Type:boolean

Default:false

Maximum Markdown characters per page

maxCharacters

Optional

Optional cap for the converted Markdown field. A warning is included when output is truncated.

Type:integer

Minimum:1000

Maximum:1000000

Maximum work time (seconds)

maxRunSeconds

Optional

Stop admitting new pages before the platform timeout so completed pages and a pending-URL checkpoint can be saved.

Type:integer

Minimum:35

Maximum:270

Default:270

Resume URLs from a checkpoint

resumeUrls

Optional

Optional pending URLs copied from a prior PENDING_URLS record. They are processed before startUrls and deduplicated by normalized URL.

Type:array

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

21K

3.8

(23)

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

198K

4.7

(35)

Notion Page Scraper | Extract Wiki, Tables & Markdown

forlex/notion-page-scraper

Scrape public Notion pages, databases, and wikis into clean JSON, Markdown, or HTML. Fully reliable Playwright engine that succeeds where others fail. Perfect for AI/RAG, backups, and data extraction.

Forlex Lab

5.0

(1)

X (Twitter) Article to Markdown Scraper - Long Form Posts

seemuapps/x-article-to-markdown-scraper

Convert any X (Twitter) long-form Article or Notes post into clean Markdown, ready for AI, RAG, and LLM ingestion pipelines.

Seemu Scraping

Website To Markdown

smart_api/website-to-markdown

Convert any webpage into clean, LLM-ready Markdown in seconds — perfect for AI training data, RAG pipelines, and content archiving.

SmartApi

5.0

(1)

OpenAI Web Scraper

dtrungtin/openai-web-scraper

Crawl web pages and extract structured information using OpenAI

Tin

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

170K

4.6

(235)

Web Page to Single-Page PDF & HTML (Automation-Ready)

exciting_perfume/Web-Page-to-Single-Page-PDF-and-HTML

Convert webpages to single-page PDFs and extract raw HTML via API. Captures full scroll height (no A4 splits). Built for automation with n8n, Make, and Zapier. Ideal for archiving, AI workflows, compliance, and bulk processing.

Gavin Campbell

Universal Web to Markdown (Bulk & AI-Ready)

lentic_october/web-to-markdown-converter

Bulk convert any website URLs to clean Markdown for AI & LLMs. Universal scraper that removes ads, scripts, and clutter. Optimized for RAG, ChatGPT, Claude, and LangChain. Fast, async, and API-ready.

kalthireddy Abhishek

PDF & DOCX to Markdown — Document Extractor for LLM/RAG

fetchbase/document-to-markdown

Convert PDF and Word (DOCX) documents into clean Markdown, text, or JSON. Smart PDF paragraph reflow, page markers for RAG citations, full DOCX structure (headings, lists, tables), custom auth headers. No browser — parses in seconds. Charged per page processed — no startup fee.