Pricing

from $0.01 / 1,000 results

Website to Markdown Scraper

Crawl any website and turn its pages into clean Markdown — plus optional plain text, raw HTML and full-page screenshots. Built for LLM, RAG and AI training datasets.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

Assia Fadli

Actor stats

Bookmarked

Total users

Monthly active users

17 hours ago

Last modified

Categories

Developer tools

Start URLs

startUrls

Required

The web pages the scraper opens first. Each entry must be a full http:// or https:// address. Provide several to cover multiple pages or sites in one run. With "Follow internal links" enabled, the scraper also crawls same-domain links found on these pages, up to the page limit.

Type:array

Example:

[
  {
    "url": "https://apify.com"
  },
  {
    "url": "https://docs.apify.com"
  }
]

Maximum pages

maxPages

Optional

Upper bound on the total number of pages scraped in one run (across all start URLs). Begin with 1–5 to validate your settings, then raise it. Larger values crawl deeper but cost more compute and time. Most relevant when link-following is on.

Type:integer

Minimum:1

Default:5

Example:25

Follow internal links

enqueue

Optional

When on, the scraper visits same-domain links discovered on each start page until the page limit is reached — the way to crawl a whole site. Turn it off to scrape only the exact URLs you supply (one record per URL).

Type:boolean

Default:true

Proxy configuration

proxyConfig

Optional

Proxy applied to every request. Keeping Apify Proxy on reduces blocking and rate limiting. You may pick specific groups or a country, or supply your own proxy URLs. Disabling proxy routes all traffic through a single datacenter IP, which many sites block.

Type:object

Default:

{
  "useApifyProxy": true
}

Capture page screenshots

screenshot

Optional

Save a full-page PNG of every page as a base64 data URI in the "screenshot" field. Handy for visual checks, but it enlarges each record and slows the run. Leave off if you only need text/Markdown.

Type:boolean

Default:true

Include plain text

getText

Optional

Also store each page's plain visible text in the "textContent" field. Markdown is produced either way — enable this only when you additionally want an unformatted text copy.

Type:boolean

Default:false

Include raw HTML

getHtml

Optional

Also store each page's full raw HTML in the "htmlContent" field. Useful when you want the original markup to parse yourself. This increases output size noticeably.

Type:boolean

Default:false

🔥 FireScrape AI Website Content Markdown Scraper

mohamedgb00714/fireScraper-AI-Website-Content-Markdown-Scraper

Advanced web scraper powered by Crawlee and Puppeteer — extracts website content, converts it to Markdown, and structures it for LLM training datasets.

mohamed el hadi msaid

305

1.9

(2)

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

AI_Builder

940

2.3

(3)

Website to Markdown Crawler for LLM & RAG

logiover/website-text-markdown-crawler

Crawl any website to clean Markdown and plain text for LLM training and RAG. HTML to Markdown, no API or login. Export website text to CSV or JSON.

Logiover

Website Crawler: Markdown Chunks for LLMs

themineworks/rag-crawler

Crawl any website into clean, pre-chunked Markdown with per-chunk token counts for RAG pipelines, vector DBs (Pinecone, Qdrant) and LLM context. MCP native for Claude & ChatGPT. SPA support via Playwright. Pay only for pages that crawl. A Firecrawl alternative.

The Mine Works

Website to Markdown Scraper - HTML to MD for RAG API

pink_comic/website-content-to-markdown

Convert web pages and HTML to clean Markdown for RAG, LLM training, AI knowledge bases, and content migration. Strips nav, ads, scripts, and styling while preserving structure. Bulk output includes word/link/image counts.

Ava Torres

Website to Markdown Crawler - Full-Site Text for LLMs & RAG

entranced_gelato/website-to-markdown-crawler

Crawl any website from a start URL and get every page as clean text + Markdown for LLMs, RAG, and AI agents. Follows internal links with depth and page limits, strips nav and ads, and returns one structured record per page. A fast, no-config site-to-Markdown crawler.

AIDevs

RAG Website Crawler — Markdown & AI Chunks

joaosbp/website-content-crawler

Crawl websites into clean Markdown, deterministic RAG chunks, canonical metadata, content hashes, and deduplicated AI-ready datasets for vector databases and agents.

João Victor

Website Markdown Crawler

moorish-dev/website-markdown-crawler

Crawls a website and converts every page to clean Markdown optimized for LLM ingestion.

Ziad Tarik

Get Site to Markdown

b-w/get-site

Website to Markdown Crawler An asynchronous web crawler that mirrors websites into a single organized markdown file, with handling for images and directory structure preservation. Designed to operate with low cost. This works great to build context for AI agents.

b-w.pro

Simple Website Scrapper (markdown format)

manojaditya64/simple-website-scrapper-markdown-format

A simple website scrapper that scrapes websites and converts it into markdown format which is easy to use with LLM. You can feed markdown data to LLM for easy analysis.