Pricing

from $1.26 / 1,000 results

Try for free

Go to Apify Store

Website to Markdown & RAG Chunks for AI

Try for free

Crawl public websites over HTTP and get clean Markdown plus ready-to-embed chunks with heading path, token estimate and hash. Sitemaps, robots.txt and a changed-pages mode. You only pay for pages that returned text.

Pricing

from $1.26 / 1,000 results

Rating

0.0

(0)

Developer

Belgair Data

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

A whole site from its sitemap to Markdown

Only changed docs pages since the last run

Apify Academy to Markdown for a knowledge base

Crawlee docs to Markdown and RAG chunks

Web to LLM Spanish — RAG-ready content extractor

fanciful_geode/web-to-llm-es

Crawls Spanish-language websites and extracts clean markdown content optimized for LLM RAG pipelines. Handles Spanish character encoding, removes boilerplate, and outputs structured chunks ready for embedding.

Ernesto de Armas

AI-Powered Smart Web Scraper

cloud9_ai/ai-web-scraper

Intelligent content extraction from any website using Crawlee + AI. Auto-detects structure, adapts to layout changes, handles JavaScript rendering. No custom code needed. Extract articles, products, listings from 1000s of pages.

cloud9

Website Content Crawler: Markdown for AI (Half Price)

laudable_instrument/website-content-crawler-half-price

Crawl any website and get each page's main content as clean Markdown and text for LLMs, RAG and search. Sitemap-seeded, de-duplicated, no nav or cookie banners. Respects robots.txt and AI-crawler opt-outs. $1.50 per 1,000 pages.

Unadhi

URL to Markdown API — Clean Page Text for LLMs, RAG & Agents

highbrow_fame/url-to-markdown-api

Fetches any URL and returns clean Markdown (readability-extracted main content), title, metadata and links; optional headless browser for JS pages. Unofficial URL to Markdown API.

yestrue

Web Fetch API — Fetch Any URL as HTML, Text, Markdown or JSON

highbrow_fame/web-fetch-api

Bulk HTTP fetch for agents: returns status, headers and body (raw HTML, text, Markdown or parsed JSON), follows redirects, optional browser rendering. Unofficial Web Fetch API.

yestrue

News Search API — Headlines & Articles by Keyword

highbrow_fame/news-search-api

Keyword news search over Google News (thousands of sources) with date range, language, country, dedup, source, publish time and optional full-text extraction. Unofficial News Search API.

yestrue

Website to Markdown — Clean Page Text for LLMs

sourcedirect/website-to-markdown

Fetch any URL and return clean markdown/text plus links. No headless browser for most pages. Free demo: https://vaytric.com/page-to-markdown/ — bulk URL lists here.

Kurt Landman

Markdown Crawler API — Crawl a Whole Website to Markdown

highbrow_fame/markdown-site-crawler

Crawls a site (links or sitemap, depth and page limits, robots.txt respected) into one Markdown document per page with title, URL, headings and links, for RAG. Unofficial Website to Markdown API.

yestrue

PubMed Biomedical & Clinical Research Scraper

litezero/pubmed-medical-research-scraper

Extract 36M+ biomedical research papers, clinical trial citations, journal abstracts, medical authors, and DOI links from PubMed NCBI.

LiteZero

Website Content Crawler (Anti-Bot) - $1.20 / 1000 Pages

scrapeunblocker/website-content-crawler

Crawl any website, even behind Cloudflare, DataDome, PerimeterX or Akamai, and get clean Markdown and text of every page for LLMs, RAG and AI agents. Main-content extraction, URL globs, sitemaps, depth and page limits. $1.20 per 1000 pages; failed pages are free.