Web Page to Markdown, JSON-LD & RAG Chunks (LLM-ready document) avatar

Web Page to Markdown, JSON-LD & RAG Chunks (LLM-ready document)

Pricing

$4.00 / 1,000 documents

Go to Apify Store
Web Page to Markdown, JSON-LD & RAG Chunks (LLM-ready document)

Web Page to Markdown, JSON-LD & RAG Chunks (LLM-ready document)

Convert any web page or docs site into clean, LLM-ready data: HTML to markdown, parsed JSON-LD and OpenGraph structured data, headings, tables, the link graph, token counts and embedding-ready chunks. Built for RAG pipelines, AI agents and content analysis. No browser, no proxies, pay per document.

Pricing

$4.00 / 1,000 documents

Rating

0.0

(0)

Developer

Andy Wang

Andy Wang

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

9 hours ago

Last modified

Share

Turn any web page or docs site into one clean, structured document for RAG, agents and analysis: HTML to markdown, structured data, and embedding chunks in a single dataset item per page. You get markdown, structured data, the link graph, token counts and ready-to-embed chunks — in a single dataset item, per page.

Most "web to markdown" tools hand you a wall of text. This one keeps the shape:

  • markdown — article content with navigation, footers, cookie banners, ads, scripts and styles removed
  • jsonLd — every application/ld+json block, parsed (Article, Product, FAQ, Recipe, Organization …), broken blocks skipped instead of failing the run
  • openGraph — og:* metadata as an object
  • headings — h1–h3 with levels, so you can cut sections without guessing
  • tables — every table as an array of rows, for data the text loses
  • links — resolved absolute URLs with anchor text, plus internal/external counts
  • tokenEstimate and wordCount — so you can budget a prompt before you send it
  • chunks — overlapping, paragraph-aligned chunks sized for embedding

Input

FieldDefaultWhat it does
startUrls—Pages to convert; one dataset item each
maxPages1Hard cap per run (1–50)
followSameHostLinksfalseQueue same-host links (docs site → one dataset)
includeChunkstrueEmit embedding-ready chunks
chunkTokens800Approximate tokens per chunk
timeoutSecs30Per-page timeout

Output example

{
"url": "https://example.com/article",
"title": "How it works",
"description": "…",
"wordCount": 1240,
"tokenEstimate": 1650,
"markdown": "# How it works\n\n…",
"headings": [{ "level": 1, "text": "How it works" }],
"jsonLd": [{ "@type": "Article", "headline": "How it works" }],
"openGraph": { "title": "How it works", "type": "article" },
"tables": [[["Plan", "Price"], ["Free", "$0"]]],
"links": { "total": 18, "external": 6, "sample": [{ "text": "Docs", "url": "https://…" }] },
"chunks": ["…# How it works…"]
}

Pricing

Pay per document. No subscription, no minimum. A single page costs a fraction of a cent; a 30-page docs crawl is priced per page.

Notes and limits

  • Fetches the HTML directly: fast and cheap, but it does not execute JavaScript. Pages that render client-side need a browser actor — say so in a review and we will add an optional rendering mode.
  • Respects robots.txt for followed links, caps responses at 5 MB, and refuses non-HTML content types rather than returning garbage.
  • Nothing is stored beyond your run's dataset.

Built and maintained by the team behind deepsense.stream. Issues and feature requests: open an issue on the actor page — every review is read.