Docs to Markdown Crawler
Pricing
from $0.60 / 1,000 pages
Go to Apify Store
Docs to Markdown Crawler
Convert public documentation pages to Markdown with source URLs and optional section chunks. Follow documentation links within a bounded crawl.
Docs to Markdown Crawler
Pricing
from $0.60 / 1,000 pages
Convert public documentation pages to Markdown with source URLs and optional section chunks. Follow documentation links within a bounded crawl.
status
Required
ok means a successful, billable page. Failures are invalid_url, url_not_allowed, robots_disallowed, no_pages, fetch_failed, http_status, out_of_scope, too_large, unsupported_content, empty_content or budget_exhausted. Failed rows incur no Page events.
ok
Required
True for an extracted page; false for a failed input or page. On false, read error.code and error.message.
inputUrl
Required
Caller-supplied documentation root or page URL, retained verbatim for the input that produced this row.
url
Required
Canonical page URL after redirects, without its fragment; llms-full sections use their declared Source URL. On failure, the failing page URL or null if no page was reached.
title
Optional
First content H1, otherwise HTML title or URL pathname. Present only on successful pages.
markdown
Optional
Extracted page text with headings, links, lists, code and tables. Present only on success; scripts and navigation are removed from HTML.
headings
Optional
Objects with level (1-6) and text, in document order. Repeated headings remain; [] means none. Present only on success.
lastModified
Optional
ISO 8601 modification time from HTTP Last-Modified, then sitemap lastmod, then HTML metadata. Null when unavailable; absent on failure.
source
Optional
Content origin: html for extracted HTML, markdown for served Markdown, or llms-full for a corpus section. Present only on success.
fetchedAt
Optional
ISO 8601 page-body fetch time; reused bodies retain their original time. This is not the publication time. Present only on success.
chunks
Optional
Heading-scoped objects with id, headingPath and markdown, in document order. Present only for successful pages with chunk: true. Joining their Markdown reproduces the page; headingPath lists enclosing headings from outermost to innermost.
error
Optional
Present only on failure. Contains code and message; http_status also includes the upstream HTTP status. Successful rows omit this field.
