Article metadata
article
Optional
Present when includeArticleJson is on: excerpt, byline, site name, published and modified dates, description, lead image and JSON-LD blocks. Only keys with a value are included.
Agent Fetch: URL to Markdown for LLMs and RAG
Pricing
from $0.70 / 1,000 fetched pages
Returns the main content of any web page URL as clean Markdown for LLMs, RAG and AI agents, with title, canonical URL, language, word count and links. Up to 25 URLs per run, automatic JavaScript rendering, optional JSON Schema field extraction with no LLM. Failed pages are free.
Requested URL
url
Optional
The URL exactly as you passed it in, so results can be joined back to the input list.
Final URL
finalUrl
Optional
The URL actually fetched after redirects.
Status
status
Optional
Outcome of this page. ok means markdown was produced. Every other value is a labelled failure, so a failed page never silently looks empty. needs_render means the plain fetch got an empty JavaScript app shell and autoRender was off.
HTTP status
httpStatus
Optional
HTTP response code of the final request. 0 when no response was received at all.
Method
method
Optional
How the page was retrieved: http (plain fetch) or browser (headless Chromium, set by render or autoRender).
Fetched at
fetchedAt
Optional
ISO 8601 timestamp of when the page was retrieved.
Title
title
Optional
The page's title.
Canonical URL
canonicalUrl
Optional
The canonical URL the page declares for itself, useful for de-duplicating syndicated content.
Language
language
Optional
Language tag the page declares.
Markdown
markdown
Optional
The main content of the page as clean Markdown, with navigation, ads and boilerplate removed. This is the field to feed an LLM.
Words
wordCount
Optional
Word count of the extracted Markdown.
Characters
charCount
Optional
Character count of the extracted Markdown, after any cut by maxMarkdownChars. Never more than maxMarkdownChars.
Links
linkCount
Optional
How many links the main content contains.
Truncated
truncated
Optional
Whether the Markdown was cut short by your maxMarkdownChars limit. A cut Markdown ends with [truncated by maxMarkdownChars].
Duration
durationMs
Optional
Milliseconds from starting this URL to its record, including any wait for the converter.
Reason
reason
Optional
Present on failed pages. Plain-language explanation of why the page did not convert, for example blocked by robots.txt.
Links
links
Optional
Present when includeLinks is on: every link inside the extracted content, as { url, text, external }. Absolute URLs, capped at 500 per page.
Article metadata
article
Optional
Present when includeArticleJson is on: excerpt, byline, site name, published and modified dates, description, lead image and JSON-LD blocks. Only keys with a value are included.
Extracted fields
extractedFieldCount
Optional
How many of your schema fields were found on the page. Present only when a schema was supplied.
Extracted values
extracted
Optional
The values for the fields your schema asked for, keyed by field name. Deterministic parsing, no LLM and no API key.
Extraction sources
extractedSources
Optional
Where each extracted value came from, so a value can be audited. json-ld, meta, page:pairs and text:label are values the page itself states; page:title, page:canonical, page:lang, page:wordCount, html:time and text:pattern are fallbacks and are never charged.
Rendered automatically
autoRendered
Optional
Present and true when the plain fetch returned an empty JavaScript app shell and the page was loaded in the headless browser instead (autoRender). Such a page is charged as a render.