URL to Markdown + Metadata

Turn any web page into clean Markdown plus structured metadata for LLMs and RAG pipelines. You get the main content, heading outline, OpenGraph and Twitter tags, JSON-LD, canonical URL, language, word count and an approximate token count. It uses plain HTTP, so it is fast and cheap.

What does URL to Markdown + Metadata do?

• Main-content extraction that drops navigation and footers
• Absolute links and image URLs
• OpenGraph, JSON-LD, author, dates and canonical URL
• Heading outline and optional link list
• Token estimate to size your prompts

How to use it

1. Click Try for free and open the Input tab.
2. Fill in the fields below, or keep the defaults for a quick test.
3. Press Start. Results appear in the Output tab within seconds to a few minutes.
4. Download as JSON, CSV or Excel, or call the actor from the API, a schedule, Make, Zapier or an AI agent through the Apify MCP server.

Input

Field	Type	Description
urls	array	Web pages to convert, one per line.
mainContentOnly	boolean	Drop navigation, headers, footers and sidebars.
includeLinks	boolean	Return all links with internal/external flag.
maxCharsPerPage	integer	Truncate long pages (0 = no limit).

Example input

{
  "urls": [
    "https://en.wikipedia.org/wiki/Web_scraping"
  ],
  "mainContentOnly": true,
  "includeLinks": false,
  "maxCharsPerPage": 100000
}

Output

Each result is a flat JSON object that you can open in the Output tab, export to CSV or Excel, or read through the API. See the dataset views for the main columns.

How much does it cost to use URL to Markdown + Metadata?

Pricing is pay per event: $0.002 per page. You pay only for results saved to the dataset, plus nothing extra for platform usage on the free plan limits. Apify's free monthly credit lets you test it before paying.

FAQ

Does it run JavaScript? No. Pages that render content only in the browser return little text and are flagged likelyJsRendered.

Is it allowed to scrape any site? You are responsible for respecting each site's terms and robots.txt.

How is it different from a crawler? It converts the URLs you list; it does not follow links.

Is it legal?

The actor reads public, open-licence or government data only and does not collect private information. You are responsible for using the results in line with the source's terms and applicable laws.

Use it with AI agents (MCP)

This actor is agent-ready: it is a plain tool with a documented JSON input and a flat JSON output, so Claude, ChatGPT, Cursor and other agents can call it through the Apify MCP server.

Add it to an MCP client with this URL (Apify account or agentic payment required):

https://mcp.apify.com/?tools=flyingnimbus/url-to-markdown-metadata

Example prompt: "Use the URL to Markdown + Metadata tool with the example input below and summarise the results."

Calls are pay per event ($0.002 per page), so an agent can estimate the cost before it runs. Empty or failed lookups return a status record instead of failing the run.

More actors by flyingnimbus

• Property Details by Address API
• Schools Near Address Finder API
• School Rating Converter & Equivalence API
• Building Permits Multi-City API
• Company Registry Lookup (LEI + SEC)
• Restaurant Inspections API - NYC, Chicago, Toronto
• CVE Risk Enricher - NVD, CISA KEV & EPSS
• SEC Insider Trades (Form 4) - Buys & Sells
• SEC 13F Holdings Tracker
• EU Company Registry Search
• Canada Recalls & Safety Alerts Monitor
• Sitemap & Robots.txt Analyzer
• Email Validator - MX, SPF & DMARC
• Website Tech Stack Detector
• PDF Text & Table Extractor
• SSL Certificate Expiry Checker
• VIN Decoder + Recalls API
• ClinicalTrials.gov Search API
• US Federal Contracts & Grants (USAspending)
• Federal Register Search API
• FDA Recalls & Drug Labels API
• Eurostat Data API
• UK Government Tenders (Contracts Finder)

Feedback

Found a bug or need another field or city? Open an issue on the actor's Issues tab and it will be looked at quickly.