Pricing

from $20.00 / 1,000 page crawleds

Try for free

Go to Apify Store

Website to Markdown Crawler — Website Crawler for RAG & LLMs

Try for free

Website to markdown crawler: crawl entire websites into clean markdown, text or HTML. A website crawler for RAG pipelines, LLM context and AI training, handling JS-rendered pages. Firecrawl & Jina alternative. Pay per page.

Pricing

from $20.00 / 1,000 page crawleds

Rating

0.0

(0)

Developer

NexGenData

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

📊 What you get

Clean JSON output (7 fields):

url — Url
title — Title
text — Text
markdown — Markdown
html — Html
metadata — Metadata
crawledAt — Crawled At

Pricing: $0.020 per page (Pay-Per-Event) — about 50 pages per $1.

🤖 Use with AI agents

Point Claude, the OpenAI Agents SDK, an n8n flow or any MCP-aware client at it.

Sample agent prompt:

Run Website Crawler on my input and return the structured results.

Agentic payments (x402): Supports agentic payment via x402 — call this actor with USDC, no API key required.

RAG Web Browser

A NexGenData utility actor.

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David

4.6K

4.9

(7)

Website URL Crawler & Link Extractor

maged120/get-urls-pro

Crawl any website and extract every URL with its depth, parent page and anchor text. Build a sitemap or audit internal links. Works on static and JavaScript sites.

Maged

211

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

167K

4.6

(234)

Instagram Following - No Cookies Required

devil_port369-owner/instagram-following

The Instagram Following Scraper extracts following profile data from a public Instagram account. Ideal for influencer marketing, audience analysis, and business intelligence. Safe API rates ensure account protection while providing valuable insights.

DataFusionX

336

5.0

(3)

Sitemap Extractor

apify/sitemap-extractor

This Apify Actor extracts all URLs from a website's sitemaps and checks their status codes via lightweight HTTP requests. It provides a clean list of valid links, acting as an ideal pre-processor to ensure your larger crawling projects target only active URLs.

Apify

379

3.2

(8)

Extract Emails, Socials and Contacts from Any Website

logical_scrapers/extract-email-from-any-website

(fastest) An advanced Actor for extracting email addresses, social links and contact details from websites. This tool is perfect for web scraping, contact collection, and lead generation.

Goldmine

2.5K

5.0

(8)

Website Content Crawler – Markdown for AI, Emails & Contacts

locomint/website-crawler-content-contacts

Website content crawler that turns a whole site into clean Markdown for LLM and RAG pipelines, with the role emails, social profiles and WhatsApp numbers found on each page. Seeded from the sitemap, honours robots.txt, plain HTTP with no browser.

Locomint

Sitemap URL Extractor

onescales/sitemap-url-extractor

Provide a website link to a sitemap.xml and the app will extract and list all URLs in the sitemap as well as additional data in the sitemap (i.e. https://onescales.com/sitemap.xml).

One Scales

645

5.0

(3)

Website Content Crawler - Markdown, 45 Fields

parseforge/website-content-crawler

Crawls websites from start URLs with depth, domain and URL-pattern limits. 45 fields per page: Markdown and plain text, word count, title and meta tags, headings, Open Graph and JSON-LD, author and dates, emails, phones and social links, detected technologies, links and HTTP status. Ready for LLMs.