Website Crawler - Crawl a Site to Markdown for LLMs

Website Content Crawler - Markdown, 45 Fields

parseforge/website-content-crawler

Crawls websites from start URLs with depth, domain and URL-pattern limits. 45 fields per page: Markdown and plain text, word count, title and meta tags, headings, Open Graph and JSON-LD, author and dates, emails, phones and social links, detected technologies, links and HTTP status. Ready for LLMs.

Website Content Crawler — Text, Markdown & AI Chunks

agency-shift/web-content-crawler

Extract text or clean Markdown from public HTML websites. Create source-linked sections for AI knowledge bases while keeping one row per page. Preserve headings, code and tables; inspect a crawl report for failed URLs and truncated content. No JavaScript rendering.

Bulk Email Verifier & Email Validator - SMTP Check

leadproof/bulk-email-verifier

Bulk email verifier and email validator. Verify email deliverability for a pasted list or chain it after any scraper - get ok / catch-all / invalid / disposable verdicts per address. Pay only per verified result.

Website Content Crawler - Clean Text, Markdown & RAG Chunks

topapi/website-content-crawler

Crawl any website or URL list for $1.20 per 1,000 pages: one row per page with clean text, Markdown, HTML, metadata, links, headings, tables and RAG chunks. Plain HTTP first, headless Chrome only for JavaScript pages. Sitemaps, llms.txt, PDF/DOCX text, Bing/DuckDuckGo search, change monitor.

AI Web Crawler

hounderd/ai-web-crawler

Crawl websites and extract clean, LLM-ready markdown content with stealth browser rendering, anti-bot hardening, smart content filtering, and structured metadata extraction. Built for RAG pipelines, AI agents, and data workflows.

Website to Markdown Scraper for AI & LLMs

quaking_pail/ai-website-content-markdown-scraper

Crawl a website and get clean Markdown of each page's main content, with URL and title. Ready for LLMs, RAG, vector databases and AI agents. Headless Chrome, same-domain crawl, API access.

Facebook Page Posts Scraper - Public Pages, No Login

leadproof/facebook-posts

Scrape the latest posts from any public Facebook Page with no login and no cookies. One row per post: text, date, reactions, comments, shares, views, permalink, thumbnail. Pay per post.

Company People Finder - Owners, Staff & Verified Emails

leadproof/company-people-finder

Find the owners, executives and staff of any company from its domain, each with the line on the company's own site that names their role. Add verified work emails and LinkedIn employees. Businesses where nobody is found are free.

Website to Markdown — Content Crawler for LLM & RAG

webdatatools/website-to-markdown

Content Crawler turns any site into clean Markdown per page for LLMs, RAG pipelines and vector DBs — no headless browser, $1 per 1,000 pages.

Stealth Website Crawler

nocturne/stealth-website-crawler

Crawl websites protected by Cloudflare, DataDome, and other anti-bot systems. Extract clean text or markdown for AI/LLM pipelines. Like Website Content Crawler, but for sites that block you.