Website Content Extractor

Website Content Crawler

bhansalisoft/website-content-crawler

Website Content Crawler : scrap any website content with meta title and meta description and site logo

Website Content Crawler — Text, Titles & Metadata

hipersoft/website-content-crawler

Extract clean, readable content from any list of websites: page title, meta description, headings, main body text, word count and link/image counts. Optional same-domain crawl. Bulk-ready. Great for LLM/RAG ingestion, content audits and research.

Website Main Content Extractor

sync-network/website-main-content-extractor

Extract the main content from any webpage — clean text without navigation, ads, footers, or boilerplate. Perfect for AI/LLM pipelines, RAG systems, content analysis, and data extraction. Returns title, description, author, publish date, and clean body text.

🌐 Full website crawler that extracts structured content (text, headings, metadata, links, images) from any domain. Free platform compute pricing.

Crawls a website starting from one or more URLs and extracts the title, meta description, headings and text from each page.

Crawl public pages and extract page titles, meta descriptions, headings, readable text, source URLs, and crawl metadata.

Sitemap Content Extractor — Bulk Page Text for SEO

darknezz/sitemap-content-extractor

Crawl any website sitemap.xml and extract structured content from each page. Full-text extraction, metadata, headings, and word counts for SEO audits and content inventories.

AI Website Content Extractor

scrapeai/ai-website-content-extractor

Crawl website pages, strip noise, and convert the main content to clean Markdown for RAG/LLM training.

Website Content Miner

seeb/website-content-miner

Extract clean website content at scale: page titles, meta descriptions, H1-H3 headings, readable main text, and URLs. Includes smart noise removal, Readability fallback, optional internal crawling, and structured output for SEO audits, AI datasets, research, and automation.

Extract SEO meta tags, Open Graph, Twitter Cards, JSON-LD structured data, and headings from any website. Perfect for SEO analysis, competitor research, and content audits.