Website Content Crawler — Text, Markdown & AI Chunks

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

Website URL Crawler & Link Extractor

maged120/get-urls-pro

Crawl any website and extract every URL with its depth, parent page and anchor text. Build a sitemap or audit internal links. Works on static and JavaScript sites.

🔥 Google News Search Scraper

powerai/google-news-search-scraper

Search Google News and export structured metadata with optional article enrichment.

Article Content Extractor 📄

easyapi/article-content-extractor

Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. 🔍📄

web-content-extractor

morph_coder/web-content-extractor

HTTP-first web scraper without proxy by default. Returns clean article text, SEO metadata, and headings. Apify Proxy and Playwright used only as fallback. No-code friendly JSON output for Make, n8n, and Zapier

Google Search SERP Crawler

radiant_martian/google-search-serp-crawler

This is a Google Search crawler with comprehensive information categorized for your AI agent or RPA use.

Reddit Search Scraper - Keyword Monitoring | $0.99/1K

clearpath/reddit-search-scraper

Search Reddit posts and comments by keyword and monitor brand mentions on a schedule, for $0.99 per 1,000 results. Boolean operators, exact phrases, subreddit scoping or auto-discovery, 5 sort orders and time filters. Full text, scores, authors, dates, media and parent-post context.

AI Web Crawler

hounderd/ai-web-crawler

Crawl websites and extract clean, LLM-ready markdown content with stealth browser rendering, anti-bot hardening, smart content filtering, and structured metadata extraction. Built for RAG pipelines, AI agents, and data workflows.

Reddit Comment Scraper - Export Comments & Replies ($1.5/1k)

harshmaur/reddit-comments-scraper

Scrape Reddit comments without the API — every comment and nested reply from any post URL, 'load more comments' expanded automatically. Export to CSV, Excel, or JSON for sentiment analysis, AI training data, or research. No login, no rate limits. From $1.50 per 1,000 comments.

Website Content Crawler

mikolabs/website-content-crawler

Deep-crawl websites to extract clean text, Markdown, or HTML for AI/LLM apps, RAG pipelines, and vector databases. Supports adaptive crawling, HTML cleaning, file downloads, and structured dataset output. Easily integrates with LangChain, LlamaIndex, and other LLM tools.