Pricing

from $1.56 / 1,000 results

Website Content Crawler | Markdown for RAG

Turn public news, blog, and documentation pages into clean Markdown or plain text. Discover pages through sitemaps and feeds, or extract known URLs directly. Export content, metadata, and change-tracking fields for RAG and monitoring, while respecting robots.txt and website boundaries.

Pricing

from $1.56 / 1,000 results

Rating

4.8

(3)

Developer

Xtech

Actor stats

Bookmarked

440

Total users

Monthly active users

9 days ago

Last modified

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

7.8K

4.8

(10)

Google News Scraper

easyapi/google-news-scraper

Powerful Google News scraper, collect up to 50000 news articles with flexible search options, language support. Perfect for news aggregation, market research, and sentiment analysis. 📰🔍

EasyApi

2.7K

4.3

(10)

Google News Scraper

lhotanova/google-news-scraper

Scrape Google News by keyword, topic or date range, past the 100-result limit. Get headlines, sources, dates, real publisher URLs and images as JSON, CSV or Excel, or via API, MCP or n8n. For news monitoring and alerts, brand tracking, market research, stock trading and AI agents.

Kristýna Lhoťanová

3.3K

4.6

(13)

Article Content Extractor 📄

easyapi/article-content-extractor

Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. 🔍📄

EasyApi

245

5.0

(5)

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

170K

4.6

(235)

Google News Scraper (Pay Per Event)

data_xplorer/google-news-scraper-fast

Scrape Google News in real time, including images and descriptions. This tool extracts complete structured data: high-resolution visuals, full, titles, sources, dates, and direct URLs.

Data Xplorer

2.4K

4.9

(5)

Google News Scraper + Article Extractor

phantom_coder/google-news-scraper

Search Google News by keyword or browse 8 built-in topics - World, Business, Technology, Sports, Science, Health and more. Add-on: extract full article text for NLP and sentiment. Near-zero start fee ($0.00005/run). Site filter, date range, 50+ languages. From $0.004/result.

Phantom Coder

5.0

(2)

News & Article Extractor

automation-lab/news-article-extractor

Auto-discover news/blog articles and extract clean text plus Markdown for LLM/RAG corpora. Uses RSS, sitemaps, and Readability; outputs metadata, counts, and token estimates.

Automation Lab

5.0

(1)

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David

4.7K

4.9

(7)

Website Content Crawler - Clean Text, Markdown & RAG Chunks

topapi/website-content-crawler

Crawl any website or URL list for $1.20 per 1,000 pages: one row per page with clean text, Markdown, HTML, metadata, links, headings, tables and RAG chunks. Plain HTTP first, headless Chrome only for JavaScript pages. Sitemaps, llms.txt, PDF/DOCX text, Bing/DuckDuckGo search, change monitor.