Pricing

from $1.50 / 1,000 results

News RAG Converter

Transform news articles into clean, structured data for AI pipelines. Strips ads and boilerplate, outputs JSON ready for vector databases and RAG systems.

Pricing

from $1.50 / 1,000 results

Rating

0.0

(0)

Developer

Igor Araujo

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

How It Works

Fetches each article URL via HTTP
Extracts content using trafilatura (ML-based extraction) with BeautifulSoup fallback
Returns clean markdown + structured JSON (title, author, date, full text)
Optimized for RAG pipelines and LLM context windows

Input

Field	Type	Description	Default	Required
`urls`	array	List of article URLs to process (1-100)	-	Yes
`format`	string	Output format: markdown, json, or both	`both`	No

Sample Input

{
  "urls": [
    "https://example.com/article-1",
    "https://example.com/article-2"
  ],
  "format": "both"
}

Sample Output

Each item in the dataset includes:

{
  "url": "https://example.com/article-1",
  "title": "Breaking News: Major Discovery",
  "author": "Jane Doe",
  "date": "2026-07-03T12:00:00Z",
  "text_length": 4523,
  "error": "",
  "fetched_at": "2026-07-03T15:30:00Z",
  "full_text": "The full article text...",
  "markdown": "# Breaking News: Major Discovery\n\n**Author:** Jane Doe\n\n..."
}

Use Cases

Building RAG knowledge bases from news articles
LLM fine-tuning dataset preparation
Research and content aggregation
Automated news digest generation

Pricing

Pay-per-event at $0.002 per result item.

Web Scraper RAG Ready

traorealexy/Web-Sraper-RAG-Ready

Turn any website into clean, token-efficient Markdown ready for RAG and LLM pipelines. Removes boilerplate, handles JavaScript rendering, and outputs structured JSON for LangChain, LlamaIndex, and vector databases.

Alexy Traore

RAG Pipeline Scraper — Website to Markdown & JSONL

yuchiaoniu/rag-pipeline-scraper

Transform any website into clean Markdown and JSONL ready for RAG pipelines, vector databases (Pinecone, Weaviate, Chroma), and LLM training. Removes ads, navigation, and boilerplate automatically.

Niu Yuchiao

Website to Markdown for RAG & LLMs

hereditary_model/website-to-markdown

Crawls a website and converts every page into clean, LLM-ready Markdown for RAG pipelines, vector databases, and AI agents. Removes nav, ads, and boilerplate. Predictable pricing: $0.004 per page converted.

Aaron Marxsen

Website to Markdown for LLM and RAG

jeweled_jockstrap/my-actor-3

Convert any URL to clean Markdown text for AI applications. Strips HTML extracts content. For LLM training RAG pipelines and vector databases. Free Firecrawl alternative.

Juan Triviño

📰 Extract Google News Articles — AI & RAG Ready

muhammadafzal/google-news-scraper

Extract Google News articles by keyword, topic, or URL with full-text extraction for AI/RAG pipelines. Get headlines, sources, snippets, images, authors, and clean article text in structured JSON. Export scraped data, run the scraper via API, or integrate with other tools.

Muhammad Afzal

Universal RAG Web Scraper

express_kingfisher/rag-web-scraper

Turn any website into clean, LLM-ready Markdown. Automatically strips ads, navigation, and noise using Mozilla Readability. Perfect for feeding data to ChatGPT, Claude, or Vector Databases (RAG).

Prince Raj

RAG-Ready Website Crawler — Clean Content for LLMs & Vector DBs

yourwingman/rag-ready-crawler

Crawl websites and output clean, chunked content optimized for RAG pipelines, LLM training data, and vector databases. Built for AI knowledge bases and semantic search.

Wingman

Website to RAG Dataset

sebastian-actors/website-to-rag-dataset

Convert public websites, docs, blogs, and XML sitemaps into clean Markdown, structured metadata, and stable chunks for RAG pipelines and vector databases.

Sebastian

News to Markdown — RAG-Ready News Chunks API

nexgendata/news-announcements-rag-markdown

Convert news and announcements into RAG-ready Markdown chunks. Clean JSON for PR, media-monitoring teams and AI agents.

NexGenData

Website to Markdown

cool_ya/website-to-markdown

Convert any web page into clean, LLM-ready Markdown. Strips nav, ads and boilerplate and returns the main article text plus title, description and word count. Perfect for RAG and AI pipelines.