Under maintenance

Pricing

Pay per usage

Try for free

Go to Apify Store

Wikipedia to RAG — Article Scraper for AI Pipelines

Under maintenance

Try for free

Search Wikipedia and download articles as clean Markdown chunks ready for RAG pipelines, Pinecone, Weaviate, Chroma, or any vector database. No API key required.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Niu Yuchiao

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Wikipedia to RAG — Article Scraper for AI Pipelines API through CLI

The Apify CLI is the official tool that allows you to use Wikipedia to RAG — Article Scraper for AI Pipelines locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Wikipedia to RAG — Article Scraper for AI Pipelines API in Python

Wikipedia to RAG — Article Scraper for AI Pipelines API in JavaScript

Wikipedia to RAG — Article Scraper for AI Pipelines OpenAPI definition

Wikipedia to RAG — Article Scraper for AI Pipelines API

Wikipedia Article Extractor (AI-ready)

changeable_acacia/wikipedia-article-extractor-ai-ready

Extracts clean JSON from any Wikipedia article for AI/RAG use.

SABYASACHI TRIPATHY

RAG Pipeline Scraper — Website to Markdown & JSONL

yuchiaoniu/rag-pipeline-scraper

Transform any website into clean Markdown and JSONL ready for RAG pipelines, vector databases (Pinecone, Weaviate, Chroma), and LLM training. Removes ads, navigation, and boilerplate automatically.

Niu Yuchiao

PDF to RAG Markdown Chunks for Embeddings

awesome_highboy/docforge

Convert PDFs into token-bounded Markdown chunks for RAG, embeddings, and vector databases (Pinecone, Chroma, Weaviate, Qdrant). Set maxTokens + overlap; get clean chunks with page number, token count, and SHA-256 content hash for dedup. JSON dataset ready for any LLM pipeline.

Adam

Wikipedia Scraper

leftwinglautus/wikipedia-scraper

Scrape Wikipedia articles via the official Wikipedia API. Search articles, get summaries, full content, and categories.

Moeeze Hassan

Wikipedia Category Scraper — Articles for RAG & AI

fast_api/wikipedia-category-scraper

Extract Wikipedia articles from any category with titles, URLs, extracts, page IDs, categories, and metadata. A fast MediaWiki API actor for building RAG datasets, knowledge bases, research corpora, and AI training data.

Fast API

Wikipedia Article Scraper

crawlerbros/wikipedia-scraper

Extract structured data from Wikipedia articles. Get summaries, categories, images, metadata, and descriptions using Wikipedia's official API. Supports 300+ languages.

Crawler Bros

Wikipedia Article Extractor

rambunctious_fingerprint/wikipedia-extractor

Casey Marsh

Wikipedia Scraper

velvety_bedbug/wikipedia-scraper

Search Wikipedia articles, fetch article content and summaries, or get today's featured and most-read articles. Supports all Wikipedia language editions.

Peters Bugs

Wikipedia Data Extractor - Articles & Summaries

vernacular_reservoir/wikipedia-data-extractor

Extract structured data from Wikipedia articles by topic or keyword. Get title, summary, description, thumbnail, coordinates and related links. Supports all Wikipedia languages. No API key required.

Aleksandrs

Wikipedia Article Extractor

glassventures/wikipedia-article-extractor

Extract Wikipedia articles via MediaWiki API. Get full text, summaries, sections, categories, images, links. Multi-language. Perfect for AI/ML training data and RAG.