Pricing

from $20.00 / 1,000 results

Try for free

Go to Apify Store

Wikipedia Page Dataset Scraper

Try for free

Scrape Wikipedia articles and export structured dataset fields for training, knowledge bases, and research.

Pricing

from $20.00 / 1,000 results

Rating

5.0

(1)

Developer

ScrapeAI

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Wikipedia Page Dataset Scraper 📚

Scrape Wikipedia pages and extract structured article content including title, summary, full text, headings, infobox data, categories, references, and internal links. Designed for AI training, RAG pipelines, knowledge base creation, research datasets, and content analysis.

Features

Scrapes article content from Wikipedia pages.
Extracts structured fields: page_title, page_url, summary, full_text, headings, infobox, categories, references, internal_links, last_updated, and scraped_at.
Supports multiple start URLs and optional crawling of linked Wikipedia articles.
Uses Playwright and Apify actor conventions for reliable dataset export.

Getting Started

Install dependencies
```
$npm install
```

Configure input

Edit INPUT.json or provide actor input through the Apify platform.

Example INPUT.json:

{
  "startUrls": [
    { "url": "https://en.wikipedia.org/wiki/Artificial_intelligence" }
  ],
  "maxPages": 50,
  "followLinks": true
}

Run locally
```
$npm start
```
Docker / Actor
- The Dockerfile can build the image.
- .actor/actor.json defines the Apify actor configuration.

Output Fields

page_title
page_url
summary
full_text
headings
infobox
categories
references
internal_links
last_updated
scraped_at

File Overview

src/main.js – actor entry point that loads input, launches Playwright, and executes the Wikipedia scraper.
src/scraper.js – page extraction and crawl logic for Wikipedia articles.
.actor/input_schema.json – defines supported actor input fields.
.actor/dataset_schema.json – defines the dataset output record fields.
.actor/actor.json – actor metadata and Apify configuration.

Logs & Storage

Logs are written to Apify storage during actor execution.
Scraped dataset records are stored in Apify dataset storage.

License

This project is provided as-is. Feel free to adapt and extend it for your own Wikipedia scraping needs.

Startup Investor Scraper

datapilot/startup-investor-scraper

VC Firm Data Scraper collects venture capital firm information using Wikipedia, DuckDuckGo search, and official websites. It extracts firm name, website, location, phone, description, investment stages, focus sectors, AUM, and social links. The actor outputs structured JSON data

Data Pilot

Wikipedia Scraper

automation-lab/wikipedia-scraper

Search and extract Wikipedia articles — titles, summaries, full content, categories, and images. Uses the free MediaWiki API.

Stas Persiianenko

ROR (Research Organization Registry) Scraper

parseforge/ror-scraper

Automate the collection of research organization data with our ROR scraper. Obtain names, aliases, locations, external identifiers (GRID, ISNI, Wikidata), relationships, and contacts from the Research Organizations Registry. Ideal for researchers, academic institutions, and data analysts.

ParseForge

5.0

(1)

Wikipedia Data Scraper Pro

moving_beacon-owner1/my-actor-39

An automated crawler that extracts textual content and metadata from Wikipedia pages for building knowledge bases.

Jamshaid Arif

Wikipedia Scraper - Articles, Summaries & Search

makework36/wikipedia-scraper

Scrape Wikipedia articles, summaries, and search results. Supports summary, search, and random article modes via the Wikipedia REST API. Pure HTTP, no browser needed.

deusex machine

Wikipedia Article Extractor (AI-ready)

changeable_acacia/wikipedia-article-extractor-ai-ready

Extracts clean JSON from any Wikipedia article for AI/RAG use.

SABYASACHI TRIPATHY

Wikipedia_Scraper

zerobreak/wikipedia-scraper

Fetch Wikipedia page content for multiple URLs with optional keyword filtering. Returns structured JSON results and handles bulk requests asynchronously.

ZeroBreak

Arxiv Paper Intelligence

viralanalyzer/arxiv-paper-intelligence

Search and extract ArXiv papers, abstracts, authors, and citations. Track research trends across any scientific field. AI-powered analysis.

viralanalyzer

5.0

(3)

Expired Domains Scraper

ib4ngz/expired-domains-scraper

This actor scrapes expired domain data from expireddomains.net, supporting user authentication with optional multi-factor authentication (MFA). It also allows users to apply filters for targeted domain scraping.

Iqbal R

Company Deep Research — SEC, GitHub, DNS & Social

ryanclinton/company-deep-research

Generate comprehensive company research reports from 7+ sources: SEC filings, stock data, Wikipedia, GitHub, Trustpilot reviews, DNS records, and social media verification. One domain in, full intelligence report out.

ryan clinton

HTML to Markdown Converter - Bulk Web Content to MD

santamaria-automations/html-to-markdown

Extract main article content from any website and convert to clean Markdown including headings, links, images, tables, and code blocks. Perfect for LLM training, AI pipelines, and documentation. Export data, run via API, schedule and monitor runs, or integrate with other tools.