# Wikipedia Scraper — Search, Summaries & Full Text (`yadroo/wikipedia-search`) Actor

Search Wikipedia and get article summaries or full plain-text content in any language: title, extract, description, thumbnail, coordinates, categories, links count, last edit. Built for research and RAG agents. No API key.

- **URL**: https://apify.com/yadroo/wikipedia-search.md
- **Developed by:** [Samat Makatov](https://apify.com/yadroo) (community)
- **Categories:** AI, Developer tools
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.70 / 1,000 result items

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Wikipedia Scraper — summaries, full articles, Wikidata facts & pageviews in any language

Turn a list of names, topics or page titles into structured Wikipedia data: relevance-ranked search or exact title lookup in any of the ~340 language editions, lead summary or the complete plain-text article split into sections, categories, links, inter-language links, images, the linked **Wikidata** record (industry, headquarters, CEO, revenue, employees, ticker, ISIN, LEI, website, social handles…) and **pageview statistics** for attention tracking. Built for due-diligence and KYB teams, market researchers, content/SEO teams, and RAG pipelines.

No API key, no proxy, no browser — official Wikimedia REST and Action APIs.

### Use cases

- **Company / person due diligence** — `includeWikidata: true` gives industry, HQ, founders, CEO, parent, subsidiaries, employees, revenue (with year), ticker, ISIN, LEI, OpenCorporates & Crunchbase ids, official site and social links, plus the encyclopedic summary.
- **Entity enrichment for CRM / lead lists** — feed 500 company names via `queries`, keep `fields: ["query","title","description","extract","wikidataId","url"]`.
- **Attention / trend monitoring** — `includePageviews: true`, `pageviewsDays: 90`, `includeDailyPageviews: true` on brands, competitors or topics; alert on spikes.
- **RAG / knowledge base ingestion** — `mode: "full"`, `includeSections: true` gives clean plain text with a table of contents; `maxTextChars` caps size.
- **Multilingual localisation research** — `includeLangLinks: true` lists which languages cover a topic; run the same queries with `lang: "de"`, `"kk"`, `"zh"` for local perspectives.
- **Topic mapping / SEO content clusters** — `includeLinks: true`, `includeCategories: true` on seed articles to build a related-topics graph.

### Input

| Field | Type | Default | Allowed values / notes |
|---|---|---|---|
| `queries` | string\[] | – | **Required.** One entry per lookup: free text, an entity name or an exact page title. Up to a few thousand per run. |
| `lang` | string | `en` | Any Wikipedia language code (`en`, `de`, `fr`, `es`, `ru`, `zh`, `ja`, `ar`, `kk`, `uz`, `simple`, `zh-yue`…). See **Reference**. |
| `searchMode` | string | `text` | `text` (relevance search like the site search box), `title` (prefix match on titles), `nearmatch` (best single title match, tolerant to case/diacritics), `exact` (treat the query as the page title; follows redirects). |
| `resultsPerQuery` | integer | `1` | 1–50 top hits saved per query (ignored for `exact`). |
| `skipDisambiguation` | boolean | `false` | Skip disambiguation list pages (always flagged via `isDisambiguation`). |
| `mode` | string | `summary` | `summary` (lead paragraph via REST summary), `full` (complete plain-text article → `fullText`), `metadata` (no text). |
| `maxTextChars` | integer | `0` | Truncate `fullText` on a word boundary (0 = whole article); `fullTextChars` keeps the real length. |
| `includeSections` | boolean | `false` | Table of contents `[{level, title, chars}]` (`chars` only in `full` mode; `anchor` in other modes). |
| `includeCategories` | boolean | `false` | Visible categories (≤100). |
| `includeLinks` | boolean | `false` | Titles of linked articles. |
| `maxLinks` | integer | `50` | 1–500 cap for `includeLinks`. |
| `includeLangLinks` | boolean | `false` | `languages` (codes), `languagesCount`, `langLinks [{lang, title, url}]`. |
| `includeImages` | boolean | `false` | Up to 20 images with URL and caption (`thumbnail` / `originalImage` are always included). |
| `includeWikidata` | boolean | `false` | Curated structured facts from the linked Wikidata item (see **Reference → Wikidata properties**). +1–2 requests per page. |
| `includePageviews` | boolean | `false` | Human pageviews, all platforms, for the last `pageviewsDays`: `total`, `avgPerDay`, `peakDay`, `peakViews`. |
| `pageviewsDays` | integer | `30` | 1–365, window ends yesterday (UTC). |
| `includeDailyPageviews` | boolean | `false` | Adds `pageviews.daily [{date, views}]`. |
| `dedupe` | boolean | `true` | Save each page once even if several queries resolve to it. |
| `fields` | string\[] | `[]` | Keep only these output fields. |

### Reference

#### Language editions (`lang`)

Any live edition works; these are the built-in known codes (unknown codes only log a warning):

| Code | Language | Code | Language | Code | Language |
|---|---|---|---|---|---|
| `en` | English | `de` | German | `fr` | French |
| `es` | Spanish | `it` | Italian | `pt` | Portuguese |
| `ru` | Russian | `ja` | Japanese | `zh` | Chinese |
| `ar` | Arabic | `nl` | Dutch | `pl` | Polish |
| `sv` | Swedish | `uk` | Ukrainian | `vi` | Vietnamese |
| `tr` | Turkish | `fa` | Persian | `ko` | Korean |
| `id` | Indonesian | `cs` | Czech | `he` | Hebrew |
| `hu` | Hungarian | `fi` | Finnish | `no` / `nn` | Norwegian |
| `da` | Danish | `ro` | Romanian | `el` | Greek |
| `bg` | Bulgarian | `sr` | Serbian | `hr` | Croatian |
| `sk` | Slovak | `sl` | Slovenian | `lt` | Lithuanian |
| `lv` | Latvian | `et` | Estonian | `th` | Thai |
| `hi` | Hindi | `bn` | Bengali | `ta` | Tamil |
| `te` | Telugu | `ml` | Malayalam | `mr` | Marathi |
| `ur` | Urdu | `ms` | Malay | `ca` | Catalan |
| `eu` | Basque | `gl` | Galician | `kk` | Kazakh |
| `uz` | Uzbek | `ky` | Kyrgyz | `tg` | Tajik |
| `tk` | Turkmen | `az` | Azerbaijani | `ka` | Georgian |
| `hy` | Armenian | `mn` | Mongolian | `be` | Belarusian |
| `tt` | Tatar | `ba` | Bashkir | `sq` | Albanian |
| `mk` | Macedonian | `bs` | Bosnian | `is` | Icelandic |
| `ga` | Irish | `cy` | Welsh | `af` | Afrikaans |
| `sw` | Swahili | `am` | Amharic | `ha` | Hausa |
| `yo` | Yoruba | `ne` | Nepali | `si` | Sinhala |
| `my` | Burmese | `km` | Khmer | `lo` | Lao |
| `tl` | Tagalog | `la` | Latin | `eo` | Esperanto |
| `simple` | Simple English | `zh-yue` | Cantonese | `ceb` | Cebuano |
| `war` | Waray | `arz` | Egyptian Arabic | `ckb` | Central Kurdish |
| `ku` | Kurdish | `ps` | Pashto | `sd` | Sindhi |
| `pa` | Punjabi | `gu` | Gujarati | `kn` | Kannada |
| `or` | Odia | `as` | Assamese | | |

Full list: https://meta.wikimedia.org/wiki/List\_of\_Wikipedias

#### Wikidata properties extracted (`includeWikidata`)

| Output key | Property | Output key | Property |
|---|---|---|---|
| `instanceOf` | P31 | `country` | P17 |
| `headquarters` | P159 | `inception` / `dissolved` | P571 / P576 |
| `foundedBy` | P112 | `ceo` / `chairperson` | P169 / P488 |
| `industry` | P452 | `legalForm` | P1454 |
| `ownedBy` / `parentOrganization` | P127 / P749 | `subsidiaries` | P355 |
| `employees` (`{value, year}`) | P1128 | `revenue` / `netProfit` / `totalAssets` (`{amount, currencyItem, year}`) | P2139 / P2295 / P2403 |
| `website` | P856 | `coordinates` | P625 |
| `tickerSymbol` / `stockExchange` | P249 / P414 | `isin` / `lei` | P946 / P1278 |
| `openCorporatesId` / `crunchbaseId` | P1320 / P2088 | `rorId` / `gridId` | P6782 / P2427 |
| `twitter` / `linkedinCompany` / `facebook` / `youtubeChannel` | P2002 / P4264 / P2013 / P2397 | `image` / `logo` | P18 / P154 |
| `population` / `capital` | P1082 / P36 | `dateOfBirth` / `dateOfDeath` | P569 / P570 |
| `citizenship` / `occupation` / `employer` | P27 / P106 / P108 | `educatedAt` / `positionHeld` / `memberOf` | P69 / P39 / P463 |
| `ownerOf` | P1830 | `phone` / `email` | P1329 / P968 |
| `streetAddress` / `postalCode` | P6375 / P281 | `officialName` / `shortName` | P1448 / P1813 |

Item values (people, places, companies, currencies) are returned as **labels** in the edition language, falling back to English, then Wikidata's language-neutral `mul` label (used by most person items since 2024), then any language. The original Q-ids are kept in `wikidata.entityIds` (e.g. `{ "ceo": "Q106028933", "foundedBy": ["Q483382", "Q332591", "Q19837"] }`) for joins.

Preferred-rank claims win, deprecated ones are dropped, time-series claims (revenue, employees) return the latest value with its year. Item values are resolved to labels in `lang`, falling back to English.

### Examples

**KYB / due diligence on a list of companies**

```json
{ "queries": ["Kaspi.kz", "Air Astana", "Halyk Bank", "KazMunayGas"], "searchMode": "nearmatch", "includeWikidata": true, "includeLangLinks": true, "fields": ["query", "title", "description", "extract", "wikidata", "languagesCount", "url"] }
```

**Brand attention tracker (run weekly)**

```json
{ "queries": ["Tesla, Inc.", "BYD Auto", "Rivian"], "searchMode": "exact", "mode": "metadata", "includePageviews": true, "pageviewsDays": 90, "includeDailyPageviews": true }
```

**Full articles for a RAG index, with table of contents**

```json
{ "queries": ["Stablecoin", "Central bank digital currency", "Payment system"], "searchMode": "exact", "mode": "full", "includeSections": true, "includeCategories": true, "maxTextChars": 60000 }
```

**Topic research in Russian — top 5 hits per query**

```json
{ "queries": ["агропромышленный комплекс Казахстана", "цифровизация сельского хозяйства"], "lang": "ru", "resultsPerQuery": 5, "skipDisambiguation": true }
```

**Related-topics graph for content planning**

```json
{ "queries": ["Agentic AI"], "searchMode": "exact", "includeLinks": true, "maxLinks": 200, "includeCategories": true, "mode": "metadata" }
```

### Output

One item per page found. Queries with no result and failed queries are not items and are not charged — they are listed in the `SUMMARY` record and the run's status message. Example (trimmed):

```json
{
  "query": "Astana International Financial Centre",
  "rank": 1,
  "found": true,
  "lang": "en",
  "pageId": 57219556,
  "title": "Astana International Financial Centre",
  "requestedTitle": null,
  "description": "Financial hub in Astana, Kazakhstan",
  "isDisambiguation": false,
  "extract": "The Astana International Financial Centre (AIFC) is a financial hub in Astana, Kazakhstan …",
  "snippet": "The Astana International Financial Centre (AIFC) is a financial hub …",
  "thumbnail": "https://upload.wikimedia.org/wikipedia/commons/thumb/…/320px-AIFC.jpg",
  "originalImage": "https://upload.wikimedia.org/wikipedia/commons/…/AIFC.jpg",
  "coordinates": { "lat": 51.09, "lon": 71.42 },
  "url": "https://en.wikipedia.org/wiki/Astana_International_Financial_Centre",
  "lastEdited": "2026-08-30T11:02:41Z",
  "revisionId": 1312345678,
  "wordCount": 1874,
  "wikidataId": "Q28155597",
  "wikidata": { "id": "Q28155597", "instanceOf": "financial centre", "country": "Kazakhstan", "inception": "2018-01-01", "headquarters": "Astana", "website": "https://aifc.kz", "twitter": "AIFC_KZ", "url": "https://www.wikidata.org/wiki/Q28155597", "entityIds": { "instanceOf": "Q338313", "country": "Q232", "headquarters": "Q1520" } },
  "pageviews": { "days": 30, "from": "2026-08-14", "to": "2026-09-12", "total": 2140, "avgPerDay": 71.3, "peakDay": "2026-09-02", "peakViews": 188 },
  "fetchedAt": "2026-09-13T08:05:12.345Z"
}
```

| Field | Type | Meaning |
|---|---|---|
| `query`, `rank`, `found` | string, int, bool | Which input produced the row and its search rank. |
| `lang`, `pageId`, `title`, `requestedTitle`, `redirected` | | Edition, stable page id, canonical title; `requestedTitle` when a redirect/search changed it. |
| `description`, `extract`, `snippet` | string | Wikidata short description, lead text, search snippet. |
| `isDisambiguation` | bool | Page is a disambiguation list. |
| `thumbnail`, `originalImage`, `images[]` | | Lead image; `images` with `includeImages`. |
| `coordinates` | object | `{lat, lon}` for places. |
| `url`, `lastEdited`, `revisionId`, `wordCount`, `pageLengthBytes` | | Page metadata. |
| `fullText`, `fullTextChars`, `sections[]` | | `mode: "full"` / `includeSections`. |
| `categories[]`, `links[]`, `languages[]`, `languagesCount`, `langLinks[]` | | Optional graph data. |
| `wikidataId`, `wikidata{}` | | Q-id and curated facts (`includeWikidata`); item values as labels, their Q-ids in `wikidata.entityIds`. |
| `pageviews{}` | | Attention metrics (`includePageviews`). |
| `fetchedAt` | ISO | Provenance. |

A `SUMMARY` record in the key-value store: `{ lang, queries, saved, notFound (count), notFoundCount, notFoundInputs[], errors[{input, error}], errorCount, mode, searchMode }`.

### Use it from code / agents

```bash
curl -X POST "https://api.apify.com/v2/acts/yadroo~wikipedia-search/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"queries":["Kaspi.kz","Halyk Bank"],"searchMode":"nearmatch","includeWikidata":true}'
```

```js
import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('yadroo/wikipedia-search').call({ queries: ['Stablecoin'], mode: 'full', includeSections: true });
const { items } = await client.dataset(run.defaultDatasetId).listItems();
```

```python
from apify_client import ApifyClient
client = ApifyClient(os.environ["APIFY_TOKEN"])
run = client.actor("yadroo/wikipedia-search").call(run_input={"queries": ["Tesla, Inc."], "searchMode": "exact", "includePageviews": True, "pageviewsDays": 90})
items = client.dataset(run["defaultDatasetId"]).list_items().items
```

MCP: add `https://mcp.apify.com` to Claude / Cursor / any MCP client and call the `yadroo/wikipedia-search` tool with the same JSON input.

### Pricing

Pay per event: **$0.001 per run start + $0.001 per page**.
Typical runs: 10 company lookups with Wikidata ≈ $0.011; 500-name enrichment ≈ $0.5; full-article ingestion of 100 pages ≈ $0.1.

### Limits & FAQ

- **Rate limits** — Wikimedia asks for ≤200 req/s overall and a descriptive User-Agent; the actor uses 1–6 requests per page (depending on toggles) with a 150 ms pause, and retries 429/5xx with backoff.
- **Freshness** — live from Wikipedia at run time; pageviews are published with ~1 day delay (window ends yesterday).
- **Not found** — a query with no page is not an item (you are not charged for it); it is listed in `SUMMARY.notFoundInputs`. A query-level API error goes to `SUMMARY.errors`; the run fails only when no query could be answered at all.
- **Disambiguation** — flagged via `isDisambiguation`; use `skipDisambiguation` or `searchMode: "text"` with `resultsPerQuery: 3` for ambiguous names.
- **Text size** — full articles can exceed 200 KB; use `maxTextChars` for LLM budgets.
- **Wikidata coverage** — only properties in the curated table are extracted; other claims are not returned (roadmap: `wikidataProperties` input for arbitrary P-ids).
- **Roadmap** — revision history / last editors, `geosearch` by coordinates, Wikipedia "on this day" and trending feeds.

***

Made by **Yadroo**. Sibling actors: [openalex-works](https://apify.com/yadroo/openalex-works), [arxiv-papers](https://apify.com/yadroo/arxiv-papers), [openlibrary-books](https://apify.com/yadroo/openlibrary-books), [domain-intel](https://apify.com/yadroo/domain-intel), [sanctions-screen](https://apify.com/yadroo/sanctions-screen).

# Actor input Schema

## `queries` (type: `array`):

One entry per lookup: a free-text query, a company/person/place name, or an exact page title. Each query yields up to resultsPerQuery pages.

## `lang` (type: `string`):

Wikipedia language code: en, de, fr, es, ru, zh, ja, ar, kk, uz, simple, zh-yue… (any of ~340 editions; the ~100 major ones are listed in the README). Lower-case.

## `searchMode` (type: `string`):

`text` ranks pages by relevance (like the site search box). `exact` treats each query as a page title and fetches it directly — use it when you already know the title (e.g. from a previous run or Wikidata).

## `resultsPerQuery` (type: `integer`):

How many top search hits to save per query (ignored for exact).

## `skipDisambiguation` (type: `boolean`):

Do not save pages that are disambiguation lists (they are still flagged with isDisambiguation when kept).

## `mode` (type: `string`):

`summary` = lead paragraph(s) via the REST summary endpoint; `full` = the complete article as plain text (headings kept as == Heading ==); `metadata` = title/description/url only.

## `maxTextChars` (type: `integer`):

Truncate fullText at this length (0 = whole article). fullTextChars always holds the original length.

## `includeSections` (type: `boolean`):

Table of contents: \[{level, title, chars}] (chars only in full mode).

## `includeCategories` (type: `boolean`):

Visible categories of the page (up to 100).

## `includeLinks` (type: `boolean`):

Titles of linked articles (entity graph / related pages).

## `maxLinks` (type: `integer`):

Cap for includeLinks.

## `includeLangLinks` (type: `boolean`):

languages (codes), languagesCount and langLinks \[{lang, title, url}] — e.g. to fetch the Russian or Kazakh article next.

## `includeImages` (type: `boolean`):

Up to 20 images with URL and caption (thumbnail/originalImage are always included when available).

## `includeWikidata` (type: `boolean`):

Structured facts from the linked Wikidata item: instance of, country, headquarters, inception, founders, CEO, industry, employees, revenue, website, ticker/ISIN/LEI, social handles, coordinates, birth/death dates, occupation… (see README). Item values are resolved to labels.

## `includePageviews` (type: `boolean`):

Daily human pageviews (all platforms) for the last pageviewsDays: total, average per day, peak day — a free popularity/attention signal.

## `pageviewsDays` (type: `integer`):

Window ending yesterday (UTC).

## `includeDailyPageviews` (type: `boolean`):

Add pageviews.daily \[{date, views}] for charting/anomaly detection.

## `dedupe` (type: `boolean`):

Save each page once even if several queries resolve to it.

## `fields` (type: `array`):

Keep only these output fields, e.g. \["query","title","extract","url"]. Empty = all.

## Actor input object example

```json
{
  "queries": [
    "Astana International Financial Centre"
  ],
  "lang": "en",
  "searchMode": "text",
  "resultsPerQuery": 1,
  "skipDisambiguation": false,
  "mode": "summary",
  "maxTextChars": 0,
  "includeSections": false,
  "includeCategories": false,
  "includeLinks": false,
  "maxLinks": 50,
  "includeLangLinks": false,
  "includeImages": false,
  "includeWikidata": false,
  "includePageviews": false,
  "pageviewsDays": 30,
  "includeDailyPageviews": false,
  "dedupe": true
}
```

# Actor output Schema

## `results` (type: `string`):

No description

## `summary` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "queries": [
        "Astana International Financial Centre"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("yadroo/wikipedia-search").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "queries": ["Astana International Financial Centre"] }

# Run the Actor and wait for it to finish
run = client.actor("yadroo/wikipedia-search").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "queries": [
    "Astana International Financial Centre"
  ]
}' |
apify call yadroo/wikipedia-search --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,yadroo/wikipedia-search"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/96tQR74P7p6czKdua/builds/zPCibRznydeJLFXlD/openapi.json