Wikidata Knowledge Entity Scraper

What it does

Searches Wikidata for knowledge entities matching a query and extracts structured metadata including entity ID, label, description, concept URI, and match type.

This Apify actor automates the collection of data from a public API, extracting structured information and saving it directly into an Apify dataset. It handles pagination automatically, supports configurable result limits, and includes robust error handling with timeouts on all HTTP requests. The actor is designed for reliability: it validates inputs, applies sensible defaults, and produces a fallback record when no results are found, so your downstream workflows never receive an empty dataset.

Why use it

Manually collecting data from web APIs is tedious and error-prone. This actor eliminates that burden by running in the cloud on the Apify platform, where it can be scheduled, integrated with webhooks, or chained with other actors. Whether you are conducting market research, building a knowledge base, monitoring package ecosystems, or feeding data into an analytics pipeline, this actor gives you structured, ready-to-use JSON output with zero browser overhead. It uses lightweight HTTP requests instead of a full browser, which makes it fast and cost-effective.

Input parameters

Parameter	Type	Required	Default	Description
searchQuery	string	Yes	"programming language"	The search term to use when querying the API.
maxResults	integer	No	100	Maximum number of results to return (1 to 1000).

Output data

Each item in the output dataset contains the following fields:

• wikidataId - Wikidata entity ID (e.g., Q15).
• label - Human-readable label of the entity.
• description - Short description of the entity.
• conceptUri - Full concept URI on Wikidata.
• url - Relative URL path on Wikidata.
• matchType - How the search matched (label, alias, etc.).

All string fields are null-checked; missing values are stored as null rather than undefined.

Example output

{
    "wikidataId": "Q15",
    "label": "Africa",
    "description": "continent",
    "conceptUri": "http://www.wikidata.org/entity/Q15",
    "url": "//www.wikidata.org/wiki/Q15",
    "matchType": "label"
}

Pricing

This actor is priced on a usage basis:

• $0.01 per result returned in the dataset.
• $0.005 per actor start (fixed platform fee).

For example, scraping 500 results would cost approximately $5.005. Apify provides free monthly credits for new users, so you can try the actor at no charge.

More scrapers from brave_paradise

Check out other useful scrapers built by brave_paradise:

• npm Registry Package Scraper
• Crates.io Rust Package Scraper
• Packagist PHP Package Scraper

Visit the brave_paradise profile on Apify to see the full catalogue of actors.