# EU Open Data Portal Scraper (`crawlerbros/eu-open-data-scraper`) Actor Scrape datasets from the EU Open Data Portal (data.europa.eu). Search by keyword, browse by theme or publisher, or fetch full details for specific datasets. No API key required. - **URL**: https://apify.com/crawlerbros/eu-open-data-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Automation, Integrations - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## EU Open Data Portal Scraper Scrape datasets from the [EU Open Data Portal](https://data.europa.eu) — Europe's official open data hub. Access over 1.7 million datasets from EU institutions, member states, and public bodies. No API key or registration required. ### What This Actor Does The EU Open Data Portal Scraper retrieves structured metadata for datasets published on data.europa.eu. You can search by keyword, browse datasets by EU theme (Environment, Energy, Health, etc.), filter by publisher, or look up specific datasets by their ID. Each result includes: - Dataset ID, title, and description (in your chosen language) - Publisher name and homepage - Theme categories (e.g., Environment, Economy, Transport) - Keywords and tags - Publication and modification dates - Available distribution formats and download URLs - Language availability - Portal link ### Use Cases - **Research & analysis**: Find EU datasets on climate, health, transport, economics, and more - **Data journalism**: Discover official EU statistics and reports - **Academic work**: Locate government datasets for studies and papers - **Business intelligence**: Access EU open data for market research - **Regulatory compliance**: Find official EU regulatory datasets ### Input | Field | Type | Description | Default | |-------|------|-------------|---------| | `mode` | Select | Search mode: `searchDatasets`, `byTheme`, `byPublisher`, `datasetDetails` | `searchDatasets` | | `query` | Text | Keyword or phrase to search for | `climate change` | | `theme` | Select | EU theme category (e.g., `ENVI` for Environment, `ENER` for Energy) | — | | `publisher` | Text | Publisher name filter (e.g., `Eurostat`) | — | | `datasetId` | Text | Dataset ID for detail lookup | — | | `locale` | Select | Language for titles/descriptions (ISO code, e.g., `en`, `de`, `fr`) | `en` | | `formatFilter` | Select | Only return datasets with this distribution format (CSV, JSON, XML, etc.) | Any | | `maxItems` | Integer | Maximum datasets to return (1–5000) | `50` | #### Modes - **`searchDatasets`** (default): Search all datasets by keyword. Leave `query` blank to browse all datasets. - **`byTheme`**: Browse datasets filtered by an EU data theme. Requires `theme`. - **`byPublisher`**: Search datasets from a specific publisher. Uses `publisher` or `query`. - **`datasetDetails`**: Fetch complete metadata for a specific dataset by `datasetId`. #### EU Data Themes | ID | Name | |----|------| | `AGRI` | Agriculture, Fisheries, Forestry and Food | | `ECON` | Economy and Finance | | `EDUC` | Education, Culture and Sport | | `ENER` | Energy | | `ENVI` | Environment | | `GOVE` | Government and Public Sector | | `HEAL` | Health | | `INTR` | International Issues | | `JUST` | Justice, Legal System and Public Safety | | `REGI` | Regions and Cities | | `SOCI` | Population and Society | | `TECH` | Science and Technology | | `TRAN` | Transport | | `OP_DATPRO` | Provisional Data | ### Output Each record contains: ```json { "dataset_id": "jrc-10112-10001", "title": "European Climate Assessment Dataset", "description": "Daily meteorological observations at weather stations across Europe...", "publisher_name": "Joint Research Centre", "publisher_url": "https://ec.europa.eu/jrc", "themes": ["Environment", "Science and Technology"], "keywords": ["climate", "meteorology", "temperature", "precipitation"], "issued_date": "2020-03-15", "modified_date": "2024-01-10", "languages": ["en", "de", "fr"], "format_types": ["CSV", "JSON"], "distributions": [ { "title": "Climate Data CSV", "format": "CSV", "media_type": "text/csv", "access_url": "https://example.eu/data/climate.csv", "download_url": "https://example.eu/data/climate.csv", "license": "CC BY 4.0" } ], "download_url": "https://example.eu/data/climate.csv", "catalog": "jrc", "country": "eu", "url": "https://data.europa.eu/data/datasets/jrc-10112-10001", "type": "dataset", "scrapedAt": "2026-06-02T10:00:00+00:00" } ```` ### Data Source The EU Open Data Portal REST API (`data.europa.eu/api/hub/search`) is a free, open API with no authentication or registration required. It indexes over 1.7 million datasets from EU institutions and member states. ### Frequently Asked Questions **Do I need an API key?** No. The EU Open Data Portal API is completely free and open. No registration required. **How many datasets can I retrieve?** Up to 5,000 per run using the `maxItems` field. The portal has over 1.7 million datasets in total. **Can I filter by language?** Yes. Use the `locale` field to get titles and descriptions in your preferred EU language (English, German, French, etc.). **How do I find datasets in a specific format like CSV?** Use the `formatFilter` field and select CSV (or JSON, XML, PDF, etc.). **What is a dataset ID?** Each dataset on the EU Open Data Portal has a unique identifier shown in its portal URL. You can use `datasetDetails` mode with this ID to get full metadata. **How recent is the data?** The API reflects the live state of the EU Open Data Portal, which is updated continuously as member states and EU institutions publish new datasets. # Actor input Schema ## `mode` (type: `string`): Choose what to scrape: search by keyword, filter by theme, filter by publisher, or fetch dataset details by ID. ## `query` (type: `string`): Keyword or phrase to search for (used in searchDatasets and byPublisher modes). ## `theme` (type: `string`): EU data theme category to browse (used in byTheme mode). ## `publisher` (type: `string`): Filter datasets by publishing organization name (e.g. 'Eurostat', 'European Commission'). Used in byPublisher mode. ## `datasetId` (type: `string`): EU Open Data Portal dataset identifier (used in datasetDetails mode). Example: 'jrc-10112-10001'. ## `locale` (type: `string`): Preferred language for titles and descriptions. ## `formatFilter` (type: `string`): Only include datasets that have at least one distribution in this format. ## `maxItems` (type: `integer`): Maximum number of datasets to return. ## Actor input object example ```json { "mode": "searchDatasets", "query": "climate change", "locale": "en", "formatFilter": "", "maxItems": 10 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "searchDatasets", "query": "climate change", "locale": "en", "maxItems": 10 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/eu-open-data-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "searchDatasets", "query": "climate change", "locale": "en", "maxItems": 10, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/eu-open-data-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "searchDatasets", "query": "climate change", "locale": "en", "maxItems": 10 }' | apify call crawlerbros/eu-open-data-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/eu-open-data-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "EU Open Data Portal Scraper", "description": "Scrape datasets from the EU Open Data Portal (data.europa.eu). Search by keyword, browse by theme or publisher, or fetch full details for specific datasets. No API key required.", "version": "0.1", "x-build-id": "UHpYuSa7r31VjLLXa" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~eu-open-data-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-eu-open-data-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~eu-open-data-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-eu-open-data-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~eu-open-data-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-eu-open-data-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Mode", "enum": [ "searchDatasets", "byTheme", "byPublisher", "datasetDetails" ], "type": "string", "description": "Choose what to scrape: search by keyword, filter by theme, filter by publisher, or fetch dataset details by ID.", "default": "searchDatasets" }, "query": { "title": "Search Query", "type": "string", "description": "Keyword or phrase to search for (used in searchDatasets and byPublisher modes)." }, "theme": { "title": "Theme", "enum": [ "AGRI", "ECON", "EDUC", "ENER", "ENVI", "GOVE", "HEAL", "INTR", "JUST", "REGI", "SOCI", "TECH", "TRAN", "OP_DATPRO" ], "type": "string", "description": "EU data theme category to browse (used in byTheme mode)." }, "publisher": { "title": "Publisher Name", "type": "string", "description": "Filter datasets by publishing organization name (e.g. 'Eurostat', 'European Commission'). Used in byPublisher mode." }, "datasetId": { "title": "Dataset ID", "type": "string", "description": "EU Open Data Portal dataset identifier (used in datasetDetails mode). Example: 'jrc-10112-10001'." }, "locale": { "title": "Language / Locale", "enum": [ "en", "de", "fr", "it", "es", "pt", "nl", "pl", "sv", "da", "fi", "el", "cs", "ro", "hu", "sk", "hr", "bg", "lt", "lv", "et", "sl", "mt", "ga" ], "type": "string", "description": "Preferred language for titles and descriptions.", "default": "en" }, "formatFilter": { "title": "Format Filter", "enum": [ "", "CSV", "JSON", "XML", "PDF", "RDF", "GEOJSON", "XLSX", "ZIP", "HTML", "ODS" ], "type": "string", "description": "Only include datasets that have at least one distribution in this format.", "default": "" }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 5000, "type": "integer", "description": "Maximum number of datasets to return.", "default": 50 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```