Eu Open Data Portal Scraper avatar

Eu Open Data Portal Scraper

Pricing

Pay per usage

Go to Apify Store
Eu Open Data Portal Scraper

Eu Open Data Portal Scraper

EU Open Data Portal Scraper searches the public data.europa.eu hub and saves dataset records you can export to JSON, CSV, or Excel. Search by keyword, filter by country or format, or look up a dataset id. No login needed. It paces requests, retries rate limits, and skips duplicate dataset ids.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

BigiByte

BigiByte

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

10 days ago

Last modified

Categories

Share

EU Open Data Portal Scraper: Search data.europa.eu datasets

EU Open Data Portal Scraper

EU Open Data Portal Scraper searches the public data.europa.eu hub and saves dataset records as a flat dataset. You can search by keyword, narrow by country or file format, or look up a dataset id. No login. Results export to JSON, CSV, or Excel from the Apify dataset.

Use cases

  • Open data research: pull air quality, transport, or other data.europa.eu datasets into a spreadsheet
  • Catalog monitoring: schedule a keyword search and compare new dataset ids over time
  • Country filters: keep German, Belgian, or other national catalogs by ISO code
  • Format checks: ask for CSV or JSON distributions when you only want files you can load
  • Id lookup: confirm a known dataset id is still present on the hub
  • Developer pipelines: feed the dataset into Make, Zapier, or a warehouse without writing a client

Input

ParameterTypeDefaultDescription
searchQueriesarrayair qualityKeywords to search for. One per line.
countriesarrayemptyLower-case ISO2 country codes, such as de.
formatsarrayemptyFile format labels, such as CSV.
datasetIdsarrayemptyDataset ids to look up. Unknown ids become error rows.
maxItemsinteger100Cap on saved dataset records. Maximum 1000. Error rows are extra.
requestDelaySecsnumber0.3Pause between requests, in seconds. Minimum 0.3.
timeoutSecsinteger300Stop starting new requests after this many seconds.
requestTimeoutSecsinteger30Timeout for each request.
proxyConfigurationobject{"useApifyProxy": false}Optional proxy. Default is no proxy.

Example input

{
"searchQueries": ["air quality"],
"countries": [],
"formats": [],
"datasetIds": [],
"maxItems": 100,
"requestDelaySecs": 0.3,
"timeoutSecs": 300,
"requestTimeoutSecs": 30,
"proxyConfiguration": { "useApifyProxy": false }
}

A country facet run looks like this:

{
"searchQueries": ["transport"],
"countries": ["de"],
"formats": ["CSV"],
"maxItems": 20
}

What data does this actor extract?

Each saved dataset record keeps the hub fields, plus source_url, scraped_at, and mode. The hub names title and description are stored as itemTitle and itemDescription. mode is dataset search, dataset detail, or facet filter.

{
"id": "be-air-example",
"itemTitle": { "en": "Air quality" },
"itemDescription": { "en": "Belgian open data record" },
"country": { "label": "Belgium", "id": "be" },
"catalog": { "id": "data-gov-be" },
"keywords": [{ "id": "air", "label": "air", "language": "fr" }],
"modified": "2024-01-01T00:00:00Z",
"resource": "http://data.europa.eu/88u/dataset/be-air-example",
"source_url": "https://data.europa.eu/data/datasets/be-air-example",
"scraped_at": "2026-10-12T00:00:00+00:00",
"mode": "dataset search"
}
FieldTypeDescription
idstringDataset id, also the dedupe key.
itemTitleobjectMultilingual title from the hub.
itemDescriptionobjectMultilingual description from the hub.
countryobjectCountry label and code.
catalogobjectCatalog that harvested the dataset.
keywordsarrayKeyword objects.
distributionsarrayFiles and access URLs, including their format labels.
resourcestringCanonical dataset URI.
source_urlstringSource URL for the row.
scraped_atstringUTC time the row was saved.
modestringdataset search, dataset detail, or facet filter.
errorstringPresent only on a failed lookup.
inputstringQuery or id that failed.
statusintegerHTTP status, or 0 when there was no response.

Failed lookups do not stop the run. An unknown dataset id is stored as { "error", "input", "status": 404 }.

Limits and terms

European Commission metadata on the portal is reusable under the Commission reuse decision, and EC content is offered under CC BY 4.0. Each dataset can carry its own licence. Check the record before you republish files.

No account or login is required.

FAQ

Does this actor need an account or login?

No. The data.europa.eu portal is public, so you do not log in.

How fresh is the data?

Rows reflect what the portal shows at run time. modified and issued are whatever the portal last published. Schedule the actor if you want a newer pull tomorrow.

What happens on an empty search?

If you clear keywords, countries, formats, and dataset ids, the run finishes with no rows and a warning in the log.

Can I export CSV?

Yes. Open the run dataset on Apify and export JSON, CSV, or Excel. The overview view shows id, title, country, catalog, keywords, modified, resource, and mode.

If you plan to join or analyse these rows, a quick CSV cleanup or a de-duplication pass are the usual next steps. BigiByte also builds scrapers for other open-data portals when you need them as a separate job.

Need another national or EU open-data catalog, a scheduled monitor, or a custom pipeline? BigiByte builds custom scrapers and data tools: https://bigibyte.com

Trademark Notice

EU Open Data Portal and related names, logos, and trademarks belong to their respective owners. Their use in this documentation is solely to identify the source of the data and does not imply affiliation, sponsorship, endorsement, or partnership.

Disclaimer

Disclaimer: This Actor is an independent tool and is not affiliated with, endorsed by, sponsored by, or otherwise officially associated with EU Open Data Portal or its owners. All data is collected from publicly available sources. Users are responsible for complying with the source's terms of use, rate limits, and attribution or licensing requirements.

This Actor only collects publicly available data from EU Open Data Portal, without logging in or bypassing any access controls. Scraping public data is generally legal, but how you use it matters:

  • Personal data: If the results include personal data (for example names, emails, or profile details), laws such as the GDPR in the EU and the CCPA in California may apply. Only collect and store personal data when you have a legitimate reason.
  • Copyright: Some content (articles, images, descriptions) may be protected by copyright. Do not republish full copyrighted content without permission.
  • Terms of use: Respect the source's terms, stated rate limits, and any attribution or licence requirements listed in the Limits and terms section.
  • Legal advice: This is general information, not legal advice. If you're unsure, consult a lawyer.

To learn more, read Apify's guide: Is web scraping legal?