🇬🇧 Data.gov.uk Scraper

🚀 Collect open dataset metadata from Data.gov.uk in minutes. Search by keyword, publisher, or topic. Export dataset titles, descriptions, download links, and publisher info. No coding, no account required.

Pull structured records from Data.gov.uk — clean fields ready as CSV, JSON, JSONL, Excel, or XML for downstream pipelines.

Related Scrapers
UK data.gov.uk ➸ You are here	USA data.gov US federal open data	Korea data.go.kr Korean open gov data

Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

parseforge/data-gov-uk-scraper on Apify. Call: ApifyClient("TOKEN").actor("parseforge/data-gov-uk-scraper").call(run_input={...}), then client.dataset(run["defaultDatasetId"]).list_items().items for results. Key inputs: startUrl (string), maxItems (integer, default 10), searchQuery (string, default "economics"), publisher (string), topic (string), format (string). Full actor spec: fetch build via GET https://api.apify.com/v2/acts/parseforge~data-gov-uk-scraper (Bearer TOKEN). Get token: https://console.apify.com/account/integrations

The Data.gov.uk Scraper collects open data catalog metadata from the UK government's data portal, returning 20+ fields per dataset: title, description, publisher, topic, format, download URL, update frequency, and license. Runs support up to 1,000,000 datasets on a paid plan.

Data.gov.uk hosts over 50,000 open datasets from UK government departments and public bodies. The Actor supports keyword search with publisher and topic filters.

🎯 Target Audience	💡 Primary Use Cases
Data scientists, policy researchers, journalists, civic tech teams, academic researchers, open data advocates	Open data discovery, policy research, data journalism, civic technology, government transparency analysis

📋 What the Data.gov.uk Scraper does

Three search filters:

• 🔍 Keyword search. Free-text search across dataset titles and descriptions.
• 🏛️ Publisher filter. Filter by government department or public body.
• 📂 Topic filter. Browse by subject area.
• 🔗 URL mode. Paste a direct Data.gov.uk search URL.

Each dataset record includes title, description, publisher, topic, data format, download URL, update frequency, license, and portal URL.

💡 Why it matters: browsing Data.gov.uk for relevant datasets means scrolling through search results and clicking into each listing. This Actor exports structured catalog metadata at scale, ready for your open data inventories or research pipelines.

📊 Data fields

Each record includes: contact, contactUrl, description, downloadLinks, format, lastUpdated, license, publisher, scrapedTimestamp, title, topic, url. All 12 field names come from a real production run, so what you see here is what lands in your dataset.

⚠️ Good to Know: Data.gov.uk is the UK government's official open data portal. Datasets link to various formats (CSV, JSON, XML, PDF) hosted by individual departments.

🚀 How to use

1. 📝 Sign up. Create a free account with $5 credit (takes 2 minutes).
2. 🌐 Open the Actor. Go to the Data.gov.uk Scraper page on the Apify Store.
3. 🎯 Set input. Enter a keyword, pick a publisher or topic.
4. 🚀 Run it. Click Start.
5. 📥 Download. Grab results in the Dataset tab.

⏱️ Total time: 3-5 minutes. No coding required.

🔗 Recommended Actors

• 📊 USAspending Scraper - U.S. federal spending data
• 📊 FRED Scraper - Economic data from Federal Reserve
• 📊 Indexmundi Scraper - Global indicators
• 📋 GSA eLibrary Scraper - U.S. government contracts
• 🏥 ClinicalTrials.gov Scraper - Clinical trial data

💡 Pro Tip: browse the complete ParseForge collection for more government and open data scrapers.

⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by the UK government or Data.gov.uk. All trademarks mentioned are the property of their respective owners. Only publicly available open data catalog metadata is collected.

🆘 Need Help?

If you hit a bug, have questions about setup, or need a scraper we haven't built yet, open our contact form or write to parseforge@protonmail.com. We also take on paid custom data projects.

For faster answers, join our Discord. It's the best place to get support and suggest new actors.