🇺🇸 Data.gov Scraper

🚀 Collect open dataset metadata from Data.gov in minutes. Search by keyword, topic, or category. Export dataset titles, descriptions, download links, and agency info. No coding, no account required.

Pull structured records from USA Data.gov U.S. Open Data — clean fields ready as CSV, JSON, JSONL, Excel, or XML for downstream pipelines.

Related Scrapers
USA data.gov ➸ You are here	UK data.gov.uk UK open gov data	Korea data.go.kr Korean open gov data

Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

parseforge/data-gov-scraper on Apify. Call: ApifyClient("TOKEN").actor("parseforge/data-gov-scraper").call(run_input={...}), then client.dataset(run["defaultDatasetId"]).list_items().items for results. Key inputs: startUrl (string), searchQuery (string, default "climate"), topics (array), topicCategories (array), datasetType (string), tags (array). Full actor spec: fetch build via GET https://api.apify.com/v2/acts/parseforge~data-gov-scraper (Bearer TOKEN). Get token: https://console.apify.com/account/integrations

The Data.gov Scraper collects open data catalog metadata from the U.S. government's data portal, returning 20+ fields per dataset: title, description, agency, topic, format, download URL, update frequency, and license. Data.gov hosts over 300,000 datasets from 100+ federal agencies.

The Actor supports keyword search with topic and category filters, plus direct URL scraping.

🎯 Target Audience	💡 Primary Use Cases
Data scientists, policy researchers, journalists, civic tech teams, academic researchers, government analysts	Open data discovery, policy research, data journalism, civic technology, federal data monitoring

📋 What the Data.gov Scraper does

Three search filters:

• 🔍 Keyword search. Free-text search across dataset titles and descriptions.
• 📂 Topic filter. Subject areas (health, education, climate, finance, etc.).
• 📂 Category filter. Detailed categorization within topics.
• 🔗 URL mode. Paste a direct Data.gov search URL.

Each dataset record includes title, description, agency, topic, categories, data format, download URLs, update frequency, license, and portal URL.

💡 Why it matters: browsing Data.gov for relevant datasets means scrolling through 300,000+ listings. This Actor exports structured catalog metadata at scale for your open data pipelines or research projects.

📊 Data fields

Each record includes: availableFormats, contact, datasetUrl, description, downloadsAndResources, landingPage, license, metadataCreated, metadataUpdated, organizationName, organizationType, organizationUrl, publisher, scrapedTimestamp, tags, title, topics. All 17 field names come from a real production run, so what you see here is what lands in your dataset.

⚠️ Good to Know: Data.gov is the U.S. government's official open data portal. Datasets link to various formats (CSV, JSON, XML, API) hosted by individual agencies.

🚀 How to use

1. 📝 Sign up. Create a free account with $5 credit (takes 2 minutes).
2. 🌐 Open the Actor. Go to the Data.gov Scraper page on the Apify Store.
3. 🎯 Set input. Enter a keyword, pick topics and categories.
4. 🚀 Run it. Click Start.
5. 📥 Download. Grab results in the Dataset tab.

⏱️ Total time: 3-5 minutes. No coding required.

🔗 Recommended Actors

• 🇬🇧 Data.gov.uk Scraper - UK open data catalog
• 📊 USAspending Scraper - Federal spending data
• 📊 FRED Scraper - Economic data
• 📋 GSA eLibrary Scraper - Government contracts
• 📊 Indexmundi Scraper - Global indicators

💡 Pro Tip: browse the complete ParseForge collection for more government and open data scrapers.

⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by the U.S. government or Data.gov. All trademarks mentioned are the property of their respective owners. Only publicly available open data catalog metadata is collected.

🆘 Need Help?

If you hit a bug, have questions about setup, or need a scraper we haven't built yet, open our contact form or write to parseforge@protonmail.com. We also take on paid custom data projects.

For faster answers, join our Discord. It's the best place to get support and suggest new actors.