Pricing

Pay per event

Data.gov Dataset Catalog Crawler

Crawl 300K+ US government datasets from Data.gov. Extract titles, organizations, tags, formats, download URLs, API endpoints, temporal and spatial coverage, contacts, and resources. Filter by agency, format, category, and tags.

Pricing

Pay per event

Rating

0.0

(0)

Developer

BowTiedRaccoon

Actor stats

Bookmarked

Total users

Monthly active users

10 days ago

Last modified

Categories

Developer tools

Business

Other

You can access the Data.gov Dataset Catalog Crawler programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "sp_intended_usage": "Describe your intended use...",
10    "sp_improvement_suggestions": "Share your suggestions here...",
11    "sp_contact": "Share your email here...",
12    "searchQuery": "",
13    "organization": "",
14    "dataFormat": "",
15    "tags": [],
16    "category": "",
17    "includeResources": True,
18    "sortBy": "score desc",
19    "maxItems": 100,
20}
21
22# Run the Actor and wait for it to finish
23run = client.actor("jungle_synthesizer/datagov-dataset-crawler").call(run_input=run_input)
24
25# Fetch and print Actor results from the run's dataset (if there are any)
26print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
27for item in client.dataset(run["defaultDatasetId"]).iterate_items():
28    print(item)
29
30# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Data.gov Crawler - US Government Dataset Catalog API in Python

The Apify API client for Python is the official library that allows you to use Data.gov Dataset Catalog Crawler API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Data.gov Dataset Catalog Crawler API in JavaScript

Data.gov Dataset Catalog Crawler API through CLI

Data.gov Dataset Catalog Crawler OpenAPI definition

Data.gov Dataset Catalog Crawler API

Data.gov Catalog Scraper

crawlergang/data-gov-catalog-scraper

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Crawler Gang

5.0

Data.gov Catalog Scraper

crawlerbros/data-gov-catalog-scraper

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Crawler Bros

Data Gov Catalog Scraper

fortuitous_pirate/data-gov-catalog-scraper

Search, filter, and download metadata for 300,000+ federal open datasets from Data.gov. Filter by agency (NASA, EPA, NOAA), format (CSV, JSON, API), tags, and topics. Returns dataset details, resource links, and organization info.

Fortuitous Pirate

Data.gov API - US Open Government Datasets

alizarin_refrigerator-owner/data-gov-api---us-open-government-datasets

Access the Data.gov catalog of 300,000+ US government datasets. Search datasets by topic, agency, format, and keywords. Discover open data from federal, state, and local governments

The Howlers

Data.gov Dataset Search

ryanclinton/datagov-dataset-search

Search and extract metadata from 300,000+ datasets in the official United States government open data catalog at [Data.gov](https://catalog.data.gov/).

Ryan Clinton

data.gouv.fr Scraper

crawlerbros/datagouvfr-scraper

Scrape the French government open-data portal (data.gouv.fr). Search datasets by keyword, fetch full dataset details by ID/slug, list datasets by organization, and search organizations and reuses - with titles, descriptions, resources/formats, licenses, temporal coverage and metrics.

Crawler Bros

Data.gov.uk Scraper - Low-cost💲🔥📚🇬🇧

delectable_incubator/data-gov-uk-scraper-low-cost

Scrape data.gov.uk dataset listings 🔎📊 with a powerful open data scraper. Extract dataset titles, publishers, update dates, descriptions, tags, and dataset URLs from search results. Ideal for government data monitoring, open data research, dataset discovery, and structured data catalog creation 🚀

Prime Scrape

Australia Open Data (data.gov.au) Scraper

parseforge/australia-data-gov-au-scraper

Export Australian government open datasets from data.gov.au. Browse 70k+ datasets across federal, state, and territory agencies. Pull dataset metadata, resources, organization, license, tags, and update frequency. Catalog mode lists all; dataset mode fetches one by ID.