Regulations.gov Scraper

Overview

Search and extract federal rulemaking documents, dockets, and public comments from Regulations. gov. Filter by agency, document type, date range, and keywords.

Features

• Search by keywords to find specific results
• Filter results by category or type
• Export data in JSON, CSV, or Excel formats
• Control output volume with configurable result limits
• Built-in proxy support for reliable data collection

Use Cases

• Track - Track federal government data releases and updates
• Build - Build datasets for policy research and analysis
• Monitor - Monitor regulatory changes and compliance requirements
• Aggregate - Aggregate public government data for transparency projects

Input Parameters

Parameter	Type	Description	Default
apiKey	string (required)	Your API key from api.data.gov (free). Sign up at https://api.data.gov/signup/
searchTerm	string	Keyword search (e.g., 'clean energy', 'drug safety', 'emissions')
documentType	string	Filter by document type
agencyId	string	Agency abbreviation (e.g., EPA, FDA, DOT, HHS, OSHA, SEC)
docketId	string	Specific docket ID (e.g., EPA-HQ-OAR-2021-0208)
startDate	string	Posted after this date (YYYY-MM-DD)
endDate	string	Posted before this date (YYYY-MM-DD)
sortBy	string	Sort order for results	-postedDate
maxItems	integer	Maximum number of results to return	100
proxyConfiguration	object	Proxy configuration (optional)

Output Example

Each result contains structured data like this:

{
  "documentId": "ABC-12345",
  "title": "Sample Government - Federal Result",
  "documentType": "Sample documentType",
  "agencyId": "ABC-12345",
  "docketId": "ABC-12345",
  "postedDate": "2025-01-15",
  "commentEndDate": "2025-01-15",
  "url": "https://example.com/item/12345"
}

Pricing

This actor uses pay-per-result pricing:

• $0.001 per result
• $1.00 per 1,000 results

No monthly fees. You only pay for what you scrape. Apify Free plan includes $5/month in platform credits.

How to Run

Apify Console

1. Go to the Regulations.gov Scraper actor page
2. Configure your input parameters
3. Click Start and wait for the results
4. Download data in JSON, CSV, or Excel format

API

curl -X POST "https://api.apify.com/v2/acts/fortuitous_pirate~regulations-gov-scraper/runs?token=YOUR_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"maxItems": 10}'

Python SDK

from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("fortuitous_pirate/regulations-gov-scraper").call(
    run_input={"maxItems": 10}
)

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

Integration

Connect Regulations.gov Scraper with your existing tools and workflows:

• API access - Programmatic access via Apify API
• Webhooks - Get notified when scraping completes
• Scheduling - Set up recurring runs on any schedule
• Zapier / Make - Connect with 5,000+ apps via Apify integrations
• Python / Node.js SDKs - Native client libraries for easy integration