Regulations.gov Crawler - Rules, Dockets, Public Comments
Pricing
from $0.32 / 1,000 record scrapeds
Regulations.gov Crawler - Rules, Dockets, Public Comments
Query the official regulations.gov v4 API for federal rules, proposed rules, notices, dockets, and public comments. Filter by agency, document type, docket, date range, and keywords. Requires a free API key.
Pricing
from $0.32 / 1,000 record scrapeds
Rating
0.0
(0)
Developer
BowTiedRaccoon
Maintained by CommunityActor stats
0
Bookmarked
6
Total users
1
Monthly active users
4 days ago
Last modified
Categories
Features
Share
Regulations.gov Scraper - Federal Rules, Dockets & Public Comments API
Query the official regulations.gov v4 API for federal rulemaking. This regulations.gov scraper returns rules, proposed rules, notices, dockets, and public comments by agency — all three endpoints from one actor, covering 2M+ documents, 400K+ dockets, and 20M+ comments submitted to the federal government, each tagged with its Federal Register document number.
Regulations.gov Crawler Features
- Covers three endpoints from a single actor — documents, dockets, and public comments
- Filters by agency, document type, docket ID, date range, and full-text keyword
- Returns clean JSON with consistent field names across all three record types
- Runs are quick and cheap
- Rate-limit aware — a 4-second courtesy delay keeps runs well under the api.data.gov quota
- Handles your own api.data.gov key if you have one, so you can crank through 1,000 requests per hour
Who Uses This Federal Rulemaking Data?
- Compliance teams — Track new rules affecting their industry without paying SaaS rent to Bloomberg Government
- Law firms — Monitor rulemaking dockets in their practice areas and stay ahead of client questions
- Policy researchers — Analyze public comments on proposed rules to understand stakeholder positions
- Trade associations — Watch agency activity and flag anything that could rearrange their members' Monday
- Regulatory intelligence products — Feed structured federal rulemaking data into internal dashboards and client alerts
How Regulations.gov Crawler Works
- Pick a data type — documents, dockets, or comments.
- Narrow the query with optional filters: agency acronym, document type, docket ID, date range, search term.
- The actor hits the regulations.gov v4 API, paginates up to the API's 20-page hard cap (5,000 records per query), and writes each record to your dataset.
- Get a free api.data.gov key if you plan to run this more than a couple times an hour. It takes a minute and doubles your effective throughput.
Input
{"apiKey": "your-free-api-data-gov-key","dataType": "documents","searchTerm": "climate","agencyId": "EPA","documentType": "Rule","postedDateFrom": "2025-01-01","postedDateTo": "2026-04-01","sortBy": "-lastModifiedDate","maxItems": 500}
| Field | Type | Default | Description |
|---|---|---|---|
apiKey | string | (empty) | Your free api.data.gov key. Get one at open.gsa.gov/api/regulationsgov. Optional but strongly recommended — without it you share a global DEMO_KEY quota. |
dataType | string | documents | Which endpoint to hit: documents, dockets, or comments. |
searchTerm | string | (empty) | Full-text search across titles and abstracts. |
documentType | string | (empty) | Documents-only filter: Rule, Proposed Rule, Notice, Supporting & Related Material, Other. |
docketType | string | (empty) | Dockets-only filter: Rulemaking or Nonrulemaking. |
agencyId | string | (empty) | Agency acronym: EPA, FAA, SEC, DOT, FDA, FCC, NRC, etc. |
docketId | string | (empty) | Filter to a specific docket (e.g., EPA-HQ-OAR-2023-0234). Documents and comments only. |
searchTerms | array | (empty) | Several keywords in one run. Records matching more than one term are returned once. |
documentTypes | array | (empty) | Several document types in one run (documents only). |
agencyIds | array | (empty) | Several agency acronyms in one run. |
docketIds | array | (empty) | Several dockets in one run (documents and comments). |
openForComment | boolean | false | Documents whose comment period is still open. |
commentEndAfter | string | (empty) | Documents whose comment period closes on or after this date (YYYY-MM-DD). |
enrichDetails | boolean | false | Add the detail fields listed below. Each enriched record is billed as one extra result. |
postedDateFrom | string | (empty) | Return records posted on or after this date (YYYY-MM-DD). |
postedDateTo | string | (empty) | Return records posted on or before this date (YYYY-MM-DD). |
sortBy | string | -lastModifiedDate | Sort order: -lastModifiedDate, lastModifiedDate, -postedDate, postedDate, title. |
maxItems | integer | 100 | Max records to return. API hard cap is 5,000 per query — narrow filters for larger datasets. |
Example: All EPA Final Rules Posted in the Last Month
{"dataType": "documents","agencyId": "EPA","documentType": "Rule","postedDateFrom": "2026-03-19","maxItems": 500}
Example: Public Comments on a Specific Docket
{"dataType": "comments","docketId": "EPA-HQ-OAR-2023-0234","sortBy": "-postedDate","maxItems": 1000}
Example: Rulemaking Dockets From the FAA
{"dataType": "dockets","agencyId": "FAA","docketType": "Rulemaking","maxItems": 200}
Regulations.gov Crawler Output Fields
All three endpoints share a consistent schema. Fields that do not apply to a given record type are returned as empty strings.
Document Record
{"recordType": "document","id": "FAA-2026-3471-0001","objectId": "09000064b925548c","title": "Airworthiness Directives: The Boeing Company Airplanes","documentType": "Proposed Rule","subtype": "Request for Comment","agencyId": "FAA","docketId": "FAA-2026-3471","docketType": "","frDocNum": "2026-06691","commentStartDate": "2026-04-07T04:00:00Z","commentEndDate": "2026-05-23T03:59:59Z","postedDate": "2026-04-07T04:00:00Z","lastModifiedDate": "2026-04-19T09:00:22Z","withinCommentPeriod": true,"openForComment": true,"withdrawn": false,"allowLateComments": false,"commentOnId": "","commentOnDocumentId": "","url": "https://www.regulations.gov/document/FAA-2026-3471-0001","apiUrl": "https://api.regulations.gov/v4/documents/FAA-2026-3471-0001"}
Docket Record
{"recordType": "docket","id": "USCG-2019-0806","objectId": "0b00006483f8d57e","title": "Allegheny River mm 0-0.25, Pittsburgh, PA","documentType": "Rulemaking","agencyId": "USCG","docketType": "Rulemaking","lastModifiedDate": "2019-10-25T12:02:53Z","url": "https://www.regulations.gov/docket/USCG-2019-0806","apiUrl": "https://api.regulations.gov/v4/dockets/USCG-2019-0806"}
Comment Record
{"recordType": "comment","id": "EPA-HQ-OAR-2023-0234-0518","objectId": "090000648681354a","title": "Subpart W Petition for Reconsideration submitted by Producer Associations, Petroleum Association of America (IPAA) et al.","documentType": "Public Submission","agencyId": "EPA","docketId": "EPA-HQ-OAR-2023-0234","postedDate": "2024-11-13T05:00:00Z","lastModifiedDate": "2024-11-14T01:34:39Z","withdrawn": false,"commentOnId": "0900006485d9b8dd","commentOnDocumentId": "EPA-HQ-OAR-2023-0234-0001","url": "https://www.regulations.gov/comment/EPA-HQ-OAR-2023-0234-0518","apiUrl": "https://api.regulations.gov/v4/comments/EPA-HQ-OAR-2023-0234-0518"}
docketId, commentOnId and commentOnDocumentId on a comment come from its detail record, so they are filled when enrichDetails is on.
Field Reference
| Field | Type | Description |
|---|---|---|
recordType | string | Which endpoint produced the record: document, docket, or comment. |
id | string | Regulations.gov ID (e.g., EPA-HQ-OAR-2023-0234-0005). |
objectId | string | Internal regulations.gov object identifier — useful for cross-referencing and for filtering comments by parent document. |
title | string | Record title. |
documentType | string | Document type or (for dockets) the docket type. |
subtype | string | Document subtype (e.g., Final Rule, Interim Final Rule). |
agencyId | string | Agency acronym (e.g., EPA, FAA, SEC). |
docketId | string | Parent docket ID (documents and comments). |
docketType | string | Rulemaking or Nonrulemaking (dockets only). |
frDocNum | string | Federal Register document number (documents only). |
commentStartDate | string | Start of comment period (ISO 8601). |
commentEndDate | string | End of comment period (ISO 8601). |
postedDate | string | Date the record was posted. |
lastModifiedDate | string | Last modification timestamp. |
withinCommentPeriod | boolean | Whether the comment period is currently open. |
openForComment | boolean | Whether the record is currently accepting comments. |
withdrawn | boolean | Whether the record has been withdrawn. |
allowLateComments | boolean | Whether late comments are permitted. |
commentOnId | string | Object ID of the document the comment is on (comments with enrichDetails on; the comment list does not carry it). |
commentOnDocumentId | string | Document ID the comment is on, e.g. EPA-HQ-OAR-2023-0234-0001 (comments with enrichDetails on). |
url | string | Public regulations.gov URL for the record. |
apiUrl | string | API URL for fetching the full detail record. |
With enrichDetails on, records also carry these fields:
| Field | Type | Description |
|---|---|---|
detailFetched | boolean | true when the detail fields were added; false when that record's detail could not be loaded (not billed extra). |
abstract | string | Abstract or summary (documents and dockets). |
files | array | Downloadable files as {url, format, sizeBytes} (documents and comments). |
pdfUrl | string | Direct PDF link (documents and comments). |
htmlUrl | string | Direct HTML link (documents). |
effectiveDate | string | Rule effective date (documents). |
cfrPart | string | CFR part affected (documents). |
pageCount | integer | Page count (documents). |
startEndPage | string | Federal Register start and end page (documents). |
topics | array | Subject topics (documents). |
comment | string | Full comment text (comments). Empty for file-only submissions. |
submitterName | string | Commenter name when given (comments). |
organization | string | Submitting organization (comments). |
submitterCategory | string | Submitter category (comments). |
receiveDate | string | Date the agency received the comment (comments). |
trackingNbr | string | Comment tracking number (comments). |
country | string | Submitter country when given (comments). |
stateProvinceRegion | string | Submitter state or region when given (comments). |
shortTitle | string | Docket short title (dockets). |
rin | string | Regulation Identifier Number (dockets). |
keywords | array | Docket keywords (dockets). |
FAQ
How do I scrape regulations.gov?
Regulations.gov Crawler hits the official v4 REST API. Pick a dataType (documents, dockets, or comments), add filters, and run it. No browser, no HTML parsing.
Do I need an API key?
Regulations.gov Crawler works without one, but not very well. The shared DEMO_KEY is rate-limited to 10 requests per hour across all users of the API. Get a free key at open.gsa.gov/api/regulationsgov — it takes about a minute and bumps your quota to 1,000 requests per hour.
How much data can I pull in one run?
Regulations.gov Crawler is capped at 5,000 records per query by the API itself (20 pages × 250 records). For larger datasets, narrow your filters — by agency, date range, or docket — and run the actor multiple times. The date range filters are especially useful for slicing large agencies into monthly windows.
Can I get the full text of public comments?
Yes. Set dataType to comments and turn on enrichDetails: each comment then carries its full text, submitter name, organization, category and attachment links. Each enriched record is billed as one extra result, so leave it off when titles and dates are enough.
How do I download all EPA (or FAA, SEC, FDA) rules by agency?
Set agencyId to the agency acronym — EPA, FAA, SEC, FDA, FCC, NRC, DOT, and so on — and leave the other filters open. The actor returns every matching document, docket, or comment for that agency, each carrying its frDocNum so you can cross-reference the Federal Register entry. Pair it with postedDateFrom/postedDateTo to slice large agencies into date windows.
How much does it cost to run?
Regulations.gov Crawler uses the standard PPE pricing model: $0.10 per run start plus $0.001 per record. A 500-record pull costs about $0.60. A full 5,000-record run is $5.10.
Need More Features?
Need a different endpoint or a field that is not listed here? File an issue or get in touch.
Why Use Regulations.gov Crawler?
- Covers all three endpoints — Documents, dockets, and comments in one actor. Other regulations.gov scrapers on the Apify store pick one and stop there.
- Uses the official API — Structured JSON, stable schemas, no HTML parsing brittleness, no surprise 500s from the rendered site.
- Bring your own key — The actor supports your own api.data.gov key so you can run it at full throughput without sharing a quota with strangers.