Regulations.gov Crawler - Rules, Dockets, Public Comments avatar

Regulations.gov Crawler - Rules, Dockets, Public Comments

Pricing

from $0.32 / 1,000 record scrapeds

Go to Apify Store
Regulations.gov Crawler - Rules, Dockets, Public Comments

Regulations.gov Crawler - Rules, Dockets, Public Comments

Query the official regulations.gov v4 API for federal rules, proposed rules, notices, dockets, and public comments. Filter by agency, document type, docket, date range, and keywords. Requires a free API key.

Pricing

from $0.32 / 1,000 record scrapeds

Rating

0.0

(0)

Developer

BowTiedRaccoon

BowTiedRaccoon

Maintained by Community

Actor stats

0

Bookmarked

6

Total users

1

Monthly active users

4 days ago

Last modified

Features

Limited permissions

Share

Regulations.gov Scraper - Federal Rules, Dockets & Public Comments API

Query the official regulations.gov v4 API for federal rulemaking. This regulations.gov scraper returns rules, proposed rules, notices, dockets, and public comments by agency — all three endpoints from one actor, covering 2M+ documents, 400K+ dockets, and 20M+ comments submitted to the federal government, each tagged with its Federal Register document number.


Regulations.gov Crawler Features

  • Covers three endpoints from a single actor — documents, dockets, and public comments
  • Filters by agency, document type, docket ID, date range, and full-text keyword
  • Returns clean JSON with consistent field names across all three record types
  • Runs are quick and cheap
  • Rate-limit aware — a 4-second courtesy delay keeps runs well under the api.data.gov quota
  • Handles your own api.data.gov key if you have one, so you can crank through 1,000 requests per hour

Who Uses This Federal Rulemaking Data?

  • Compliance teams — Track new rules affecting their industry without paying SaaS rent to Bloomberg Government
  • Law firms — Monitor rulemaking dockets in their practice areas and stay ahead of client questions
  • Policy researchers — Analyze public comments on proposed rules to understand stakeholder positions
  • Trade associations — Watch agency activity and flag anything that could rearrange their members' Monday
  • Regulatory intelligence products — Feed structured federal rulemaking data into internal dashboards and client alerts

How Regulations.gov Crawler Works

  1. Pick a data type — documents, dockets, or comments.
  2. Narrow the query with optional filters: agency acronym, document type, docket ID, date range, search term.
  3. The actor hits the regulations.gov v4 API, paginates up to the API's 20-page hard cap (5,000 records per query), and writes each record to your dataset.
  4. Get a free api.data.gov key if you plan to run this more than a couple times an hour. It takes a minute and doubles your effective throughput.

Input

{
"apiKey": "your-free-api-data-gov-key",
"dataType": "documents",
"searchTerm": "climate",
"agencyId": "EPA",
"documentType": "Rule",
"postedDateFrom": "2025-01-01",
"postedDateTo": "2026-04-01",
"sortBy": "-lastModifiedDate",
"maxItems": 500
}
FieldTypeDefaultDescription
apiKeystring(empty)Your free api.data.gov key. Get one at open.gsa.gov/api/regulationsgov. Optional but strongly recommended — without it you share a global DEMO_KEY quota.
dataTypestringdocumentsWhich endpoint to hit: documents, dockets, or comments.
searchTermstring(empty)Full-text search across titles and abstracts.
documentTypestring(empty)Documents-only filter: Rule, Proposed Rule, Notice, Supporting & Related Material, Other.
docketTypestring(empty)Dockets-only filter: Rulemaking or Nonrulemaking.
agencyIdstring(empty)Agency acronym: EPA, FAA, SEC, DOT, FDA, FCC, NRC, etc.
docketIdstring(empty)Filter to a specific docket (e.g., EPA-HQ-OAR-2023-0234). Documents and comments only.
searchTermsarray(empty)Several keywords in one run. Records matching more than one term are returned once.
documentTypesarray(empty)Several document types in one run (documents only).
agencyIdsarray(empty)Several agency acronyms in one run.
docketIdsarray(empty)Several dockets in one run (documents and comments).
openForCommentbooleanfalseDocuments whose comment period is still open.
commentEndAfterstring(empty)Documents whose comment period closes on or after this date (YYYY-MM-DD).
enrichDetailsbooleanfalseAdd the detail fields listed below. Each enriched record is billed as one extra result.
postedDateFromstring(empty)Return records posted on or after this date (YYYY-MM-DD).
postedDateTostring(empty)Return records posted on or before this date (YYYY-MM-DD).
sortBystring-lastModifiedDateSort order: -lastModifiedDate, lastModifiedDate, -postedDate, postedDate, title.
maxItemsinteger100Max records to return. API hard cap is 5,000 per query — narrow filters for larger datasets.

Example: All EPA Final Rules Posted in the Last Month

{
"dataType": "documents",
"agencyId": "EPA",
"documentType": "Rule",
"postedDateFrom": "2026-03-19",
"maxItems": 500
}

Example: Public Comments on a Specific Docket

{
"dataType": "comments",
"docketId": "EPA-HQ-OAR-2023-0234",
"sortBy": "-postedDate",
"maxItems": 1000
}

Example: Rulemaking Dockets From the FAA

{
"dataType": "dockets",
"agencyId": "FAA",
"docketType": "Rulemaking",
"maxItems": 200
}

Regulations.gov Crawler Output Fields

All three endpoints share a consistent schema. Fields that do not apply to a given record type are returned as empty strings.

Document Record

{
"recordType": "document",
"id": "FAA-2026-3471-0001",
"objectId": "09000064b925548c",
"title": "Airworthiness Directives: The Boeing Company Airplanes",
"documentType": "Proposed Rule",
"subtype": "Request for Comment",
"agencyId": "FAA",
"docketId": "FAA-2026-3471",
"docketType": "",
"frDocNum": "2026-06691",
"commentStartDate": "2026-04-07T04:00:00Z",
"commentEndDate": "2026-05-23T03:59:59Z",
"postedDate": "2026-04-07T04:00:00Z",
"lastModifiedDate": "2026-04-19T09:00:22Z",
"withinCommentPeriod": true,
"openForComment": true,
"withdrawn": false,
"allowLateComments": false,
"commentOnId": "",
"commentOnDocumentId": "",
"url": "https://www.regulations.gov/document/FAA-2026-3471-0001",
"apiUrl": "https://api.regulations.gov/v4/documents/FAA-2026-3471-0001"
}

Docket Record

{
"recordType": "docket",
"id": "USCG-2019-0806",
"objectId": "0b00006483f8d57e",
"title": "Allegheny River mm 0-0.25, Pittsburgh, PA",
"documentType": "Rulemaking",
"agencyId": "USCG",
"docketType": "Rulemaking",
"lastModifiedDate": "2019-10-25T12:02:53Z",
"url": "https://www.regulations.gov/docket/USCG-2019-0806",
"apiUrl": "https://api.regulations.gov/v4/dockets/USCG-2019-0806"
}

Comment Record

{
"recordType": "comment",
"id": "EPA-HQ-OAR-2023-0234-0518",
"objectId": "090000648681354a",
"title": "Subpart W Petition for Reconsideration submitted by Producer Associations, Petroleum Association of America (IPAA) et al.",
"documentType": "Public Submission",
"agencyId": "EPA",
"docketId": "EPA-HQ-OAR-2023-0234",
"postedDate": "2024-11-13T05:00:00Z",
"lastModifiedDate": "2024-11-14T01:34:39Z",
"withdrawn": false,
"commentOnId": "0900006485d9b8dd",
"commentOnDocumentId": "EPA-HQ-OAR-2023-0234-0001",
"url": "https://www.regulations.gov/comment/EPA-HQ-OAR-2023-0234-0518",
"apiUrl": "https://api.regulations.gov/v4/comments/EPA-HQ-OAR-2023-0234-0518"
}

docketId, commentOnId and commentOnDocumentId on a comment come from its detail record, so they are filled when enrichDetails is on.

Field Reference

FieldTypeDescription
recordTypestringWhich endpoint produced the record: document, docket, or comment.
idstringRegulations.gov ID (e.g., EPA-HQ-OAR-2023-0234-0005).
objectIdstringInternal regulations.gov object identifier — useful for cross-referencing and for filtering comments by parent document.
titlestringRecord title.
documentTypestringDocument type or (for dockets) the docket type.
subtypestringDocument subtype (e.g., Final Rule, Interim Final Rule).
agencyIdstringAgency acronym (e.g., EPA, FAA, SEC).
docketIdstringParent docket ID (documents and comments).
docketTypestringRulemaking or Nonrulemaking (dockets only).
frDocNumstringFederal Register document number (documents only).
commentStartDatestringStart of comment period (ISO 8601).
commentEndDatestringEnd of comment period (ISO 8601).
postedDatestringDate the record was posted.
lastModifiedDatestringLast modification timestamp.
withinCommentPeriodbooleanWhether the comment period is currently open.
openForCommentbooleanWhether the record is currently accepting comments.
withdrawnbooleanWhether the record has been withdrawn.
allowLateCommentsbooleanWhether late comments are permitted.
commentOnIdstringObject ID of the document the comment is on (comments with enrichDetails on; the comment list does not carry it).
commentOnDocumentIdstringDocument ID the comment is on, e.g. EPA-HQ-OAR-2023-0234-0001 (comments with enrichDetails on).
urlstringPublic regulations.gov URL for the record.
apiUrlstringAPI URL for fetching the full detail record.

With enrichDetails on, records also carry these fields:

FieldTypeDescription
detailFetchedbooleantrue when the detail fields were added; false when that record's detail could not be loaded (not billed extra).
abstractstringAbstract or summary (documents and dockets).
filesarrayDownloadable files as {url, format, sizeBytes} (documents and comments).
pdfUrlstringDirect PDF link (documents and comments).
htmlUrlstringDirect HTML link (documents).
effectiveDatestringRule effective date (documents).
cfrPartstringCFR part affected (documents).
pageCountintegerPage count (documents).
startEndPagestringFederal Register start and end page (documents).
topicsarraySubject topics (documents).
commentstringFull comment text (comments). Empty for file-only submissions.
submitterNamestringCommenter name when given (comments).
organizationstringSubmitting organization (comments).
submitterCategorystringSubmitter category (comments).
receiveDatestringDate the agency received the comment (comments).
trackingNbrstringComment tracking number (comments).
countrystringSubmitter country when given (comments).
stateProvinceRegionstringSubmitter state or region when given (comments).
shortTitlestringDocket short title (dockets).
rinstringRegulation Identifier Number (dockets).
keywordsarrayDocket keywords (dockets).

FAQ

How do I scrape regulations.gov?

Regulations.gov Crawler hits the official v4 REST API. Pick a dataType (documents, dockets, or comments), add filters, and run it. No browser, no HTML parsing.

Do I need an API key?

Regulations.gov Crawler works without one, but not very well. The shared DEMO_KEY is rate-limited to 10 requests per hour across all users of the API. Get a free key at open.gsa.gov/api/regulationsgov — it takes about a minute and bumps your quota to 1,000 requests per hour.

How much data can I pull in one run?

Regulations.gov Crawler is capped at 5,000 records per query by the API itself (20 pages × 250 records). For larger datasets, narrow your filters — by agency, date range, or docket — and run the actor multiple times. The date range filters are especially useful for slicing large agencies into monthly windows.

Can I get the full text of public comments?

Yes. Set dataType to comments and turn on enrichDetails: each comment then carries its full text, submitter name, organization, category and attachment links. Each enriched record is billed as one extra result, so leave it off when titles and dates are enough.

How do I download all EPA (or FAA, SEC, FDA) rules by agency?

Set agencyId to the agency acronym — EPA, FAA, SEC, FDA, FCC, NRC, DOT, and so on — and leave the other filters open. The actor returns every matching document, docket, or comment for that agency, each carrying its frDocNum so you can cross-reference the Federal Register entry. Pair it with postedDateFrom/postedDateTo to slice large agencies into date windows.

How much does it cost to run?

Regulations.gov Crawler uses the standard PPE pricing model: $0.10 per run start plus $0.001 per record. A 500-record pull costs about $0.60. A full 5,000-record run is $5.10.


Need More Features?

Need a different endpoint or a field that is not listed here? File an issue or get in touch.

Why Use Regulations.gov Crawler?

  • Covers all three endpoints — Documents, dockets, and comments in one actor. Other regulations.gov scrapers on the Apify store pick one and stop there.
  • Uses the official API — Structured JSON, stable schemas, no HTML parsing brittleness, no surprise 500s from the rendered site.
  • Bring your own key — The actor supports your own api.data.gov key so you can run it at full throughput without sharing a quota with strangers.