Pricing

from $9.99 / 1,000 results

GOV.UK Search & Content Scraper

Scrape GOV.UK search results and page content via the official APIs. Search by keywords or URLs, filter by organisation, and extract metadata, publication dates, links, and full page text with automatic pagination.

Pricing

from $9.99 / 1,000 results

Rating

0.0

(0)

Developer

Jamshaid Arif

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Example input

{
  "queries": [
    "insolvency rules",
    "https://www.gov.uk/government/organisations/companies-house",
    "/vat-rates"
  ],
  "maxResultsPerSearch": 100,
  "order": "newest",
  "organisation": "hm-revenue-customs",
  "fetchContentForResults": true,
  "maxBodyChars": 20000
}

Pagination — up to 1000 results per search query, fetched in pages of 100 automatically.
order — relevance (default), newest, oldest.
organisation — restrict to one publisher by slug (companies-house, home-office, ...).
fetchContentForResults — enrich every search hit with its full Content API record (body text, dates, links, organisations); one extra request per hit, deduplicated.

Output items

search_result: title, path/url, description, format, organisations, public_timestamp, popularity, search_query.

content: title, description, document_type, schema_name, locale, first_published_at, public_updated_at, organisations, extracted body_text (handles plain bodies, multi-format bodies, and multi-part guides; truncated to maxBodyChars, 0 = unlimited), and a links map of related base paths (parent, children, taxons...).

Search totals and per-query errors are saved under key SUMMARY.

GOV.UK Content Search Scraper

parseforge/govuk-content-search-scraper

Scrape GOV.UK: search the entire UK government publications catalogue (policies, guidance, news, statistics). Filter by query, organisation, format or date. Returns titles, descriptions, URLs, organisations and publication dates.

ParseForge

GOV UK Companies Register

harvestedge/gov-uk-companies-register

The UK Companies Scraper for UK Chamber of Commerce. Ideal for lead generation, compliance checks, KYC enrichment, and UK company intelligence workflows. GOV.UK

Harvest Edge

Data.gov.uk Scraper

parseforge/data-gov-uk-scraper

Collect UK government open data effortlessly. Extract datasets, publishers, formats, topics, licenses, and download links from data.gov.uk — the official UK open data portal. Perfect for researchers, policy analysts, and developers building data catalogs.

ParseForge

5.0

Data.gov Dataset Search

ryanclinton/datagov-dataset-search

Search and extract metadata from 300,000+ datasets in the official United States government open data catalog at [Data.gov](https://catalog.data.gov/).

Ryan Clinton

Legislation.gov.uk Scraper

crawlerbros/legislation-gov-uk-scraper

Scrape UK statute law from legislation.gov.uk. Fetch specific Acts and Statutory Instruments, browse by type and year, get the newest legislation, or search by title. Returns clean metadata plus official XML/PDF links.

Crawler Bros

PDF Text Extractor

automation-lab/pdf-text-extractor

Extract text, metadata, and page-by-page content from PDF files. Provide PDF URLs and get structured JSON with full text, per-page text, page count, author, title, creation date, and more. Export as JSON, CSV, or Excel. No browser or proxy needed.

Stas Persiianenko

204

Data.gov.uk Scraper - Low-cost💲🔥📚🇬🇧

delectable_incubator/data-gov-uk-scraper-low-cost

Scrape data.gov.uk dataset listings 🔎📊 with a powerful open data scraper. Extract dataset titles, publishers, update dates, descriptions, tags, and dataset URLs from search results. Ideal for government data monitoring, open data research, dataset discovery, and structured data catalog creation 🚀

Prime Scrape

UK Data.gov Datasets Scraper - Open Data Catalog

benthepythondev/uk-data-gov-datasets-scraper

Search the UK government open-data catalogue and export dataset titles, publishers, licenses, dates, notes, tags and resources.

Ben

Regulations.gov Comments — Full-Text Extractor

bikram07/regulations-gov-comments

Extract the FULL TEXT of public comments on US federal rulemaking dockets from Regulations.gov — not just metadata. Get who is arguing for or against a rule, in their own words. Filter by docket, search term, or date. Zero-config returns recent comments with body text. Official US gov API.

Bikram

PDF Text Extractor — Text & Metadata from URLs

darknezz/pdf-text-extractor

Extract clean text and metadata from any PDF by URL: full text, page count, title, author, dates as JSON. Perfect for AI pipelines, RAG ingestion, document search and content analysis. No API key needed.