UK ONS Statistics Scraper: Datasets and Observations

Extract structured statistical datasets from the Office for National Statistics catalogue. Easily gather dataset lists, descriptions, contact information, and version details. Export your clean results directly to JSON, CSV, or Excel on Apify.

---

Key Features & Use Cases

• Catalogue Archiving: Save dataset titles, topics, keywords, and release notes for ongoing research and data archives.
• Price Index & Metric Lookup: Fetch CPIH or other key dataset descriptions, contact info, and current version details.
• Scheduled Data Syncs: Set your run on a timer to track ongoing updates and identify fresh releases.
• Version Tracking: Keep track of updated dataset version identifiers as new publications drop.
• Metadata & Licence Review: Keep licence strings, methodologies, and source links conveniently organised alongside dataset items.

---

What Data Does This Actor Extract?

Each processed item yields a clean document record. Key extracted attributes include:

• datasetTitle & datasetDescription: Formatted text fields for clear organization.
• id: Unique identifier for each dataset.
• contacts: Official department contact details (names, emails, telephone lines).
• keywords: Related thematic tags.
• last_updated: Timestamp of the latest publication refresh.
• next_release & release_frequency: Details on publication schedules.
• national_statistic: Indicates official statistical designation.
• edition & versionId: Version details attached to the record.
• scrapedAt: Timestamp recording when the row was saved.

---

Input Options

Parameter	Type	Default	Description
mode	String	datasets	Options: datasets (list datasets) or versions (check version details).
datasetId	String	""	Target dataset identifier (e.g., cpih01). Leave empty to list the catalogue.
edition	String	"time-series"	Targeted edition variant inside version details.
version	String	"latest"	Target version label (latest or exact version number).
maxItems	Integer	100	Maximum rows to collect (capped at 1000).
requestDelaySecs	Number	0.75	Pause between outgoing queries (0.5 to 1.0 second).
timeoutSecs	Integer	300	Total run time limit in seconds.
requestTimeoutSecs	Integer	30	Per-request timeout limit in seconds.
proxyConfiguration	Object	{ "useApifyProxy": false }	Optional proxy settings object.

Input Examples

Catalogues Scan:

{
    "mode": "datasets",
    "datasetId": "",
    "edition": "time-series",
    "version": "latest",
    "maxItems": 100,
    "requestDelaySecs": 0.75,
    "timeoutSecs": 300,
    "requestTimeoutSecs": 30,
    "proxyConfiguration": { "useApifyProxy": false }
}

Single Dataset Detail:

{
    "mode": "versions",
    "datasetId": "cpih01",
    "edition": "time-series",
    "version": "latest",
    "maxItems": 1
}

---

Output Example

{
    "contacts": [
        {
            "email": "qualityoflife@ons.gov.uk",
            "name": "Will Shufflebottom, Owain Birrell, Pavan Bains and Geeta Kerai",
            "telephone": "+44 300 0671543"
        }
    ],
    "datasetDescription": "Seasonally and non seasonally-adjusted quarterly estimates of life satisfaction.",
    "keywords": ["well-being"],
    "id": "wellbeing-quarterly",
    "last_updated": "2023-12-13T09:40:24.204Z",
    "national_statistic": false,
    "next_release": "TBC",
    "release_frequency": "Quarterly",
    "state": "published",
    "datasetTitle": "Quarterly personal well-being estimates",
    "edition": "time-series",
    "versionId": "9",
    "mode": "datasets",
    "scrapedAt": "2026-10-12T00:00:00Z"
}

---

How It Works

1. Parses your configuration, setting your row limits and request delays.
2. Formats and sends queries for either catalogue indexes or individual target items.
3. Formats incoming statistical records, drops duplicates, and safely handles missing items without breaking your batch run.
4. Concludes automatically when your item target, timeout limit, or dataset end is reached.

---

FAQ

Can this actor download raw observation values directly?

No. It focuses on dataset catalogue records, descriptions, metadata, and version references.

What happens if I pass an invalid dataset ID?

An error record is logged with status details so your workflow continues smoothly without crashing.

Why did my run return zero rows?

An empty catalogue response saves zero rows and writes an explicit confirmation note in the log.

---

Trademark Notice

UK ONS Statistics and related names, logos, and marks belong to their respective owners. Mentioning them here serves purely to describe the dataset content and implies no endorsement, partnership, or direct association.

---

Is web scraping legal?

This tool collects publicly accessible information. When storing or processing dataset results, keep the following guidelines in mind:

• Personal Data: Some statistical entries list departmental contact names, phone numbers, or email addresses. Please comply with relevant data handling guidelines (such as GDPR or local regulations) if processing or resharing these details.
• Copyright & Terms: Ensure you adhere to Open Government Licence guidelines and respect attribution requirements when using third-party content.
• General Disclaimer: This documentation provides factual overview information rather than formal legal advice.