GovData Germany Scraper - CKAN Open Data Portal
Pricing
Pay per event
Scrape Germany's national open data portal: 156,000+ Datensätze with full DCAT-AP.de metadata, distributions, publishers, EU data themes, High-Value Dataset flags, licences and live link checks.
This Actor's pricing details are outlined in the table below. Visit our pricing page to compare plans and see how much you can save.
Pricing | |||
|---|---|---|---|
| Catalogue page scanned One page of up to 500 datasets read from the GovData catalogue index, or one directory call. This is the fixed cost of paging, spread across every row that page yields. | $4.00 / 1,000 | ||
| Dataset One dataset with its full DCAT-AP.de record: title, description, publisher and contact point, EU themes, keywords, licences, temporal and spatial coverage with bounding box and centroid, update frequency, High-Value Dataset flag, regional keys and every distribution nested with its own metadata. | $7.00 / 1,000 | ||
| Distribution One file or service — its URL, normalised format, MIME type, byte size, checksum, licence and dates — carrying the identity, publisher, themes and keywords of the dataset it belongs to. | $5.00 / 1,000 | ||
| Contact point One deduplicated publishing body or contact person: name, email, phone, postal address, its organization and source portal, how many of the scanned datasets it is responsible for and which themes they cover. | $6.00 / 1,000 | ||
| Organization One of the publishing organizations on the portal, with its total dataset count, how many match the filters on this run, its creation date and its page on GovData. | $10.00 / 1,000 | ||
| Category One EU data theme with its German and English titles, its data-theme URI, and dataset counts both catalogue-wide and within the current query. | $10.00 / 1,000 | ||
| Tag One keyword from the catalogue vocabulary with the number of datasets carrying it, ranked, and honouring whatever filters the run set. | $3.00 / 1,000 | ||
| Format One distribution format with its dataset count, whether it is machine-readable or a service, and every raw spelling the catalogue uses for it with each variant's own count. | $3.00 / 1,000 | ||
| Licence One licence from the registered vocabulary with its title, URL, Open Definition and Open Source conformance, and how many datasets declare it at package level. | $5.00 / 1,000 | ||
| Distribution link checked Optional. One distribution URL fetched to see whether it is actually alive: HTTP status, content type, byte size, redirect target and latency. GovData harvests metadata and never re-verifies links — 5.3% of a spread sample were dead 404s. | $6.00 / 1,000 | ||
| Distribution columns previewed Optional. The first 64 KB of a CSV, TSV, JSON, GeoJSON or XML distribution read with a range request, returning its real column names, delimiter, character encoding and a sample row. Not charged for formats that are skipped without a request. | $15.00 / 1,000 | ||
| Organization profiled Optional. One extra query per organization returning what it actually publishes: its EU themes, its top distribution formats and its top keywords, each with counts. | $12.00 / 1,000 | ||
| Actor StartInfrequent Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event). | $0.054 | ||
Additional costs | |||
Platform usageIncluded Platform usage costs are tied to the Actor's performance in terms of the underlying platform resources it consumes. Learn more | Free | ||
