Scrape all 22,666 datasets from Ireland's open data portal data.gov.ie: full DCAT metadata, distributions, 174 publishers, EU high-value flags, openness scores and DataStore column schemas.
This Actor's pricing details are outlined in the table below. The unit prices you pay depend on your subscription plan, with higher tiers offering better rates. Visit our pricing page to compare plans and see how much you can save.
Pricing
Free
No discount
Business
Gold discount
Dataset
One Irish open dataset with its full portal record: title and Irish title, description, publishing body with its own description, DCAT theme, tags, licence id with a plain-English label and an Open Definition check, EU high-value flag with its regulation category and applicable legislation, declared update frequency, version, standard it conforms to, provenance, issue, portal-registration and last-change dates, temporal coverage, spatial coverage with bounding box, coordinate systems and vertical extent, contact point, harvest collection and source, and every file summarised with its formats, total size and how many are loaded into the portal DataStore.
$7.00
/ 1,000
$6.23
/ 1,000
Portal page scanned
One page of up to 200 datasets read from the data.gov.ie CKAN index. This is the fixed cost of paging through the portal, spread across every row that page yields.
$7.00
/ 1,000
$6.23
/ 1,000
File
One downloadable file or service: its direct download URL, normalised and raw format, MIME type, byte size, checksum, whether it is machine readable, whether it is loaded into the portal DataStore, its locator protocol, and the identity, publisher and theme of the dataset it belongs to.
$4.00
/ 1,000
$3.56
/ 1,000
Publisher
One of the 174 publishing bodies on the portal, with its acronym, full description, logo, how many datasets it publishes, its follower count and the date it joined.
$4.00
/ 1,000
$3.56
/ 1,000
Harvest source
One of the 31 upstream feeds data.gov.ie harvests, with its URL, harvester type, collection name, default licence and language, schedule, next scheduled run, last harvest request and job count.
$4.00
/ 1,000
$3.56
/ 1,000
Showcase
One of the portal showcases: an application, map or story built on Irish open data, with its description, external URL, author and tags.
$4.00
/ 1,000
$3.56
/ 1,000
Data request
One public data request, what a citizen or company asked a public body to publish, with the body it targets, the intended use, the vote count, whether it was closed and which dataset was accepted in answer.
$4.00
/ 1,000
$3.56
/ 1,000
Portal change
One recent change to a dataset on the portal, with its timestamp, the change type and the dataset it touched. This is the feed to poll for what moved since your last run.
$2.00
/ 1,000
$1.78
/ 1,000
Theme
One of the 14 portal themes with its plain-English label and its live dataset count under whatever filters the run set.
$2.00
/ 1,000
$1.78
/ 1,000
EU high-value category
One of the six high-value dataset categories from Implementing Regulation (EU) 2023/138, with its EU URI and how many Irish datasets fall under it.
$2.00
/ 1,000
$1.78
/ 1,000
Licence
One licence id the portal uses, with a plain-English label, an Open Definition check and its live dataset count. The portal marks 732 CC-BY-4.0 datasets as not open, and this row is where that shows up.
$2.00
/ 1,000
$1.78
/ 1,000
Update frequency
One declared update frequency with a plain-English label and its live dataset count, so you can see how much of the portal is actually maintained.
$2.00
/ 1,000
$1.78
/ 1,000
Harvest collection
One of the 27 harvest collections with its live dataset count, showing how much of the national portal each contributing feed accounts for.
$2.00
/ 1,000
$1.78
/ 1,000
Format
One file-format spelling with its canonical name, whether it is machine readable, and its dataset count. The portal uses 132 spellings for about 30 real formats and the index is case sensitive, so the raw spellings matter.
$2.00
/ 1,000
$1.78
/ 1,000
Tag
One keyword from the portal vocabulary of 22,742 tags with the number of datasets carrying it, ranked, honouring whatever filters the run set.
$1.00
/ 1,000
$0.89
/ 1,000
Openness score attached
Optional. The portal's own 0 to 5 star openness rating for a dataset plus the reason it was given, fetched from the record view that carries it. Not charged when the portal returned no rating.
$3.00
/ 1,000
$2.67
/ 1,000
DataStore table read
Optional. One file that is loaded into the portal DataStore queried for its real column names, per-column SQL types, true row count and a sample of rows. Nothing in the harvested metadata carries this. Not charged when the table could not be read.
$5.00
/ 1,000
$4.45
/ 1,000
File link checked
Optional. One file URL fetched from the publisher's own server to see whether it is actually alive: HTTP status, redirect target, content type and byte size. The portal harvests 31 external feeds and never revalidates the links.
$3.00
/ 1,000
$2.67
/ 1,000
Publisher profile attached
Optional. The publishing body's acronym, description, logo, dataset count and follower count added to a dataset row. Each publisher is fetched once per run and reused across every dataset it published.
$3.00
/ 1,000
$2.67
/ 1,000
Actor StartInfrequent
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.02
$0.0178
Additional costs
Platform usageIncluded
Platform usage costs are tied to the Actor's performance in terms of the underlying platform resources it consumes. Learn more