Pricing

Pay per event

Try for free

Go to Apify Store

CKAN Open Data Portal Scraper

Try for free

Query any CKAN open-data portal's Action API -- data.gov.uk, open.canada.ca, data.gov, the EU portal, and national/city catalogues. Give us a portal URL plus package_search, package_show, or organization_list and we page results, retry on throttling, and skip not-found errors so the run keeps going.

Pricing

Pay per event

Rating

0.0

(0)

Developer

DevilScrapes

Actor stats

Bookmarked

Total users

Monthly active users

12 hours ago

Last modified

Categories

Developer tools

You can access the CKAN Open Data Portal Scraper programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "requests": [
10        {
11            "portal_url": "https://data.gov.uk",
12            "action": "package_search",
13            "rows": 5,
14            "max_items": 5,
15            "label": "data.gov.uk sample search",
16        },
17        {
18            "portal_url": "https://open.canada.ca/data",
19            "action": "package_search",
20            "rows": 5,
21            "max_items": 5,
22            "label": "open.canada.ca sample search",
23        },
24    ],
25    "proxy_configuration": { "useApifyProxy": True },
26}
27
28# Run the Actor and wait for it to finish
29run = client.actor("devilscrapes/ckan-open-data-portal-scraper").call(run_input=run_input)
30
31# Fetch and print Actor results from the run's dataset (if there are any)
32print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
33for item in client.dataset(run.default_dataset_id).iterate_items():
34    print(item)
35
36# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

CKAN Open Data Portal Scraper -- Any Portal API in Python

The Apify API client for Python is the official library that allows you to use CKAN Open Data Portal Scraper API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

CKAN Open Data Portal Scraper API in JavaScript

CKAN Open Data Portal Scraper API through CLI

CKAN Open Data Portal Scraper OpenAPI definition

CKAN Open Data Portal Scraper API

GovData Germany Scraper - CKAN Open Data Portal

parseforge/govdata-germany-scraper

Scrape Germany's national open data portal: 156,000+ Datensätze with full DCAT-AP.de metadata, distributions, publishers, EU data themes, High-Value Dataset flags, licences and live link checks.

ParseForge

data.gov.uk Datasets Scraper

parseforge/data-gov-uk-scraper

Scrapes dataset listings from data.gov.uk by search query, topic, publisher, or format. Returns each dataset as a flat row with title, description, publisher, licence, and file URLs.

ParseForge

5.0

(1)

US Building Permits Scraper - Construction Leads, 13 Cities

burn98/building-permits-scraper

Fresh building permits from official city open-data APIs: Chicago, NYC, LA, Austin, Seattle, SF, Philadelphia, Boston + more. Normalized permit type, status, address, valuation and contractor name. Construction leads, pay per result.

Michi Reinhoffer

Socrata Open Data API Scraper

devilscrapes/socrata-open-data-scraper

Pull raw records from any Socrata Open Data (SODA) portal -- NYC, Chicago, and hundreds more US city, county, and state portals. Give us portal domains and dataset IDs; we page through results and retry on throttling, returning typed rows for 311 complaints, crime data, inspections, or any dataset.

DevilScrapes

CKAN Open Data Exporter: Government Datasets & Files

doggo/ckan-opendata-exporter

Search and export open data from any CKAN portal: data.gov, data.gov.uk, the EU Data Portal and thousands of government catalogs. Find datasets by keyword and export metadata, file download links and data rows. No API key. CSV, JSON, Excel.

Doggo

Building Permits Scraper - National Permit Aggregator

jungle_synthesizer/building-permits-national-aggregator

Aggregate building permits across 30+ US metros via city open-data portals. Normalized schema: permit type, valuation, geocoded address, contractor, owner. Built for construction leads, contractor sales, PropTech, and insurance workflows.

BowTiedRaccoon

uData Portal Extractor (data.gouv.fr & Etalab)

datamule/udata-portal-extractor

Point at ANY uData open-data portal (data.gouv.fr, data.public.lu, ~30 Etalab govs) and extract datasets, organizations, or community reuses via the uniform /api/1/ REST API. Nested resources, facet filters (q/tag/org/license), server-driven pagination.

Datamule

Building Permits Scraper: 12 Cities, Contractor Leads

themineworks/building-permits-construction-leads

Building permits from 12 US and Canadian city open data portals in ONE schema: contractor name, phone, licence, owner, valuation and a derived project class (solar, roofing, HVAC, new build). Plus a contractor rollup. No API key, no proxy.

The Mine Works

Japan Tokyo Open Data Catalog (CKAN API)

jpopendata/japan-tokyo-opendata

Unofficial client for the Tokyo Metropolitan Government Open Data Catalog (CKAN API v3, no key). Search datasets by keyword/publisher/category, or download a dataset's CSV records as structured JSON (Shift_JIS aware). CC BY 4.0.

JP Open Data

Colorado & Oregon Business Leads

harbinger/new-business-leads-scraper

Scrape new LLC, Corp & LP filings from Colorado & Oregon open-data APIs. Fresh B2B leads daily — names, addresses, registered agents, filing dates. No proxies needed. Perfect for insurance agents, accountants, marketers, and sales teams.

Julian

US Diverse Supplier Leads Scraper - MBE, WBE, DBE & Veteran

scrapesage/us-diverse-supplier-leads-scraper

Scrape official state & city supplier-diversity directories for certified MBE, WBE, DBE, SBE, Veteran-Owned & Service-Disabled-Veteran-Owned businesses. Company, contact name, phone, email, website, NAICS/NIGP codes, certification type & expiry, lead score. Filters + monitoring, keyless, no browser.