Pricing

from $15.00 / 1,000 result items

Australia Open Data (data.gov.au) Scraper

Export Australian government open datasets from data.gov.au. Browse 70k+ datasets across federal, state, and territory agencies. Pull dataset metadata, resources, organization, license, tags, and update frequency. Catalog mode lists all; dataset mode fetches one by ID.

Pricing

from $15.00 / 1,000 result items

Rating

0.0

(0)

Developer

ParseForge

Actor stats

Bookmarked

Total users

Monthly active users

2 hours ago

Last modified

🦘 Australia Open Data (data.gov.au) Scraper

🚀 Export the Australian open data catalog in seconds. Pull 70,000+ datasets spanning federal, state, and territory agencies, including AEMO power market data, transport feeds, environmental records, and census tables. No API key, no manual CSV stitching, no portal click-through.

The Australia Open Data Scraper taps the official data.gov.au catalog and returns 13 structured fields per dataset, including title, description, organization, license, resource files (CSV, GeoJSON, XLSX, ZIP, NetCDF), tags, and creation/modification timestamps. The portal aggregates publications from the Australian Bureau of Statistics, Australian Energy Market Operator, Bureau of Meteorology, Geoscience Australia, Department of Climate Change, and every state and territory government.

The catalog covers federal datasets, all eight states and territories, and major statutory authorities, with consistent licensing fields and downloadable resources. This Actor turns it into a clean dataset downloadable as CSV, Excel, JSON, or XML in under a minute. Filters and pagination run server-side, so you skip the parser engineering entirely.

🎯 Target Audience	💡 Primary Use Cases
ANZ researchers, fintech analysts, climate scientists, civic-tech builders, GIS engineers, journalists, NGOs	Open-data discovery, energy market analysis, climate research, regional dataset inventory, license auditing, ML training data

📋 What the Australia Open Data Scraper does

Two collection workflows in a single run:

🦘 Catalog walk. Paginate the full Australian dataset registry, optionally filtered by a search query.
🎯 Single dataset fetch. Retrieve one dataset by UUID or slug for targeted enrichment.
📁 Resource expansion. Every dataset includes its file resources with name, format, URL, language, size, and last-modified timestamp.
🏷️ Tag merge. All publication keywords consolidated into one clean list.
🏛️ Organization attribution. Publishing department, state agency, or statutory authority captured for every record.

Each record includes identifiers (UUID, slug), descriptive metadata (title, notes, tags), governance (organization, license, frequency), and a full list of downloadable resources.

💡 Why it matters: Australia's open data portal pools data from every level of government, but the portal UI is built for browsing one dataset at a time. This Actor turns it into a single downloadable spreadsheet so you can audit license terms, sort by recency, or build a research inventory in minutes.

📊 Data fields

Each record includes: frequency, id, license, metadataCreated, metadataModified, name, notes, organization, portalUrl, resources, resourcesCount, scrapedAt, tags, title. These field names come straight from the actor's dataset schema, so what you see here is what lands in your dataset.

🚀 How to use

📝 Sign up. Create a free account with $5 credit (takes 2 minutes).
🌐 Open the Actor. Go to the Australia Open Data Scraper page on the Apify Store.
🎯 Set input. Pick catalog mode for a full walk or dataset mode with an ID, plus maxItems.
🚀 Run it. Click Start and let the Actor collect your data.
📥 Download. Grab your results in the Dataset tab as CSV, Excel, JSON, or XML.

⏱️ Total time from signup to downloaded dataset: 3-5 minutes. No coding required.

🔗 Recommended Actors

🍁 Canada Open Data Scraper - Canadian federal open dataset catalog
🏢 ABR Australian Business Register Scraper - 7M+ Australian business records
📈 Indexmundi Scraper - Global demographic and economic indicators
🗺️ Nominatim OSM Scraper - Geocode addresses via OpenStreetMap
✈️ OurAirports Scraper - Global airport, heliport, and airfield dataset

💡 Pro Tip: browse the complete ParseForge collection for more reference-data scrapers.

⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by data.gov.au, the Australian Government, or any state or territory agency. All trademarks mentioned are the property of their respective owners. Only publicly available open government data is collected.

🆘 Need Help?

If you hit a bug, have questions about setup, or need a scraper we haven't built yet, open our contact form or write to parseforge@protonmail.com. We also take on paid custom data projects.

For faster answers, join our Discord. It's the best place to get support and suggest new actors.

Canada Open Data Catalog Scraper

parseforge/canada-open-data-scraper

Export Canadian government open datasets from open.canada.ca. Browse 36k+ datasets across federal departments. Pull dataset metadata, resources, organization, license, tags, and publication dates. Catalog mode lists all datasets; dataset mode fetches one by ID.

ParseForge

Data.gov.uk Scraper - Low-cost💲🔥📚🇬🇧

delectable_incubator/data-gov-uk-scraper-low-cost

Scrape data.gov.uk dataset listings 🔎📊 with a powerful open data scraper. Extract dataset titles, publishers, update dates, descriptions, tags, and dataset URLs from search results. Ideal for government data monitoring, open data research, dataset discovery, and structured data catalog creation 🚀

Prime Scrape

Data.gov Catalog Scraper

crawlergang/data-gov-catalog-scraper

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Crawler Gang

5.0

Data.gov Catalog Scraper

crawlerbros/data-gov-catalog-scraper

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Crawler Bros

Data.gov Dataset Search

ryanclinton/datagov-dataset-search

Search and extract metadata from 300,000+ datasets in the official United States government open data catalog at [Data.gov](https://catalog.data.gov/).

Ryan Clinton

Data.gov API - US Open Government Datasets

alizarin_refrigerator-owner/data-gov-api---us-open-government-datasets

Access the Data.gov catalog of 300,000+ US government datasets. Search datasets by topic, agency, format, and keywords. Discover open data from federal, state, and local governments

The Howlers

Australia Open Data Scraper - Government Datasets

benthepythondev/australia-open-data-scraper

Search Australia's government data catalogue and export dataset titles, publishers, licenses, dates, tags and resources.

Ben

Data Gov Catalog Scraper

fortuitous_pirate/data-gov-catalog-scraper

Search, filter, and download metadata for 300,000+ federal open datasets from Data.gov. Filter by agency (NASA, EPA, NOAA), format (CSV, JSON, API), tags, and topics. Returns dataset details, resource links, and organization info.

Fortuitous Pirate

Data.gov.uk Scraper - Cheap 🌐📊🇬🇧

scrapestorm/data-gov-uk-scraper---cheap

🔎 Easily collect dataset listings from data.gov.uk Provide one or multiple search URLs and extract dataset information such as 📄 Dataset Title 🏢 Published By 🕒 Last Updated 📝 Description 🔗 Dataset URL & more Perfect for open data research, government data monitoring & dataset discovery 📊🚀

Storm_Scraper

5.0

Hong Kong Open Data Scraper

parseforge/data-gov-hk-hong-kong-scraper

Export datasets from data.gov.hk, the Hong Kong government open data portal. Browse the full catalog or fetch specific datasets. Pull titles, organizations, descriptions, tags, update frequency, resource files, formats, licences, and direct download links.

ParseForge