Opendatasoft Portals Scraper avatar

Opendatasoft Portals Scraper

Pricing

Pay per usage

Go to Apify Store
Opendatasoft Portals Scraper

Opendatasoft Portals Scraper

Opendatasoft Portal Scraper pulls public rows from any Explore Data portal like Paris, Toulouse, or Infogreffe. Pick a dataset, add an optional ODSQL filter, and export clean JSON, CSV, or Excel. Records and catalog modes, with paging, dedupe, retries, and scheduling to keep your data fresh.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

BigiByte

BigiByte

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Categories

Share

Opendatasoft Portal Scraper: Any ODS Portal

USA Automotive Leads Hub

This scraper exports public rows and catalog details from municipal and business open data portals like Paris, Toulouse, and Infogreffe. Just point it at a portal, pick a dataset, and optionally add a filter clause. You'll get a clean dataset ready to download as JSON, CSV, or Excel.


What This Actor Extracts

  • Records Mode: Saves one row per dataset record while keeping all original field names intact. On transit feeds, for example, this includes station codes, names, dock and bike counts, status flags, coordinates, and commune details. Longitude and latitude are also neatly flattened out for easy mapping.
  • Catalog Mode: Saves one row per dataset available on the portal, giving you the slug, title, summary, license, keywords, and a complete list of field names.

Every exported row includes a timestamp (scrapedAt) and a source reference (sourceUrl). If a row can't be produced, it's logged as a clean error row with a short message, so the rest of the run continues smoothly without crashing.


Use Cases

  • Schedule regular exports of real-time availability feeds or municipal datasets.
  • Explore every dataset on a portal, along with its license and field names, before deciding what to download.
  • Apply custom filter clauses to keep only the records that match your criteria.
  • Quickly grab a few hundred public rows for a data science notebook without any setup overhead.
  • Rerun the same inputs over time to compare changes and track updates.

Input Parameters

ParameterTypeDefaultDescription
modestringrecordsChoose records to export a specific dataset, or catalog to list datasets available on the portal.
portalUrlstringhttps://opendata.paris.frBase web address of the target public data portal.
datasetIdstringvelib-disponibilite-en-temps-reelDataset slug to target when running in records mode.
wherestringemptyOptional filter clause used exclusively in records mode.
maxItemsinteger100Row cap for the run (hard maximum of 1,000 items).
timeoutSecsinteger300Stop the run after this many seconds.
requestTimeoutSecsinteger30How long to wait before timing out.
proxyConfigurationobject{"useApifyProxy": false}Optional proxy settings. Leave it turned off unless you have a specific routing need.

Example Input

{
"mode": "records",
"portalUrl": "https://opendata.paris.fr",
"datasetId": "velib-disponibilite-en-temps-reel",
"where": "",
"maxItems": 100,
"timeoutSecs": 300,
"requestTimeoutSecs": 30,
"proxyConfiguration": { "useApifyProxy": false }
}

Output Example

A sample record export looks like this:

{
"stationcode": "40001",
"name": "Hôpital Mondor",
"is_installed": "OUI",
"capacity": 28,
"numdocksavailable": 23,
"numbikesavailable": 5,
"mechanical": 0,
"ebike": 5,
"is_renting": "OUI",
"is_returning": "OUI",
"duedate": "2026-10-11T20:32:26+00:00",
"coordonnees_geo": { "lon": 2.4537451531298, "lat": 48.798922410229 },
"longitude": 2.4537451531298,
"latitude": 48.798922410229,
"nom_arrondissement_communes": "Créteil",
"code_insee_commune": "94028",
"scrapedAt": "2026-10-12T00:00:00+00:00",
"sourceUrl": "https://opendata.paris.fr/explore/dataset/velib-disponibilite-en-temps-reel/"
}

If you plan to map or join these rows, a geocoding pass or a quick CSV cleanup are the usual next steps. BigiByte also builds scrapers for other open-data portals when you need them as a separate job.

Need another city's open data, a scheduled monitor, or a custom pipeline? BigiByte builds custom scrapers and data pipelines: https://bigibyte.com


Trademark Notice & Disclaimer

Portals and related names, logos, and trademarks belong to their respective owners. Their mention here is solely for identification purposes and does not imply affiliation, sponsorship, endorsement, or partnership.

This actor is an independent tool designed to collect publicly available information. Users are fully responsible for complying with the source's terms of use, any usage restrictions, and attribution or licensing requirements.

This Actor only collects publicly available data from Opendatasoft Portals without bypassing any access controls. Scraping public data is generally legal, but how you use it matters:

  • Personal data: If the results include personal data (for example names, emails, or profile details), laws such as the GDPR in the EU and the CCPA in California may apply. Only collect and store personal data when you have a legitimate reason.
  • Copyright: Some content (articles, images, descriptions) may be protected by copyright. Do not republish full copyrighted content without permission.
  • Terms of use: Respect the source's terms, any usage restrictions, and any attribution or non-commercial-use requirements.
  • Legal advice: This is general information, not legal advice. If you're unsure, consult a lawyer.

To learn more, read Apify's guide: Is web scraping legal?