# data.gouv.fr Scraper (`crawlerbros/datagouvfr-scraper`) Actor Scrape the French government open-data portal (data.gouv.fr). Search datasets by keyword, fetch full dataset details by ID/slug, list datasets by organization, and search organizations and reuses - with titles, descriptions, resources/formats, licenses, temporal coverage and metrics. - **URL**: https://apify.com/crawlerbros/datagouvfr-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Automation, Developer tools, Integrations - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## data.gouv.fr Scraper Scrape **data.gouv.fr**, the official French government open-data portal — no account, no API key, no cookies. Search tens of thousands of public datasets, pull full dataset metadata, browse everything an organization publishes, and discover the reuses (apps, APIs, visualizations, articles) built on top of French public data. Fast, structured JSON straight from the public data.gouv.fr API. Ideal for **open-data research, data journalism, civic tech, competitive analysis, dataset discovery, and building data catalogs**. ### What this actor does - **Five modes:** `searchDatasets`, `datasetDetails`, `byOrganization`, `searchOrganizations`, `searchReuses` - **Flexible lookup:** search by keyword, fetch by dataset ID / slug / full URL, or list every dataset of an organization - **Reuse discovery:** find apps, APIs, visualizations and articles, filterable by topic and type - **Rich metadata:** resources & file formats, licenses, temporal coverage, tags, and engagement metrics (views, reuses, followers, downloads) - **Automatic pagination** with cross-page de-duplication, so a request for N records returns N unique records - **Empty fields are omitted** — you never get `null`s ### Output per record Every record is a flat JSON object. `recordType`, `id`, `url`, `sourceUrl` and `scrapedAt` appear on every record. #### Dataset (`searchDatasets`, `datasetDetails`, `byOrganization`) - `id`, `title`, `slug`, `description` - `license`, `frequency`, `accessType` - `qualityScore` (0–1 metadata-quality score), `featured` (present when true), `badges[]` (e.g. `hvd`, `spd`) - `organization`, `organizationId`, `organizationUrl` - `temporalCoverageStart`, `temporalCoverageEnd`, `spatialGranularity`, `spatialZones[]` - `tags[]` - `createdAt`, `lastModified`, `lastUpdate` - `resourceCount`, `formats[]`, `resources[]` — each resource has `title`, `description`, `format`, `url`, `latestUrl`, `mime`, `type`, `fileType`, `filesize`, `checksum`, `createdAt`, `lastModified` - `views`, `followers`, `reuses`, `downloads` - `url` — portal page · `sourceUrl` — API endpoint - `recordType: "dataset"`, `scrapedAt` #### Organization (`searchOrganizations`) - `id`, `name`, `slug`, `acronym`, `description` - `businessNumberId` (SIREN), `badges[]` - `datasetsCount`, `reusesCount`, `dataservicesCount`, `followers`, `members`, `views` - `createdAt`, `lastModified` - `logoUrl`, `url`, `sourceUrl` - `recordType: "organization"`, `scrapedAt` #### Reuse (`searchReuses`) - `id`, `title`, `slug`, `description` - `type`, `topic` - `organization`, `organizationId` - `datasetsCount`, `tags[]` - `views`, `followers` - `createdAt`, `lastModified` - `imageUrl` — reuse cover image - `externalUrl` — link to the reuse itself · `url` — portal page · `sourceUrl` — API endpoint - `recordType: "reuse"`, `scrapedAt` #### Sample dataset record ```json { "recordType": "dataset", "id": "53ba5b91a3a729219b7beae9", "title": "Transport", "slug": "transport", "description": "Réseau de transport en commun …", "license": "cc-zero", "frequency": "unknown", "accessType": "open", "qualityScore": 0.444, "organization": "Mairie de Monacia d'Aullène", "organizationId": "5b9e...", "organizationUrl": "https://www.data.gouv.fr/organizations/...", "tags": ["transport", "mobilité"], "createdAt": "2014-07-07T09:00:00+00:00", "lastUpdate": "2014-09-02T15:44:46.643000+00:00", "resourceCount": 2, "formats": ["csv", "gtfs"], "resources": [ { "title": "Arrêts", "format": "csv", "url": "https://…/stops.csv", "latestUrl": "https://www.data.gouv.fr/api/1/datasets/r/…", "filesize": 102400, "checksum": "f0a7cc05…", "createdAt": "2014-07-07T10:34:25+00:00" } ], "views": 3993, "downloads": 488, "url": "https://www.data.gouv.fr/datasets/transport", "sourceUrl": "https://www.data.gouv.fr/api/1/datasets/transport/", "scrapedAt": "2026-07-02T13:25:30+00:00" } ```` ### Input | Field | Type | Default | Description | |---|---|---|---| | `mode` | string | `searchDatasets` | `searchDatasets` / `datasetDetails` / `byOrganization` / `searchOrganizations` / `searchReuses` | | `query` | string | `transport` | Free-text keyword for the search modes (leave empty to browse all) | | `datasetIds` | array | – | Dataset IDs, slugs or full URLs (mode=datasetDetails) | | `organization` | string | – | Organization slug, ID or full URL (mode=byOrganization) | | `topic` | string | – | Reuse topic filter (mode=searchReuses) | | `reuseType` | string | – | Reuse type filter: API, Application, Visualization, … (mode=searchReuses) | | `format` | string | – | Only datasets offering this file format (CSV, JSON, GeoJSON, …) (dataset modes) | | `license` | string | – | Only datasets under this license (CC-BY, ODbL, Licence Ouverte, …) (dataset modes) | | `badge` | string | – | Only datasets with a quality badge: HVD (High Value Dataset) or SPD (dataset modes) | | `tag` | string | – | Only datasets/reuses carrying this exact tag | | `featured` | boolean | `false` | Only editorially featured datasets/reuses | | `sort` | string | `-reuses` | Newest, recently updated, most reused, most followed, or most viewed | | `maxItems` | integer | `50` | Hard cap on emitted records (1–2000) | #### Example: search datasets by keyword ```json { "mode": "searchDatasets", "query": "transport", "sort": "-reuses", "maxItems": 50 } ``` #### Example: fetch specific datasets ```json { "mode": "datasetDetails", "datasetIds": ["transport", "base-sirene-des-entreprises-et-de-leurs-etablissements-siren-siret"] } ``` #### Example: every dataset from an organization ```json { "mode": "byOrganization", "organization": "institut-national-de-la-statistique-et-des-etudes-economiques-insee", "sort": "-last_modified", "maxItems": 100 } ``` #### Example: discover transport apps (reuses) ```json { "mode": "searchReuses", "topic": "transport_and_mobility", "reuseType": "application", "maxItems": 50 } ``` ### Use cases - **Data catalogs** — build a searchable catalog of French public datasets in a specific domain - **Organization monitoring** — track everything a ministry or agency publishes - **Format discovery** — find every dataset available as CSV, JSON, GeoJSON, … - **Civic tech** — discover apps and visualizations reusing transport, health, or environment data - **Freshness tracking** — monitor dataset update timestamps and coverage periods - **Data journalism** — surface newly published or most-reused open datasets ### FAQ **Do I need an API key or account?** No. The data.gouv.fr API is fully public and free. **Can I get every dataset from a specific ministry or agency?** Yes — use **Datasets by organization** mode with the organization's slug or ID (a full profile URL also works). **Can I filter datasets by file format?** Yes. Set the `format` input (e.g. `csv`, `json`, `geojson`, `gtfs`) to only return datasets that publish a resource in that format. You can further narrow results with `license`, `badge` (HVD / SPD), `tag` and `featured`. Every dataset record also lists its available `formats`. **What are reuses?** Reuses are the apps, APIs, visualizations and articles that people have built on top of datasets. Search them by keyword, topic and type. **Which sort options apply to which mode?** Datasets and organizations support all sort options. Reuses can be sorted by newest, recently updated, most followed or most viewed; "most reused" doesn't apply to reuses and falls back to the default relevance order. **Why do I sometimes get slightly fewer records than the reported total?** The portal's relevance ordering can surface the same record on more than one page. The actor removes those duplicates, so you always get unique records. **Is the content in French?** Yes — data.gouv.fr is the French national portal, so titles and descriptions are primarily in French. All text is returned as proper UTF-8. **How many results can I get?** Set `maxItems` up to 2000 per run. The actor paginates automatically until it reaches `maxItems` or the matching results are exhausted. ### Data source Data comes from the public [data.gouv.fr API](https://www.data.gouv.fr/api/1/), operated by the French government (Etalab / DINUM). All content is open data published under open licenses. This is a third-party actor and is not affiliated with data.gouv.fr, Etalab or DINUM. # Actor input Schema ## `mode` (type: `string`): What to fetch. ## `query` (type: `string`): Free-text keyword for search modes (datasets / organizations / reuses). Leave empty to browse everything. ## `datasetIds` (type: `array`): Dataset object IDs or slugs, e.g. `transport` or `55e4129788ee386899a46ec1`. Full data.gouv.fr URLs are also accepted. ## `organization` (type: `string`): Organization slug or object ID, e.g. `institut-national-de-la-statistique-et-des-etudes-economiques-insee`. Full URLs are accepted. ## `topic` (type: `string`): Filter reuses by topic. ## `reuseType` (type: `string`): Filter reuses by type. ## `format` (type: `string`): Only return datasets that offer a resource in this file format. ## `license` (type: `string`): Only return datasets published under this license. ## `badge` (type: `string`): Only return datasets carrying this quality badge. HVD = High Value Dataset (EU), SPD = reference/base dataset. ## `tag` (type: `string`): Only return datasets or reuses carrying this exact tag (e.g. `mobilité`, `covid-19`). ## `featured` (type: `boolean`): Only return records the portal has editorially featured (datasets and reuses). ## `sort` (type: `string`): Sort results (search / byOrganization modes). Leave empty for relevance / default order. ## `maxItems` (type: `integer`): Hard cap on emitted records. ## Actor input object example ```json { "mode": "searchDatasets", "query": "transport", "datasetIds": [ "transport" ], "topic": "", "reuseType": "", "format": "", "license": "", "badge": "", "featured": false, "sort": "-reuses", "maxItems": 15 } ``` # Actor output Schema ## `records` (type: `string`): Dataset containing all scraped records (datasets, organizations, reuses). # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "searchDatasets", "query": "transport", "datasetIds": [ "transport" ], "topic": "", "reuseType": "", "format": "", "license": "", "badge": "", "sort": "-reuses", "maxItems": 15 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/datagouvfr-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "searchDatasets", "query": "transport", "datasetIds": ["transport"], "topic": "", "reuseType": "", "format": "", "license": "", "badge": "", "sort": "-reuses", "maxItems": 15, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/datagouvfr-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "searchDatasets", "query": "transport", "datasetIds": [ "transport" ], "topic": "", "reuseType": "", "format": "", "license": "", "badge": "", "sort": "-reuses", "maxItems": 15 }' | apify call crawlerbros/datagouvfr-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/datagouvfr-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "data.gouv.fr Scraper", "description": "Scrape the French government open-data portal (data.gouv.fr). Search datasets by keyword, fetch full dataset details by ID/slug, list datasets by organization, and search organizations and reuses - with titles, descriptions, resources/formats, licenses, temporal coverage and metrics.", "version": "1.0", "x-build-id": "ffWCGCvvG0dYE1dAC" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~datagouvfr-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-datagouvfr-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~datagouvfr-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-datagouvfr-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~datagouvfr-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-datagouvfr-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "searchDatasets", "datasetDetails", "byOrganization", "searchOrganizations", "searchReuses" ], "type": "string", "description": "What to fetch.", "default": "searchDatasets" }, "query": { "title": "Search query", "type": "string", "description": "Free-text keyword for search modes (datasets / organizations / reuses). Leave empty to browse everything.", "default": "transport" }, "datasetIds": { "title": "Dataset IDs or slugs (mode=datasetDetails)", "type": "array", "description": "Dataset object IDs or slugs, e.g. `transport` or `55e4129788ee386899a46ec1`. Full data.gouv.fr URLs are also accepted.", "default": [], "items": { "type": "string" } }, "organization": { "title": "Organization ID or slug (mode=byOrganization)", "type": "string", "description": "Organization slug or object ID, e.g. `institut-national-de-la-statistique-et-des-etudes-economiques-insee`. Full URLs are accepted." }, "topic": { "title": "Reuse topic (mode=searchReuses)", "enum": [ "", "culture_and_recreation", "economy_and_business", "education_and_research", "environment_and_energy", "health", "housing_and_development", "law_and_justice", "open_data_tools", "others", "transport_and_mobility", "work_and_training" ], "type": "string", "description": "Filter reuses by topic.", "default": "" }, "reuseType": { "title": "Reuse type (mode=searchReuses)", "enum": [ "", "api", "application", "idea", "news_article", "paper", "post", "visualization" ], "type": "string", "description": "Filter reuses by type.", "default": "" }, "format": { "title": "File format (dataset modes)", "enum": [ "", "csv", "json", "geojson", "xlsx", "shp", "gtfs", "zip", "pdf", "xml", "parquet", "html", "kml", "ods", "txt" ], "type": "string", "description": "Only return datasets that offer a resource in this file format.", "default": "" }, "license": { "title": "License (dataset modes)", "enum": [ "", "cc-by", "cc-by-sa", "cc-zero", "fr-lo", "lov2", "notspecified", "odc-by", "odc-odbl", "odc-pddl", "other-at", "other-open", "other-pd" ], "type": "string", "description": "Only return datasets published under this license.", "default": "" }, "badge": { "title": "Badge (dataset modes)", "enum": [ "", "hvd", "spd" ], "type": "string", "description": "Only return datasets carrying this quality badge. HVD = High Value Dataset (EU), SPD = reference/base dataset.", "default": "" }, "tag": { "title": "Tag", "type": "string", "description": "Only return datasets or reuses carrying this exact tag (e.g. `mobilité`, `covid-19`)." }, "featured": { "title": "Featured only", "type": "boolean", "description": "Only return records the portal has editorially featured (datasets and reuses).", "default": false }, "sort": { "title": "Sort order", "enum": [ "", "-created", "-last_modified", "-reuses", "-followers", "-views" ], "type": "string", "description": "Sort results (search / byOrganization modes). Leave empty for relevance / default order.", "default": "-reuses" }, "maxItems": { "title": "Max items", "minimum": 1, "maximum": 2000, "type": "integer", "description": "Hard cap on emitted records.", "default": 50 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```