# EDGAR JRC Global GHG Emissions Database Scraper (`jungle_synthesizer/edgar-jrc-ghg-emissions-database-scraper`) Actor Pull country, sector, gas, and year GHG emissions from EU JRC EDGAR — the most-cited global GHG dataset (IPCC AR6, EU Green Deal). CO2, CH4, N2O, F-gases and AR5 CO2e totals 1970-2023. Includes IEA-EDGAR CO2 fuel-combustion subset. No auth or proxy needed. - **URL**: https://apify.com/jungle\_synthesizer/edgar-jrc-ghg-emissions-database-scraper.md - **Developed by:** [BowTiedRaccoon](https://apify.com/jungle_synthesizer) (community) - **Categories:** Business, Developer tools, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## EDGAR JRC Global GHG Emissions Database Scraper Pull country-level greenhouse gas emissions from the EU Commission's JRC EDGAR database — the most-cited global GHG dataset in use, referenced by IPCC AR6, the EU Green Deal, and virtually every serious climate research paper written in the last decade. ### What it does The scraper fetches the EDGAR dataset index page to discover the current release's ZIP manifest, downloads the requested gas bundles from the EU JRC open-data server, parses the XLSX files inside each ZIP, and emits one record per country × IPCC sector × gas × year. No authentication. No proxy. No rate-limit gymnastics. The EU Commission just puts the data out there. **Coverage:** - Gases: CO2 (IEA-EDGAR fuel combustion), CO2bio, CH4, N2O, F-gases, AR5_GHG (CO2-equivalent totals, GWP-100) - Countries: ~250 (ISO-3 codes) - Years: 1970–2023 - Sectors: IPCC 2006 classification (~25 per country per gas) or totals-only mode The IEA-EDGAR CO2 bundle deserves a specific note. It's the closest freely available substitute for IEA's "CO2 Emissions from Fuel Combustion" product, which is paywalled. You get the same underlying methodology. The IEA just charges for the branded report. ### Output schema One row per emission record. | Field | Type | Description | |-------|------|-------------| | `country_code` | string | ISO-3 country code (e.g. USA, DEU, CHN) | | `country_name` | string | Country display name | | `region` | string | EDGAR regional group (e.g. Annex_I, EU27) | | `year` | integer | Reporting year (1970–2023) | | `gas` | string | Gas identifier: CO2, CH4, N2O, F-gases, AR5_GHG | | `sector_ipcc2006` | string | IPCC 2006 sector code (e.g. 1A1a). Empty in totals-only mode. | | `sector_name` | string | Human-readable sector name. Empty in totals-only mode. | | `subsector` | string | fossil or bio sub-classification (null for totals rows) | | `emission_kt` | number | Emission quantity in kt (or kt CO2e for AR5_GHG) | | `emission_unit` | string | Always "kt" | | `dataset_version` | string | EDGAR release directory, e.g. EDGAR_2024_GHG | | `source_file` | string | Source ZIP filename for provenance | | `is_fuel_combustion_iea` | boolean | True for IEA-EDGAR CO2 fuel combustion rows | ### Input options | Parameter | Default | Description | |-----------|---------|-------------| | `gases` | `["CO2","CH4","N2O","AR5_GHG"]` | Gas bundles to download. Valid: CO2, CO2bio, CH4, N2O, F-gases, AR5_GHG. | | `countries` | `[]` (all) | ISO-3 country filter. Empty returns all ~250 countries. | | `yearFrom` | 2000 | First year to include. Earliest available: 1970. | | `yearTo` | 2023 | Last year to include. | | `includeIeaFuelCombustion` | `true` | Include IEA-EDGAR CO2 fuel combustion bundle. | | `includeSectorBreakdown` | `true` | Emit per-IPCC-sector rows. When false, emit country/gas/year totals only. | | `includeMonthly` | `false` | Download monthly bundles (much larger, slower). | | `maxItems` | 200 | Cap on output records. | ### Use cases **ESG and supply-chain carbon accounting.** Tools like Watershed, Persefoni, and Climatiq use country-level emission factors as baselines. EDGAR is the standard source. This actor eliminates the ZIP-parse pipeline. **Climate research.** IPCC AR6 Working Group III references EDGAR extensively. If you're reproducing or extending that analysis, this is your data source. **Journalism and NGO reporting.** EU Green Deal progress tracking, national emissions comparisons, sector-specific breakdowns. The actor returns data in a format that loads directly into a spreadsheet or database. **National statistics offices.** Countries building their own GHG inventories cross-check against EDGAR. The sector breakdown by IPCC 2006 codes aligns with standard reporting frameworks. ### Technical notes The actor operates as a data pipeline, not a scraper in the traditional sense. It fetches the EDGAR index page to discover the current release year's ZIP manifest, then downloads each requested bundle sequentially. Files are unzipped in memory and parsed with SheetJS. The wide-format year columns (Y_1970 through Y_2023) are pivoted to long-format rows before output. Memory requirement: 2 GB recommended for full multi-gas runs. Each ZIP is 6–50 MB uncompressed, and the EDGAR_AR5_GHG bundle is the largest at roughly 10 MB compressed. EDGAR releases annually, typically mid-year. The actor auto-detects the current release from the index page, so it survives annual updates without code changes. You can also pin a specific version via the `datasetVersion` input. ### Data source **EU Commission Joint Research Centre — EDGAR (Emissions Database for Global Atmospheric Research)** - Index: https://edgar.jrc.ec.europa.eu/dataset_ghg2024 - Data: https://jeodpp.jrc.ec.europa.eu/ftp/jrc-opendata/EDGAR/ - License: Creative Commons BY 4.0 (https://edgar.jrc.ec.europa.eu/about) Cite as: Crippa M., et al. (2024) EDGAR Community GHG Database, European Commission, JRC. # Actor input Schema ## `sp_intended_usage` (type: `string`): Please describe how you plan to use the data extracted by this crawler. ## `sp_improvement_suggestions` (type: `string`): Provide any feedback or suggestions for improvements. ## `sp_contact` (type: `string`): Provide your email address so we can get in touch with you. ## `gases` (type: `array`): Which gas bundles to download. AR5_GHG is the all-gas CO2-equivalent total (GWP-100). Valid values: CO2, CH4, N2O, F-gases, AR5_GHG, CO2bio. ## `datasetVersion` (type: `string`): EDGAR release directory name, e.g. EDGAR_2024_GHG. Leave blank to auto-detect the latest from the index page. ## `countries` (type: `array`): ISO-3 country codes to include (e.g. USA, DEU, CHN). Leave empty for all countries. ## `yearFrom` (type: `integer`): First year to include in output (1970 is earliest available). ## `yearTo` (type: `integer`): Last year to include in output. ## `includeIeaFuelCombustion` (type: `boolean`): Pull the IEA-EDGAR CO2 bundle (CO2 from fuel combustion) — closest free proxy for the IEA paywalled CO2 from Fuel Combustion product. Enabled by default when CO2 is in the gases list. ## `includeSectorBreakdown` (type: `boolean`): Emit one row per IPCC 2006 sector. When false, emit country/gas/year totals only. ## `includeMonthly` (type: `boolean`): Pull EDGAR monthly bundles (much larger downloads, slower). Annual bundles are always included. ## `maxItems` (type: `integer`): Maximum number of emission records to emit. Use a small value for quick tests. ## Actor input object example ```json { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "gases": [ "CO2", "CH4", "N2O", "AR5_GHG" ], "countries": [], "yearFrom": 2000, "yearTo": 2023, "includeIeaFuelCombustion": true, "includeSectorBreakdown": true, "maxItems": 15 } ```` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "gases": [ "CO2", "CH4", "N2O", "AR5_GHG" ], "datasetVersion": "", "countries": [], "yearFrom": 2000, "yearTo": 2023, "includeIeaFuelCombustion": true, "includeSectorBreakdown": true, "includeMonthly": false, "maxItems": 15 }; // Run the Actor and wait for it to finish const run = await client.actor("jungle_synthesizer/edgar-jrc-ghg-emissions-database-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "gases": [ "CO2", "CH4", "N2O", "AR5_GHG", ], "datasetVersion": "", "countries": [], "yearFrom": 2000, "yearTo": 2023, "includeIeaFuelCombustion": True, "includeSectorBreakdown": True, "includeMonthly": False, "maxItems": 15, } # Run the Actor and wait for it to finish run = client.actor("jungle_synthesizer/edgar-jrc-ghg-emissions-database-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "gases": [ "CO2", "CH4", "N2O", "AR5_GHG" ], "datasetVersion": "", "countries": [], "yearFrom": 2000, "yearTo": 2023, "includeIeaFuelCombustion": true, "includeSectorBreakdown": true, "includeMonthly": false, "maxItems": 15 }' | apify call jungle_synthesizer/edgar-jrc-ghg-emissions-database-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=jungle_synthesizer/edgar-jrc-ghg-emissions-database-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "EDGAR JRC Global GHG Emissions Database Scraper", "description": "Pull country, sector, gas, and year GHG emissions from EU JRC EDGAR — the most-cited global GHG dataset (IPCC AR6, EU Green Deal). CO2, CH4, N2O, F-gases and AR5 CO2e totals 1970-2023. Includes IEA-EDGAR CO2 fuel-combustion subset. No auth or proxy needed.", "version": "0.1", "x-build-id": "OQKAjqVG4La40ztyF" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/jungle_synthesizer~edgar-jrc-ghg-emissions-database-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-jungle_synthesizer-edgar-jrc-ghg-emissions-database-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/jungle_synthesizer~edgar-jrc-ghg-emissions-database-scraper/runs": { "post": { "operationId": "runs-sync-jungle_synthesizer-edgar-jrc-ghg-emissions-database-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/jungle_synthesizer~edgar-jrc-ghg-emissions-database-scraper/run-sync": { "post": { "operationId": "run-sync-jungle_synthesizer-edgar-jrc-ghg-emissions-database-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "sp_intended_usage", "sp_improvement_suggestions" ], "properties": { "sp_intended_usage": { "title": "What is the intended usage of this data?", "minLength": 1, "type": "string", "description": "Please describe how you plan to use the data extracted by this crawler." }, "sp_improvement_suggestions": { "title": "How can we improve this crawler for you?", "minLength": 1, "type": "string", "description": "Provide any feedback or suggestions for improvements." }, "sp_contact": { "title": "Contact Email", "minLength": 1, "type": "string", "description": "Provide your email address so we can get in touch with you." }, "gases": { "title": "Gases", "type": "array", "description": "Which gas bundles to download. AR5_GHG is the all-gas CO2-equivalent total (GWP-100). Valid values: CO2, CH4, N2O, F-gases, AR5_GHG, CO2bio.", "items": { "type": "string" } }, "datasetVersion": { "title": "Dataset Version", "type": "string", "description": "EDGAR release directory name, e.g. EDGAR_2024_GHG. Leave blank to auto-detect the latest from the index page." }, "countries": { "title": "Country Filter (ISO3)", "type": "array", "description": "ISO-3 country codes to include (e.g. USA, DEU, CHN). Leave empty for all countries.", "items": { "type": "string" } }, "yearFrom": { "title": "Year From", "type": "integer", "description": "First year to include in output (1970 is earliest available)." }, "yearTo": { "title": "Year To", "type": "integer", "description": "Last year to include in output." }, "includeIeaFuelCombustion": { "title": "Include IEA-EDGAR Fuel Combustion Subset", "type": "boolean", "description": "Pull the IEA-EDGAR CO2 bundle (CO2 from fuel combustion) — closest free proxy for the IEA paywalled CO2 from Fuel Combustion product. Enabled by default when CO2 is in the gases list." }, "includeSectorBreakdown": { "title": "Include Sector Breakdown", "type": "boolean", "description": "Emit one row per IPCC 2006 sector. When false, emit country/gas/year totals only." }, "includeMonthly": { "title": "Include Monthly Series", "type": "boolean", "description": "Pull EDGAR monthly bundles (much larger downloads, slower). Annual bundles are always included." }, "maxItems": { "title": "Max Items", "type": "integer", "description": "Maximum number of emission records to emit. Use a small value for quick tests.", "default": 15 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```