Our World in Data Chart & Article Extractor avatar

Our World in Data Chart & Article Extractor

Pricing

from $0.49 / 1,000 results

Go to Apify Store
Our World in Data Chart & Article Extractor

Our World in Data Chart & Article Extractor

Browse Our World in Data articles by topic or keyword, download the dataset behind any chart by its slug, or pull country profile pages, with article, chart, and data-row records.

Pricing

from $0.49 / 1,000 results

Rating

0.0

(0)

Developer

Nimbryxo-studio

Nimbryxo-studio

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 hours ago

Last modified

Features

Limited permissions

Share

Our World in Data publishes its research as articles, topic pages and interactive charts, and most charts have a downloadable dataset behind them. This actor turns those public resources into structured records: searchable articles, a chart catalog you can browse by topic or country, full chart metadata plus wide or long data rows, and country profiles that list the indicators available for that country.

No login, cookie or API key is needed. Every request goes to a public Our World in Data page or endpoint.

What you can collect

  • Articles — keyword search across OWID's articles, data insights, announcements and topic pages, with topic, author, page-type, date-range and sort filters.
  • Chart catalog — find chart slugs by keyword, topic or the countries a chart covers. Use the slugs with the chart-data modes.
  • Chart data — fetch one chart by slug or URL: title, subtitle, citation, units, column descriptions, source URLs, and its full CSV dataset.
  • Chart data bulk — fetch several charts in one run, with the same filters.
  • Country profiles — country name, code, profile pages, and the charts/indicators available for that country.

Quick start

Recent climate articles:

{
"mode": "articles",
"searchQuery": "climate change",
"topic": "Climate Change",
"sortBy": "newest",
"maxItems": 25
}

One chart's data for two countries and a short year range:

{
"mode": "chartData",
"chartSlug": "life-expectancy",
"entities": ["Germany", "France"],
"yearFrom": 2000,
"yearTo": 2023,
"maxItems": 100
}

Discover chart slugs for a country:

{
"mode": "chartCatalog",
"searchQuery": "energy",
"entities": ["Germany"],
"maxItems": 50
}

A country profile with its available indicators:

{
"mode": "countries",
"countries": ["Germany"],
"maxIndicatorsPerCountry": 50
}

Inputs

FieldTypeDefaultWhat it does
modeselectarticlesarticles, chartCatalog, chartData, chartDataBulk, or countries.
searchQuerytext—Keyword for articles and chart catalog; also a country-name search in countries mode when no country list is set.
topicselectAll topicsRestricts articles and chart catalog results to one OWID topic. Legacy topic slugs are accepted.
authorselectAny authorRestricts articles to one OWID author.
articleTypeselecteditorialEditorial (articles, data insights, announcements, topic pages), one exact page type, or everything.
sortByselectnewestnewest, oldest, or search relevance.
dateFromtext—Earliest publication date, YYYY-MM-DD.
dateTotext—Latest publication date, YYYY-MM-DD.
includeContentbooleanfalseAdds OWID's full article text to each article record.
includeArticleDetailsbooleanfalseVisits each selected article page to fill related charts and any missing page metadata. Slower.
chartSlugtext—One chart slug or full chart URL, e.g. life-expectancy.
chartSlugsstring list[]Several chart slugs/URLs for bulk chart data.
entitiesstring list[]Keep chart rows for these countries/regions. Names (Germany) and codes (DEU) both work. Empty means all.
columnsstring list[]Keep only these data columns, matched by CSV header, short name, display title or variable ID. Empty means all.
yearFrominteger—Earliest year in chart data rows.
yearTointeger—Latest year in chart data rows.
dataFormatselectwidewide: one record per entity-year; long: one record per entity-year-column.
includeChartConfigbooleantrueEmit a chart metadata record before the chart's data rows.
countriesstring list[]Country names, slugs or ISO codes for countries mode. Empty uses searchQuery, then all listed countries.
maxIndicatorsPerCountryinteger100How many chart indicators to list inside each country record, up to 5,000.
maxItemsinteger100Hard cap on emitted records, up to 25,000.

Output per record

Every record has recordType and scrapedAt. Empty values are omitted at every depth — a field is present only when the source really has it.

Articles (recordType: "article")

articleSlug, title, publishedAt, updatedAt, authors, primaryAuthor, excerpt, excerptLong, thumbnailUrl, tags, pageType, importance, availableEntities, relatedCharts, content (when requested), articleUrl.

Chart catalog (recordType: "chart")

chartSlug, title, subtitle, variantName, chartType, chartTypes, tags, availableEntityCount, publishedAt, updatedAt, queryParams, chartUrl, csvUrl, metadataUrl, searchResultUrl.

Chart metadata (recordType: "chartConfig")

chartSlug, chartId, title, subtitle, note, variantName, originUrl, chartVersion, chartTypes, availableTabs, citation, source, columnDetails, dataColumns, unit, entityType, entityCount, grapherQueryParams, dateDownloaded, selectedEntityNames, dimensionVariableIds, isPublished, hasMapTab, lastUpdated, nextUpdate, chartUrl, csvUrl, metadataUrl, configUrl, searchResultUrl, dataAvailable.

When a chart has no downloadable CSV, the record also includes dataUnavailableReason, valuesUrl (OWID's public start/end values endpoint) and previewValues (the entities and values OWID shows in its search result for that chart). These are real OWID values, not a full time series.

columnDetails is one object per data column with column, titleShort, titleLong, shortName, unit, timespan, type, variableId, lastUpdated, nextUpdate, citationShort, descriptionShort, and the chart's display name when it has one.

Chart data rows (recordType: "chartDataRow")

Wide format: chartSlug, chartTitle, entity, entityCode, year or date, one field per data column (named from the chart's own CSV header, in camelCase), and sourceUrl.

Long format: chartSlug, chartTitle, entity, entityCode, year or date, column, columnTitle, columnName, unit, value, and sourceUrl.

Countries (recordType: "country")

countrySlug, countryName, countryCode, countryShortCode, countryUrl, searchUrl, description, thumbnailUrl, tags, profiles, profileCount, availableIndicatorCount, availableIndicators, relatedCharts, plus isHistorical / isUnlisted when they apply.

Each profile object has title, profileSlug, profileUrl, excerpt, tags, thumbnailUrl, publishedAt and updatedAt. Each available indicator has chartSlug, title, subtitle, tags, chartTypes and chartUrl.

How the filters combine

  • Article filters compose: query + topic + author + page type + date range are all applied together.
  • Chart data filters compose: selected chart(s) + entities + years + columns.
  • entities accepts country names as they appear in the chart (United States), OWID/ISO codes (USA, OWID_WRL for World), two-letter codes (DE) and country slugs. Matching is case-insensitive and ignores a leading ~; short forms are expanded through OWID's own country catalog so they match the chart's names and codes.
  • columns accepts the CSV header, a short name (life_expectancy_0), a display title, titleLong, or a numeric OWID variable ID. A token that matches nothing produces no data rows rather than all columns.
  • dataFormat: "long" is useful when charts have many columns: each value becomes its own record with its unit.

Data quality and limits

  • OWID does not redistribute every chart. About 2% of charts return 403 for their CSV and about 4% return 404. The actor still emits their metadata when it exists, marks dataAvailable: false, adds dataUnavailableReason, and includes previewValues and valuesUrl when OWID publishes them. The run status names the affected slugs. The preview is not a full time series.
  • Chart rows are the full public CSV unless entity, yearFrom, yearTo or columns narrows them.
  • Article search covers OWID's public search index, not just the recent RSS feed. The index has 2,013 pages and 1,179 chronological records; merging and deduplicating them yields about 2,109 local records across all page types. Some canonical OWID pages that appear in the sitemap are absent from that index (for example battery-price-decline), so keyword search cannot return every sitemap URL. Date filtering is applied to the publication date.
  • The chart index caps a single query at 3,000 hits. The actor partitions by topic tag when you request the full catalog, so chartCatalog without filters can return all 4,092 type:chart records observed on 2026-11-21. The full catalog peaks around 215 MiB locally.
  • Country profile counts come from OWID; availableIndicators is capped by maxIndicatorsPerCountry while availableIndicatorCount reports the full total. Germany's 3,010 indicators fit within the 5,000 maximum and peak around 135 MiB locally.
  • maxItems caps emitted records across a run, including chart metadata records, and now allows up to 25,000. Verified locally (45.6 s, 131 MiB) and on the 512 MB cloud build (25,000 rows, 34.315 s, 112 MB).
  • Some charts use Day instead of Year; those rows expose a date field and a derived year.
  • The actor never fabricates missing values and omits empty fields.

FAQ

Do I need an API key, login or proxy? No. Everything is public. The actor does not ask for cookies or proxy configuration and works without either.

Where do I get a chart slug? Use chartCatalog mode, or copy the part after /grapher/ in a chart URL. Chart-data inputs also accept the full URL.

Why does a chart return metadata but no rows? OWID publishes metadata for more charts than it can redistribute as CSV. dataAvailable, dataUnavailableReason, previewValues, valuesUrl and the run status tell you which case you hit.

Why do chart columns change from chart to chart? Each chart publishes its own data columns. Wide mode keeps those names (camelCased); long mode puts each column into column, columnTitle and unit so every chart has the same shape.

Can I get one country's full history for many charts? Yes. Use chartDataBulk with several slugs and entities: ["Germany"], or use countries mode to discover indicators first.

Does article mode return every page OWID has ever published? It searches OWID's public page index, which covers articles, data insights, announcements, topic pages, about pages, profiles and featured visualizations. It does not cover every canonical sitemap URL: a small number of pages are absent from the search index and cannot be found by keyword. Choose articleType to narrow the result; editorial is the default.

Can I filter articles by author and date together? Yes — combine author, dateFrom, dateTo, topic and searchQuery in one run.

Is this affiliated with Our World in Data? No. It reads public pages and data files and is not affiliated with, endorsed by, or connected to Our World in Data or the Global Change Data Lab. OWID's charts, articles and data are published under CC BY unless stated otherwise; third-party data keeps its own terms, so check the citation in each chart's metadata before republishing.