Humanitarian Data Exchange Scraper

Humanitarian Data Exchange (HDX) is open platform for sharing data across crises and organisations Returns clean, structured JSON records ready for analysis, automation, or integration with other tools.

What You Get

• Medical conditions and symptoms
• Drug information
• Health statistics by region
• Clinical trial data

All results are returned as structured JSON objects — no parsing or cleanup required.

This actor supports automatic pagination — it keeps fetching pages until maxResults is reached.

Quick Start

Click Run with default settings — no configuration needed. The actor works out of the box.

{
  "maxResults": 100,
  "searchQuery": ""
}

Or search for specific data:

{
  "searchQuery": "diabetes",
  "maxResults": 100,
  "startPage": 1,
  "resultsPerPage": 0
}

Input Options

Field	Default	Description
searchQuery	""	Keyword or phrase to filter results. Leave empty to browse all records.
maxResults	100	Maximum records to retrieve (1–10,000). Increase for bulk exports.
startPage	1	Page to start from. Useful for resuming a previous run.
resultsPerPage	0	Records per page (0 = use maximum allowed). Reduce if rate-limited.

Output Format

Results are pushed to the Apify Dataset as individual JSON records. Each run also saves a summary to the Key-Value Store under OUTPUT:

{
  "totalResults": 100,
  "fetchedAt": "2025-01-01T00:00:00.000Z"
}

Dataset records contain the raw structured data returned by the source, including fields like:

• Medical conditions and symptoms
• Drug information
• Health statistics by region

Use Cases

• Healthcare information apps
• Medical research platforms
• Patient education tools
• Public health dashboards

Pricing

$1.00 per 1,000 results — pay only for what you use. Pricing is based on the number of records pushed to the dataset.

Results	Estimated Cost
100	$0.10
1,000	$1.00
10,000	$10.00

Notes

• Results are pushed to the dataset in real time as they are fetched
• The actor automatically retries failed requests up to 3 times
• Rate limiting is handled gracefully with built-in delays
• Run multiple times safely — each run creates a fresh dataset