🇰🇷 Korean Data Portal Scraper

🚀 Extract dataset metadata from South Korea's official open data portal in minutes. Search by keyword, filter by type and recommendation status. No coding, no authentication required.

🕒 Last updated: 2026-04-16 · 📊 20 fields · 📂 50,000+ public datasets · 🔍 Keyword and URL-based search

South Korea's data.go.kr is the country's official government open data portal, hosting over 50,000 public datasets from hundreds of government agencies. This scraper collects structured dataset metadata including titles, descriptions, organization names, file formats, download URLs, API access links, view counts, download statistics, and contact information. It supports keyword search, direct URL scraping, and filtering by dataset type (FILE, API, STD, LINKED).

Whether you are a researcher analyzing Korean government data availability, a business looking for market data, or a developer building applications with Korean public datasets, this actor delivers structured metadata for up to 1,000,000 datasets per run for paid users. Every record includes the dataset title, publishing organization, description, creation and update dates, file formats, download links, and usage metrics. The data exports as JSON, CSV, or Excel.

🎯 Target Audience	💡 Use Cases
Data researchers	Discover Korean government datasets by topic
Business analysts	Find economic and market data from Korean agencies
Developers	Locate API-based datasets for application integration
Journalists	Access public data for investigative reporting
Urban planners	Find geographic and demographic data for Korea
Academic researchers	Build bibliographies of Korean government data sources

---

📋 What the Korean Data Portal Scraper does

• 🔍 Keyword search across dataset titles and descriptions in Korean and English
• 🔗 Direct URL scraping from any data.go.kr search results page
• 📂 Dataset type filtering for downloadable files, APIs, standards, and linked data
• ⭐ Recommendation filtering to show only portal-recommended datasets
• 📊 Usage metrics including view counts and download statistics
• 📥 Download URLs and API access links for direct data retrieval

The scraper queries the data.go.kr portal with your search parameters, retrieves matching dataset listings, and extracts full metadata for each entry. Results include dataset IDs, titles, descriptions, publishing organizations, dataset types, creation and update dates, file formats, download links, API documentation, categories, tags, contact information, license terms, and usage statistics. Each record is timestamped.

💡 Why it matters: Browsing data.go.kr manually is slow, especially if you need to survey datasets across multiple topics or agencies. This scraper automates discovery and delivers structured metadata ready for cataloging, analysis, or application development.

---

🎬 Full Demo

🚧 Coming soon...

---

⚙️ Input

Field	Type	Required	Description
startUrl	string	No	Direct URL from data.go.kr search results
maxItems	integer	No	Max datasets to collect. Free: up to 10. Paid: up to 1,000,000
keyword	string	No	Search term for datasets (e.g., "weather", "population")
svcType	string	No	Dataset type: FILE, API, STD, or LINKED
recmSe	string	No	Recommendation filter: Y (recommended only) or N (all)
conditionType	string	No	Search condition: init (default) or search
kwrdArray	string	No	Comma-separated keywords for advanced search

Example 1: Basic keyword search

{
  "keyword": "weather",
  "maxItems": 10
}

Example 2: Filtered search for downloadable file datasets

{
  "keyword": "population",
  "svcType": "FILE",
  "recmSe": "Y",
  "maxItems": 50
}

⚠️ Good to Know: Use either a Start URL or search filters, not both. If you provide a Start URL, search filters are ignored. The keyword search works with both Korean and English terms, though Korean terms typically return more results.

---

📊 Output

🧾 Schema

Emoji	Field	Type	Description
🆔	datasetId	string	Unique dataset identifier
📝	title	string	Official dataset title
🏢	organization	string	Publishing government agency
📋	description	string	Dataset description
📊	datasetType	string	Data format type (FILE, API, STD, LINKED)
📅	createdDate	string	When the dataset was first published
📅	lastUpdated	string	Most recent update date
📈	viewCount	number	Total page views
📈	downloadCount	number	Total downloads
🏷️	categories	array	Topic classifications
🏷️	tags	array	Keyword tags
🔗	datasetUrl	string	Direct link to the dataset page
📥	downloadUrl	string	File download URL
💾	fileFormat	string	Available file format
📦	fileSize	string	File size
🔗	dataAccessLink	string	API or data access endpoint
📖	documentation	string	API documentation link
👤	contactInfo	string	Responsible agency contact
⚖️	licenseInfo	string	Data usage license terms
⚠️	error	string	Error message if processing failed

📦 Sample records

---

✨ Why choose this Actor

Feature	Details
🔍 Keyword and URL search	Search by topic or scrape any data.go.kr results page
📂 4 dataset types	FILE, API, STD, and LINKED data formats
⭐ Recommendation filter	Show only portal-recommended datasets
📈 Usage metrics	View counts and download statistics for each dataset
📥 Download URLs	Direct links to files and API endpoints
🌐 Korean and English	Search with terms in both languages
📦 Flexible export	JSON, CSV, or Excel output

📊 Discover and catalog up to 1,000,000 Korean government datasets per run with full metadata and download links.

---

📈 How it compares to alternatives

Feature	This Actor	Manual Browsing	Generic Scrapers
Keyword search (Korean + English)	✅	✅	❌
Dataset type filtering	✅	✅	❌
Usage metrics extraction	✅	Manual	❌
Download URL collection	✅	Manual	❌
Bulk collection (1M+ datasets)	✅	❌	❌
Structured JSON/CSV output	✅	❌	Varies
Scheduled runs	✅	❌	❌

Automate your Korean government data discovery instead of browsing and recording datasets manually.

---

🚀 How to use

1. Create an Apify account - Sign up free with $5 credit
2. Open the Korean Data Portal Scraper - Navigate to the actor page on Apify
3. Enter a search keyword or URL - Type a topic like "weather" or paste a data.go.kr search URL
4. Add optional filters - Set dataset type, recommendation status, or advanced keywords
5. Click Start - The actor collects matching datasets and delivers structured metadata

⏱️ A typical run with 10 datasets completes in under 1 minute.

---

💼 Business use cases

📊 Data Research Discover available government datasets by topic Catalog API endpoints for application development Track new dataset publications across agencies Compare data availability across Korean departments	💼 Business Intelligence Find economic and trade data for market analysis Locate demographic data for customer segmentation Access weather data for logistics planning Monitor government data releases in your industry
🎓 Academic Research Build inventories of available Korean public data Find datasets for Korean studies research Track data quality and update frequency Compile data source bibliographies for papers	📰 Journalism Find public data sources for investigative stories Track dataset updates from specific agencies Access environmental and health data for reporting Monitor government transparency through data publication

---

🔌 Automating Korean Data Portal Scraper

Integrate the Korean Data Portal Scraper into your workflow using the Apify API or client libraries.

Node.js:

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });
const run = await client.actor("parseforge/data-go-kr-scraper").call({
  keyword: "weather",
  svcType: "FILE",
  maxItems: 50
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

Python:

from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("parseforge/data-go-kr-scraper").call(run_input={
    "keyword": "weather",
    "svcType": "FILE",
    "maxItems": 50
})
items = list(client.dataset(run["defaultDatasetId"]).iterate_items())
print(items)

• 📖 Apify API reference
• 🐍 Python client docs
• 📦 Node.js client docs

Schedules: Set up recurring runs to monitor new dataset publications, track update frequency, or build a growing catalog of Korean government data. Configure daily, weekly, or monthly schedules from the Apify Console.

---

❓ Frequently Asked Questions

---

🔌 Integrate with any app

• 🔗 Make (Integromat) - Connect dataset metadata to Google Sheets, Notion, or any of 1,500+ apps
• 🔗 Zapier - Trigger workflows when new datasets are found
• 🔗 Slack - Get notified when new government datasets are published
• 🔗 Airbyte - Stream dataset metadata into your data warehouse
• 🔗 GitHub - Store dataset catalogs in repositories for version control
• 🔗 Google Drive - Automatically save CSV exports to shared folders

---

🔗 Recommended Actors

Actor	Description
US Census Bureau Scraper	Extract demographic and economic data from the US Census Bureau
NASA Reports Scraper	Collect technical reports from NASA's NTRS database
Crossref Scraper	Extract DOI metadata for 155M+ research publications
Open Library Scraper	Search and download book data from the Internet Archive
ROR Scraper	Collect research organization data from ROR

💡 Pro Tip: Combine the Korean Data Portal Scraper with the US Census Bureau Scraper to compare public data availability and coverage between Korean and US government portals.

---

🆘 Need Help? Open our contact form and we will get back to you within 24 hours. We are happy to help with custom setups, integrations, or feature requests.

---

Disclaimer: This actor is not affiliated with, endorsed by, or connected to the Korean government or data.go.kr. It accesses publicly available data from South Korea's open data portal. Use responsibly and in accordance with applicable terms of service.