Korean Open Government Data Portal Scraper

🚀 Extract comprehensive dataset information from South Korea's official open data portal with ease!

The Korean Open Government Data Portal (data.go.kr) contains over 50,000 datasets from various Korean government agencies, covering everything from weather data and economic statistics to transportation and public health information. This scraper makes it easy to collect, analyze, and use this valuable public data for research, business intelligence, and application development.

Target Audience: Researchers, data analysts, developers, business intelligence professionals, and anyone interested in Korean public data
Primary Use Cases: Market research, data analysis, API discovery, business intelligence, research projects

What Does Korean Data Portal Scraper Do?

This tool collects comprehensive dataset information from the Korean Open Government Data Portal, supporting both research and development needs. It delivers:

• Complete dataset metadata (titles, descriptions, categories)
• Organization and contact information
• API endpoints and documentation URLs (for API datasets)
• File formats and download links (for file-based datasets)
• Data fields and parameters (for API datasets)
• View and download statistics
• License and usage information
• Tags and keywords for categorization
• Creation and update dates
• And more

Business Value: Access South Korea's extensive public data catalog programmatically, discover APIs for integration, and build comprehensive datasets for analysis without manual browsing through thousands of pages.

How to use the Korean Data Portal Scraper - Full Demo

Watch this demo to see how easy it is to get started!

[Demo video will be added here]

Input

To start scraping the Korean Data Portal, simply fill in the input form. You can scrape datasets based on:

• startUrl - Direct URL to a search results page from data.go.kr. This is useful when you want to scrape a specific search result page you've already configured on the website. To get a URL: 1) Go to https://www.data.go.kr/en/tcs/dss/selectDataSetList.do, 2) Apply your desired filters, 3) Copy the URL from your browser address bar.
• keyword - Search term to find datasets. This will search across dataset titles, descriptions, and keywords. Example: 'weather', 'population', 'economic'
• svcType - Filter by dataset type. FILE: Downloadable file-based datasets (CSV, XML, Excel, etc.). API: REST API endpoints that return JSON/XML data. STD: Standard datasets following specific data formats. LINKED: Linked data using semantic web standards.
• recmSe - Filter by recommendation status. Y: Only show datasets recommended by the portal (typically high-quality, frequently used datasets). N: Show all datasets including non-recommended ones.
• conditionType - Search condition type. 'init': Initial search state (default, shows all results). 'search': Active search mode (typically used after applying filters).
• kwrdArray - Comma-separated keywords for advanced search. Example: 'temperature,precipitation,humidity'
• maxItems - Maximum number of datasets to scrape. Free users: Required, maximum 50. Paid users: Optional, maximum 1,000,000. Leave empty for unlimited (paid users only). The scraper will stop once this limit is reached, even if more datasets are available.

Here's what the input configuration looks like in JSON:

{
    "keyword": "weather",
    "svcType": "API",
    "maxItems": 100
}

Output

After the Actor finishes its run, you'll get a dataset with the output. The length of the dataset depends on the amount of results you've set. You can download those results as an Excel, HTML, XML, JSON, and CSV document.

Here's an example of scraped Korean Data Portal data you'll get if you decide to scrape weather-related API datasets:

{
    "dataset_id": "15059093",
    "title": "JSON AsosDaIyInfoService",
    "organization": "Science and technology research",
    "dataset_type": "API",
    "description": "A service that searches for daily weather data observed with synoptic meteorological observation equipment. Surface weather observation (ASOS) is an observation of meteorological elements and phenomena near the ground and on the ground, such as temperature, precipitation, air pressure, humidity, solar radiation, and solar irradiance.",
    "category": "science Technology - Science and technology research",
    "tags": ["weather", "Weather observation", "Daily data", "Temperature", "Precipitation"],
    "last_updated": "2025-09-17",
    "created_date": "2019-12-26",
    "view_count": 197695,
    "download_count": 9656,
    "dataset_url": "https://www.data.go.kr/en/data/15059093/openapi.do",
    "api_endpoint": "http://apis.data.go.kr/1360000/AsosDalyInfoService/getWthrDataList",
    "api_documentation_url": "https://www.data.go.kr/catalog/15059093/openapi.json",
    "response_format": "JSON+XML",
    "data_fields": ["pageNo", "numOfRows", "dataType", "dataCd", "dateCd", "startDt", "endDt", "stnIds"],
    "sample_data": "Java Javascript C# PHP Curl Objective-C Python Nodejs",
    "contact_info": "Deliberation: dev : allow / run : allow | API Type: REST",
    "license_info": "Public Works_Source Mark",
    "scrapedTimestamp": "2025-12-04T17:48:21.921Z"
}

What You Get: Complete dataset information including API endpoints for integration, file download links, metadata for cataloging, and usage statistics for prioritizing valuable datasets.

Download Options: CSV, Excel, or JSON formats for easy analysis and integration into your existing tools.

Why Choose the Korean Data Portal Scraper?

• Comprehensive Data Collection: Extract complete metadata from over 50,000 Korean government datasets in one automated process
• API Discovery: Quickly find and catalog available APIs with endpoints, documentation, and parameter information
• Time Savings: Collect data from hundreds of pages in minutes instead of hours of manual browsing
• Structured Output: Get clean, organized data ready for analysis, integration, or database import
• Flexible Filtering: Use multiple search criteria to find exactly the datasets you need

Time Savings: What would take days of manual browsing and copying can be completed in minutes with automated collection.

Efficiency: Process thousands of datasets automatically, ensuring you don't miss valuable data sources.

How to Use

1. Sign Up: Create a free account w/ $5 credit (takes 2 minutes)
2. Find the Scraper: Visit the Korean Data Portal Scraper page
3. Set Input: Add your search keyword, dataset type, or start URL (we'll show you exactly what to enter)
4. Run It: Click "Start" and let it collect your data
5. Download Data: Get your results in the "Dataset" tab as CSV, Excel, or JSON

Total Time: First run takes about 5 minutes to set up and complete
No Technical Skills Required: Everything is point-and-click

Business Use Cases

Data Researchers:

• Build comprehensive catalogs of Korean public data
• Discover available APIs for research projects
• Track dataset updates and new releases
• Analyze data availability across different categories

Developers:

• Find APIs for application integration
• Discover data sources for mobile and web apps
• Get API documentation and endpoint information
• Identify datasets with sample code and examples

Business Analysts:

• Collect market and economic data
• Monitor government data releases
• Build datasets for business intelligence
• Track industry-specific information

Academic Researchers:

• Discover research data sources
• Catalog available datasets for studies
• Find data for comparative analysis
• Track data updates for longitudinal studies

Using Korean Data Portal Scraper with the Apify API

For advanced users who want to automate this process, you can control the scraper programmatically with the Apify API. This allows you to schedule regular data collection and integrate with your existing business tools.

• Node.js: Install the apify-client NPM package
• Python: Use the apify-client PyPI package
• See the Apify API reference for full details

Frequently Asked Questions

Q: How does it work?
A: Korean Data Portal Scraper is easy to use and requires no technical knowledge. Simply configure your search parameters (keyword, dataset type, etc.) and let the tool collect the data automatically from the Korean government's open data portal.

Q: How accurate is the data?
A: The scraper extracts data directly from the official Korean Open Government Data Portal, ensuring 100% accuracy. All information comes from the source website in real-time.

Q: Can I schedule regular runs?
A: Yes! Using the Apify API or platform integrations, you can schedule regular runs to keep your dataset catalog up-to-date automatically.

Q: What if I need help?
A: Our support team is available to help you get the most out of this tool. Contact us through the Apify platform for assistance.

Q: Is my data secure?
A: Yes, all data processing happens securely on Apify's platform. Your results are private and only accessible to you.

Q: Can I filter by specific organizations?
A: Yes, you can use the startUrl option to scrape specific search result pages that you've configured on the data.go.kr website with organization filters applied.

Q: What dataset types are available?
A: The portal includes four types: FILE (downloadable files), API (REST endpoints), STD (standard datasets), and LINKED (semantic web data). You can filter by any of these types.

Integrate Korean Data Portal Scraper with any app and automate your workflow

Last but not least, Korean Data Portal Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform.

These includes:

• Make
• Zapier
• Slack
• Airbyte
• GitHub
• Google Drive
• and much more.

Alternatively, you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever Korean Data Portal Scraper successfully finishes a run.

🔗 Recommended Actors

Looking for more data collection tools? Check out these related actors:

Actor	Description	Link
GSA eLibrary Scraper	Extracts government publications and documents from the GSA eLibrary portal	https://apify.com/parseforge/gsa-elibrary-scraper
Hubspot Marketplace Scraper	Collects business app data from HubSpot marketplace	https://apify.com/parseforge/hubspot-marketplace-scraper
Hugging Face Model Scraper	Extracts AI model information from Hugging Face platform	https://apify.com/parseforge/hugging-face-model-scraper
AWS Marketplace Scraper	Collects software and service listings from AWS Marketplace	https://apify.com/parseforge/aws-marketplace-scraper
Stripe App Marketplace Scraper	Extracts app data from Stripe's marketplace	https://apify.com/parseforge/stripe-marketplace-scraper

Pro Tip: 💡 Browse our complete collection of data collection actors to find the perfect tool for your business needs.

Need Help? Our support team is here to help you get the most out of this tool.

---

⚠️ Disclaimer: This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by the Korean Open Government Data Portal (data.go.kr) or any of its subsidiaries. All trademarks mentioned are the property of their respective owners.