Singapore data.gov.sg Datasets Scraper
Pricing
from $7.50 / 1,000 results
Singapore data.gov.sg Datasets Scraper
Hit any data.gov.sg datastore resource by ID and pull every record with dataset_id, record_id, fields, values, and resource_name. Optional full row search lets you filter rows. Useful for civic analytics, transport studies, and economic research across Singapore public datasets.
Pricing
from $7.50 / 1,000 results
Rating
0.0
(0)
Developer
ParseForge
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
7 days ago
Last modified
Categories
Share

🇸🇬 Singapore data.gov.sg Datasets Scraper
🚀 Export any open dataset from Singapore data.gov.sg via its public datastore_search API in seconds.
🕒 Last updated: 2026-05-29 · 📊 9 fields per record · data.gov.sg datastore API · National coverage · Thousands of datasets
The Singapore data.gov.sg Datasets Scraper turns the datastore_search public API into a clean dataset. Pass a resource_id from any dataset on data.gov.sg, get back one row per record.
| 🎯 Target Audience | 💡 Primary Use Cases |
|---|---|
| 📊 Analysts | Build clean datasets from the source |
| 🏢 Business teams | Plug official data into internal tools |
| 🤖 ML engineers | Training data ready for pandas and BigQuery |
| 📰 Journalists | Verify numbers in seconds |
| 🎓 Researchers | Reproducible historical pulls |
| 👩💻 Developers | Skip writing a client library |
📋 What the Singapore data.gov.sg Datasets Scraper does
- Calls the public data.gov.sg datastore endpoint.
- Parses the response and flattens each record into a clean row.
- Casts numeric fields and normalizes timestamps for downstream tools.
- Surfaces upstream errors as a clean
errorrecord instead of crashing. - Exports as CSV, Excel, JSON, JSONL, XML, RSS, or HTML.
💡 Why it matters: the source is public but its format is not analyst friendly. This actor returns a flat, tool-ready dataset.
🎬 Full Demo
🚧 Coming soon.
⚙️ Input
| Field | Type | Required | Description |
|---|---|---|---|
datasetId | string | No | data.gov.sg resource_id. |
query | string | No | Optional full-row search filter. |
maxItems | integer | No | Free 10, paid up to 1,000,000. |
Example 1:
{ "datasetId": "d_8b84c4ee58e3cfc0ece0d773c8ca6abc", "maxItems": 100 }
Example 2:
{ "datasetId": "d_8b84c4ee58e3cfc0ece0d773c8ca6abc", "query": "MRT" }
⚠️ Good to Know: the upstream source enforces its own rate limits. Heavy pulls should be spread across runs.
📊 Output
Each record is a flat object. error is always last.
| Field | Type | Description |
|---|---|---|
🆔 dataset_id | string | data.gov.sg resource_id |
🆔 record_id | number | Row identifier |
🧾 fields | array | List of column names |
🧾 values | object | Full row payload |
🕒 last_updated | string | Source last update if available |
📁 resource_name | string | Resource identifier |
🏛️ organization | string | Owning agency if available |
🕒 scrapedAt | string | When this row was fetched |
❌ error | string | Set if upstream returned an error |
Sample record:
{"dataset_id": "d_8b84c4ee58e3cfc0ece0d773c8ca6abc","record_id": 1,"fields": ["_id", "month", "value"],"values": { "_id": 1, "month": "2026-04", "value": 1234 },"last_updated": null,"resource_name": "d_8b84c4ee58e3cfc0ece0d773c8ca6abc","organization": null,"scrapedAt": "2026-05-29T10:00:00.000Z","error": null}
✨ Why choose this Actor
| 🆓 | Calls the fully public Singapore API, no key. | | 🧹 | Returns clean rows with explicit field list. | | 🔁 | Auto-pagination across all rows. | | 🛟 | Errors surfaced as clean records. | | 💾 | Push to dataset, instant download. |
📈 How it compares to alternatives
| Approach | Setup time | Clean keys | Numeric casting | Error handling |
|---|---|---|---|---|
| Roll your own fetch | 30 min plus | ❌ | ❌ | ❌ |
| Manual download | hours | ❌ | ❌ | ❌ |
| This Actor | 5 sec, no install | ✅ | ✅ | ✅ |
🚀 How to use
- Click Try for free.
- Fill in the input fields (defaults work for a first run).
- Click Start. Your dataset is ready in seconds.
💼 Business use cases
📊 Analytics dashboards. Pipe to a BI tool, refresh on a schedule.
💼 Internal data products. Mirror the source into your own warehouse.
📰 Newsroom fact-checking. Verify any number before publishing.
🤖 ML feature engineering. Use the clean dataset as model input.
🔌 Automating Singapore data.gov.sg Datasets Scraper
- Make and Zapier: trigger on a schedule, push to Airtable or Slack.
- Cron schedule: native Apify scheduler.
- Webhooks: receive a POST when a run finishes.
- Pipe to BigQuery, Snowflake, Postgres: native Apify integrations.
🌟 Beyond business use cases
🎓 Education. Bring real public data into classrooms.
🧪 Personal research. Track indicators or markets over time.
🤝 Non-profit and open data. Build public dashboards.
🧰 Tinkering. Prototype quickly with structured data.
🤖 Ask an AI assistant about this scraper
Paste this README into ChatGPT or Claude and ask it to map your workflow to the actor inputs. The schema, examples and field list above contain everything an LLM needs to design a working pipeline.
❓ Frequently Asked Questions
❓ Do I need an API key? No, the source is fully public.
❓ Is there a rate limit? The upstream enforces a soft limit. Avoid hammering.
❓ Can I schedule runs? Yes, via Apify scheduler, Make, Zapier or cron.
❓ Are values cast to numbers? Yes where applicable.
❓ How are errors handled? Pushed as a single record with error populated.
❓ Is this scraping or API? Public API or feed.
❓ Will the schema change? Core fields are stable.
❓ Can I filter the results? Yes, see the input schema above.
❓ What if the upstream changes? We update the actor.
❓ What format can I download? CSV, Excel, JSON, JSONL, XML, RSS, HTML straight from the Apify dataset UI.
🔌 Integrate with any app
Apify ships native integrations with Make, Zapier, Slack, Discord, Google Drive, Google Sheets, Gmail, Airbyte, Keboola, Telegram, GitHub, and any REST API or webhook endpoint.
🔗 Recommended Actors
| Actor | What it does |
|---|---|
| ParseForge Alpha Vantage Scraper | Global market data and FX. |
| ParseForge OurAirports Scraper | Global airport database. |
| ParseForge NBA Stats Scraper | Player and team stats. |
| ParseForge CurseForge Mods Scraper | Public mod metadata. |
💡 Pro Tip: browse the complete ParseForge collection for 900+ production-grade scrapers across business intelligence, real estate, e-commerce, sports, finance, and public records.
Disclaimer: This actor scrapes only publicly available data. ParseForge is not affiliated with, endorsed by, or sponsored by any of the third-party services referenced. Users are responsible for complying with the target site's terms of service and applicable law. Create a free account w/ $5 credit.