# AEMO NEM Market Data Scraper (`parseforge/aemo-nem-market-data-scraper`) Actor

Scrapes electricity market data tables and file links from AEMO's NEMWeb portal. Returns each row as a flat record for export to CSV, JSON, Excel, or XML.

- **URL**: https://apify.com/parseforge/aemo-nem-market-data-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** Other
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $192.48 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### AEMO NEM Market Data Scraper

**Scrape electricity market data from AEMO's NEMWeb portal, including price, demand, and dispatch tables.** Every record captures the raw data as published, ready for CSV, JSON, Excel, or XML export. No API key required.

AEMO's NEMWeb portal publishes critical National Electricity Market data, but manually downloading and parsing the ZIP and CSV files is slow and repetitive. This scraper reads the public market data pages directly, collecting the latest tables and file links so you can feed them into your models and reports. It handles the navigation and extraction, returning a structured dataset from the URLs you provide.

| Who uses it | What they scrape AEMO NEMWeb for |
|---|---|
| Energy analysts | Feed real-time price and demand data into forecasting models. |
| Traders | Monitor dispatch and pricing tables for trading decisions. |
| Researchers | Gather historical market data for academic studies on grid behavior. |
| Market operators | Track regional price and demand figures for compliance reporting. |

### What it does

This Actor collects market data tables and file links from AEMO NEMWeb pages and returns each row as a flat record.

- 📊 **Structured extraction:** Tables from NEMWeb pages are parsed into rows and columns automatically.
- 🔗 **File link capture:** URLs to the latest ZIP and CSV data files are collected for downstream processing.
- ⚙️ **Configurable limits:** Set a maximum number of items to scrape, from a quick preview to a full-scale run.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with AEMO NEMWeb data

**📈 Feed short-term trading models.**

An energy trader runs the scraper on the dispatch and price pages every five minutes to update their automated bidding strategy.

**📋 Automate compliance reporting.**

A market operator collects daily regional demand and price summaries to populate a regulatory report with minimal manual effort.

**🔍 Research grid events.**

A PhD student scrapes historical data archives to analyze price spikes during a particular summer's heatwave.

**📊 Build internal dashboards.**

An analytics team schedules the scraper to feed a live dashboard showing NEM price and demand trends across all regions.

### Why choose this scraper

| | What you get |
|---|---|
| **No manual downloads** | Stop clicking through pages and unzipping files by hand. |
| **Always current** | Each run fetches the latest published data from the live portal. |
| **Flexible output** | Export to CSV, JSON, Excel, or XML for your existing toolchain. |

### How it compares

No other Store actor targets AEMO NEMWeb the same way, so the honest comparison is with the alternatives teams actually weigh.

| | AEMO NEM Market Data Scraper | Build it in-house | By hand |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When AEMO NEMWeb changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |

### Configure the run

Drive the Actor from one or more AEMO NEMWeb page URLs, and set a maximum item count to control the size of your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
 "startUrls": [
 {
 "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
 }
 ],
 "maxItems": 10
}
```

A larger pull:

```json
{
 "startUrls": [
 {
 "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
 }
 ],
 "maxItems": 200
}
```

### Pricing

Pay-per-result: **$0.21273 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $21.27 |
| 1,000 results | $212.73 |
| 10,000 results | $2127.30 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [AEMO NEM Market Data Scraper](https://apify.com/parseforge/aemo-nem-market-data-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to AEMO NEMWeb through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/aemo-nem-market-data-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that the URL you provided points to a valid AEMO NEMWeb page with data tables. The page structure may have changed; try a different URL or check the AEMO website directly.

**The scraper is only returning 10 items.**

This is the default preview limit for free accounts. If you have a paid plan, increase the 'Max Items' setting in the input up to 1,000,000.

**Some data is missing from the output.**

The scraper extracts what is publicly visible on the page. If a table is loaded dynamically after the page renders, it may not be captured. Verify the data is present in the page's initial HTML.

**The run fails with a timeout error.**

The target AEMO page may be slow to respond. Try increasing the run timeout in the Actor's advanced settings, or reduce the number of start URLs.

### FAQ

| Question | Answer |
|---|---|
| Do I need an AEMO API key or login? | No. This scraper reads the publicly accessible NEMWeb pages, so no registration or API key is required. |
| What data does this scraper collect? | It extracts the tables and file links present on the NEMWeb pages you target, such as price, demand, and dispatch data. The exact fields depend on the page, and a sample record is shown in the dataset preview. |
| Can I scrape historical market data? | Yes. If you provide URLs to historical archive pages on NEMWeb, the scraper will collect the data from those pages. |
| How many items can I scrape? | Free Apify users are limited to 10 items for a preview. Paid users can scrape up to 1,000,000 items per run by adjusting the max items setting. |
| What format is the exported data in? | You can export your dataset in CSV, JSON, Excel, or XML format from the Apify platform. |
| How do I target a specific data table? | Provide the exact URL of the NEMWeb page containing the table you want. The scraper will extract all tables and file links found on that page. |
| Does this scraper download the ZIP and CSV files? | It collects the URLs to those files. You can use another Actor or a simple script to download the files from the captured links. |
| Can I schedule this scraper to run automatically? | Yes. Apify's scheduler lets you set the scraper to run at regular intervals, such as every 5 minutes or daily. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Australian Energy Market Operator Limited. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `startUrls` (type: `array`):

AEMO NEMWeb page URLs to scrape market data from.

## `maxItems` (type: `integer`):

Free users: Limited to 10 items (preview). Paid users: Optional, max 1,000,000

## Actor input object example

```json
{
  "startUrls": [
    {
      "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
    }
  ],
  "maxItems": 10
}
```

# Actor output Schema

## `results` (type: `string`):

Complete dataset of all scraped records.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "startUrls": [
        {
            "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
        }
    ],
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/aemo-nem-market-data-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "startUrls": [{ "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb" }],
    "maxItems": 10,
}

# Run the Actor and wait for it to finish
run = client.actor("parseforge/aemo-nem-market-data-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "startUrls": [
    {
      "url": "https://aemo.com.au/en/energy-systems/electricity/national-electricity-market-nem/data-nem/market-data-nemweb"
    }
  ],
  "maxItems": 10
}' |
apify call parseforge/aemo-nem-market-data-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/aemo-nem-market-data-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/bzmTmCwhLy9guv1h0/builds/xNMOp1tmL59xP7oGg/openapi.json