AU News Monitor — ABC, news.com.au, AFR, SMH
Pricing
from $1.28 / 1,000 articles
AU News Monitor — ABC, news.com.au, AFR, SMH
Multi-source AU news: ABC News, news.com.au (DataDome bypass via curl_cffi), AFR, and SMH (RSS). Features anti-bot evasion, paywall-respecting extraction, keyword filtering, cross-run deduplication, and 365-day trend analysis.
Pricing
from $1.28 / 1,000 articles
Rating
0.0
(0)
Developer
HE Work
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
4 days ago
Last modified
Categories
Features
Share
✅ Checked daily. An automated test runs this Actor on the Apify cloud every day and checks that it still returns real data, so if the website changes and something breaks, it's caught the same day and fixed.
Multi-source Australian news aggregation from ABC News, news.com.au, Australian Financial Review (AFR), and Sydney Morning Herald (SMH). Includes keyword filtering, cross-run deduplication, and trend analysis.
Quick Overview
This actor monitors four major Australian news sources, extracting headlines, URLs, publication dates, and article snippets. It automatically deduplicates articles across runs (so you never see the same article twice) and optionally tracks keyword trends over time.
What you get:
- Headlines, URLs, publication dates, and snippets from all four sources
- Automatic category inference (politics, business, sport, technology, etc.)
- Cross-run deduplication — never see duplicate articles between runs
- Trend analysis — track keyword frequency and category distribution over up to 365 days
- Paywall-respecting — only publicly visible content is extracted
Use cases:
- Media monitoring and PR tracking
- Market intelligence and competitor research
- News aggregation services
- Research and academic data collection
Data Schema
| Field | Type | Description |
|---|---|---|
headline | string | Article headline/title |
url | string | Article URL |
source | string | abc, news.com.au, afr, or smh |
published | string | Publication date (ISO 8601) |
author | string | Article author (if available) |
snippet | string | Lead paragraph or description |
category | string | Inferred category: politics, business, sport, technology, world, entertainment, health, property, opinion, general |
word_count | integer | Word count of snippet |
scraped_at | string | When article was scraped (ISO 8601) |
Example output:
{"headline": "RBA holds interest rates steady for fifth consecutive month","url": "https://www.abc.net.au/news/2026-05-13/rba-interest-rates-hold/...","source": "abc","published": "2026-05-13T14:30:00+10:00","category": "business","snippet": "The Reserve Bank has left the cash rate unchanged at 3.85 per cent..."}
Input Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
sources | string[] | ["abc", "news.com.au", "afr", "smh"] | News sources to scrape |
keywords | string[] | [] | Filter articles by keywords (word-boundary matching) |
categories | string[] | [] | Filter by category: politics, business, sport, etc. |
maxPerSource | number | 0 | Max articles per source (0 = unlimited) |
includeTrends | boolean | false | Enable keyword trend analysis |
trendKeywords | string[] | [] | Keywords to track trends for |
Output
The actor provides:
- Article records — individual articles with all metadata
- Deduplication — articles previously seen in prior runs are excluded
- Trend analysis (optional) — keyword frequency and category distribution with up to 365-day history
Dataset views in Apify Console: Overview, By Category, Trends, and Full Detail. Export as JSON, CSV, XML, or Excel.
What Makes This Actor Different
- Only AU-specific multi-source news actor on Apify Store
- Cross-run deduplication — schedule daily and never see duplicate articles
- Trend analysis — track what topics are rising or falling in Australian media
- Paywall-respecting — only publicly visible content is extracted
- Extremely low cost — lightweight HTTP-based scraping, no browser required for most sources
Known Limitations
| Limitation | Details |
|---|---|
| AFR headlines only | Australian Financial Review has a hard paywall — article bodies are not extracted |
| SMH via RSS | Sydney Morning Herald uses their RSS feed (~20 most recent articles) — limited archive |
| Keyword filtering is post-scrape | All articles are collected first, then filtered — may return 0 results for narrow keywords |
| Trend data accumulates over time | Best results after multiple scheduled runs |
Example output
One item from a real run (long texts shortened):
{"headline": "Rugby league great Paul Langmack dies aged 61","url": "https://www.abc.net.au/news/2026-11-05/rugby-league-great-paul-langmack-dies-aged-61/107348920","source": "abc","published": "2026-11-05T00:00:00","author": null,"snippet": null,"category": "sport","word_count": null,"scraped_at": "2026-11-05T07:24:56+00:00"}
Alerts & workflows
Ready-made workflow: News monitor → Telegram / Slack. No Make or Zapier needed — set it in the input and schedule the Actor (e.g. daily).
- Give the run a Watch list name (e.g.
my-watch). Every run with that name remembers every article URL it has seen; each item getschange_status=new,changedorunchanged(changed items also carryprevious_value). - Turn on Only new / changed items to skip — and not pay for — items you've already seen.
- Add one or more destinations; after each run you get a digest of what's new or changed:
- Slack: an incoming-webhook URL.
- Telegram: bot token (from @BotFather) + chat ID.
- Discord: a channel webhook URL.
- Email: an address (sent with Apify's send-mail Actor).
- Google Sheets: open your sheet → Extensions → Apps Script, paste the script below, Deploy → New deployment → Web app (execute as you, access: anyone), and paste the web app URL into the input. Each new / changed item is appended as a row.
function doPost(e) {var rows = JSON.parse(e.postData.contents).rows || [];var sheet = SpreadsheetApp.getActiveSpreadsheet().getActiveSheet();if (!rows.length) return ContentService.createTextOutput("0");var head = sheet.getLastRow() ? sheet.getRange(1, 1, 1, sheet.getLastColumn()).getValues()[0] : [];if (!head.length) { head = Object.keys(rows[0]); sheet.appendRow(head); }rows.forEach(function (r) { sheet.appendRow(head.map(function (h) { return r[h] === undefined ? "" : r[h]; })); });return ContentService.createTextOutput(String(rows.length));}
Secrets (webhook URLs, bot tokens) are stored encrypted by Apify.
How it compares
| This Actor | Typical alternative | |
|---|---|---|
| Fields per result | 11 (see Example output) | Varies by actor |
| Freshness | Read live from the source when the run starts | Varies |
| Reliability | Tested daily by an automated run on the Apify cloud (see the top of this page) | — |
| Price | $1.50 per 1,000 articles | $2.00–$8.00 per 1,000 results (comparable Actors on the Apify Store, 6 Nov 2026) |
Pricing
Pay per result, no monthly fee:
- $1.50 per 1,000 articles: One news article delivered to your dataset.
- $0.0005 per run (start).
Bronze plans pay 5% less, Silver 10% less, Gold and above 15% less.
Examples: 1,000 articles = $1.50; 10,000 = $15.00.
Who Is This For?
- PR and media monitoring professionals tracking brand mentions
- Market intelligence teams monitoring industry news
- Researchers collecting Australian media data
- Journalists tracking story development across outlets
FAQ
Does this bypass paywalls? No — we extract only publicly visible content. AFR articles return headlines and URLs only, respecting the paywall. SMH uses their freely available RSS feed.
How does deduplication work? Each article URL is hashed and stored. On subsequent runs, previously seen articles are automatically excluded — you only get new content.
What's trend analysis? Enable includeTrends to track how often specific keywords appear over time. Trends accumulate across runs (up to 365 days of history).
Do I need a proxy? Most sources work without a proxy. For news.com.au, residential proxies improve reliability.
Built on the Apify platform. Part of the AU Data Suite — Australian web data for developers and businesses.