AU News Monitor — ABC, news.com.au, AFR, SMH avatar

AU News Monitor — ABC, news.com.au, AFR, SMH

Pricing

from $1.28 / 1,000 articles

Go to Apify Store
AU News Monitor — ABC, news.com.au, AFR, SMH

AU News Monitor — ABC, news.com.au, AFR, SMH

Multi-source AU news: ABC News, news.com.au (DataDome bypass via curl_cffi), AFR, and SMH (RSS). Features anti-bot evasion, paywall-respecting extraction, keyword filtering, cross-run deduplication, and 365-day trend analysis.

Pricing

from $1.28 / 1,000 articles

Rating

0.0

(0)

Developer

HE Work

HE Work

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

4 days ago

Last modified

Features

Limited permissions

Share

✅ Checked daily. An automated test runs this Actor on the Apify cloud every day and checks that it still returns real data, so if the website changes and something breaks, it's caught the same day and fixed.

Python

Multi-source Australian news aggregation from ABC News, news.com.au, Australian Financial Review (AFR), and Sydney Morning Herald (SMH). Includes keyword filtering, cross-run deduplication, and trend analysis.


Quick Overview

This actor monitors four major Australian news sources, extracting headlines, URLs, publication dates, and article snippets. It automatically deduplicates articles across runs (so you never see the same article twice) and optionally tracks keyword trends over time.

What you get:

  • Headlines, URLs, publication dates, and snippets from all four sources
  • Automatic category inference (politics, business, sport, technology, etc.)
  • Cross-run deduplication — never see duplicate articles between runs
  • Trend analysis — track keyword frequency and category distribution over up to 365 days
  • Paywall-respecting — only publicly visible content is extracted

Use cases:

  • Media monitoring and PR tracking
  • Market intelligence and competitor research
  • News aggregation services
  • Research and academic data collection

Data Schema

FieldTypeDescription
headlinestringArticle headline/title
urlstringArticle URL
sourcestringabc, news.com.au, afr, or smh
publishedstringPublication date (ISO 8601)
authorstringArticle author (if available)
snippetstringLead paragraph or description
categorystringInferred category: politics, business, sport, technology, world, entertainment, health, property, opinion, general
word_countintegerWord count of snippet
scraped_atstringWhen article was scraped (ISO 8601)

Example output:

{
"headline": "RBA holds interest rates steady for fifth consecutive month",
"url": "https://www.abc.net.au/news/2026-05-13/rba-interest-rates-hold/...",
"source": "abc",
"published": "2026-05-13T14:30:00+10:00",
"category": "business",
"snippet": "The Reserve Bank has left the cash rate unchanged at 3.85 per cent..."
}

Input Parameters

ParameterTypeDefaultDescription
sourcesstring[]["abc", "news.com.au", "afr", "smh"]News sources to scrape
keywordsstring[][]Filter articles by keywords (word-boundary matching)
categoriesstring[][]Filter by category: politics, business, sport, etc.
maxPerSourcenumber0Max articles per source (0 = unlimited)
includeTrendsbooleanfalseEnable keyword trend analysis
trendKeywordsstring[][]Keywords to track trends for

Output

The actor provides:

  1. Article records — individual articles with all metadata
  2. Deduplication — articles previously seen in prior runs are excluded
  3. Trend analysis (optional) — keyword frequency and category distribution with up to 365-day history

Dataset views in Apify Console: Overview, By Category, Trends, and Full Detail. Export as JSON, CSV, XML, or Excel.


What Makes This Actor Different

  • Only AU-specific multi-source news actor on Apify Store
  • Cross-run deduplication — schedule daily and never see duplicate articles
  • Trend analysis — track what topics are rising or falling in Australian media
  • Paywall-respecting — only publicly visible content is extracted
  • Extremely low cost — lightweight HTTP-based scraping, no browser required for most sources

Known Limitations

LimitationDetails
AFR headlines onlyAustralian Financial Review has a hard paywall — article bodies are not extracted
SMH via RSSSydney Morning Herald uses their RSS feed (~20 most recent articles) — limited archive
Keyword filtering is post-scrapeAll articles are collected first, then filtered — may return 0 results for narrow keywords
Trend data accumulates over timeBest results after multiple scheduled runs

Example output

One item from a real run (long texts shortened):

{
"headline": "Rugby league great Paul Langmack dies aged 61",
"url": "https://www.abc.net.au/news/2026-11-05/rugby-league-great-paul-langmack-dies-aged-61/107348920",
"source": "abc",
"published": "2026-11-05T00:00:00",
"author": null,
"snippet": null,
"category": "sport",
"word_count": null,
"scraped_at": "2026-11-05T07:24:56+00:00"
}

Alerts & workflows

Ready-made workflow: News monitor → Telegram / Slack. No Make or Zapier needed — set it in the input and schedule the Actor (e.g. daily).

  1. Give the run a Watch list name (e.g. my-watch). Every run with that name remembers every article URL it has seen; each item gets change_status = new, changed or unchanged (changed items also carry previous_value).
  2. Turn on Only new / changed items to skip — and not pay for — items you've already seen.
  3. Add one or more destinations; after each run you get a digest of what's new or changed:
    • Slack: an incoming-webhook URL.
    • Telegram: bot token (from @BotFather) + chat ID.
    • Discord: a channel webhook URL.
    • Email: an address (sent with Apify's send-mail Actor).
    • Google Sheets: open your sheet → Extensions → Apps Script, paste the script below, Deploy → New deployment → Web app (execute as you, access: anyone), and paste the web app URL into the input. Each new / changed item is appended as a row.
function doPost(e) {
var rows = JSON.parse(e.postData.contents).rows || [];
var sheet = SpreadsheetApp.getActiveSpreadsheet().getActiveSheet();
if (!rows.length) return ContentService.createTextOutput("0");
var head = sheet.getLastRow() ? sheet.getRange(1, 1, 1, sheet.getLastColumn()).getValues()[0] : [];
if (!head.length) { head = Object.keys(rows[0]); sheet.appendRow(head); }
rows.forEach(function (r) { sheet.appendRow(head.map(function (h) { return r[h] === undefined ? "" : r[h]; })); });
return ContentService.createTextOutput(String(rows.length));
}

Secrets (webhook URLs, bot tokens) are stored encrypted by Apify.

How it compares

This ActorTypical alternative
Fields per result11 (see Example output)Varies by actor
FreshnessRead live from the source when the run startsVaries
ReliabilityTested daily by an automated run on the Apify cloud (see the top of this page)—
Price$1.50 per 1,000 articles$2.00–$8.00 per 1,000 results (comparable Actors on the Apify Store, 6 Nov 2026)

Pricing

Pay per result, no monthly fee:

  • $1.50 per 1,000 articles: One news article delivered to your dataset.
  • $0.0005 per run (start).

Bronze plans pay 5% less, Silver 10% less, Gold and above 15% less.

Examples: 1,000 articles = $1.50; 10,000 = $15.00.


Who Is This For?

  • PR and media monitoring professionals tracking brand mentions
  • Market intelligence teams monitoring industry news
  • Researchers collecting Australian media data
  • Journalists tracking story development across outlets

FAQ

Does this bypass paywalls? No — we extract only publicly visible content. AFR articles return headlines and URLs only, respecting the paywall. SMH uses their freely available RSS feed.

How does deduplication work? Each article URL is hashed and stored. On subsequent runs, previously seen articles are automatically excluded — you only get new content.

What's trend analysis? Enable includeTrends to track how often specific keywords appear over time. Trends accumulate across runs (up to 365 days of history).

Do I need a proxy? Most sources work without a proxy. For news.com.au, residential proxies improve reliability.


Built on the Apify platform. Part of the AU Data Suite — Australian web data for developers and businesses.