# Sydney Morning Herald Article Scraper (`xtracto/smh-scraper`) Actor Extract article metadata and visible intro content from smh.com.au. Full articles require a Nine subscription. No browser needed - HTTP-only. - **URL**: https://apify.com/xtracto/smh-scraper.md - **Developed by:** [Xtractoo](https://apify.com/xtracto) (community) - **Categories:** News - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $5.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Sydney Morning Herald Article Scraper Extract article metadata, author, and available text from any **smh.com.au** article URL. The Sydney Morning Herald is Australia's oldest continually published newspaper, covering national politics, business, culture, and international affairs. ### Why Use This Actor? - **Australian news monitoring** - track Australia's most prominent broadsheet. - **Asia-Pacific perspective** - strong coverage of Australia, New Zealand, and Pacific region news. - **Metadata and headline extraction** - author, title, date, and intro paragraphs always available even under the paywall. ### How It Works This actor uses **only HTTP requests** - no browser, no Selenium, no Playwright. Articles are extracted in seconds with RAM usage well under 256 MB. > **Note:** SMH uses a Piano paywall (Nine platform). Only the intro paragraphs (typically 2–4) are freely visible. Author, title, description, and publication date are always extracted from structured metadata. ### Input ```json { "url": "https://www.smh.com.au/national/nsw/principal-teachers-accused-of-assaulting-multiple-school-boys-20260421-p5zprg.html", "urls": [ "https://www.smh.com.au/national/article-one.html", "https://www.smh.com.au/business/article-two.html" ], "mode": "article", "limit": 10 } ```` ### Output ```json { "url": "https://www.smh.com.au/goodfood/perth-eating-out/the-sandwich-and-90s-westraliana-rule-this-tiny-tuart-hill-bakery-20260515-p5zxln.html?ref=rss&utm_medium=rss&utm_source=rss_feed", "source": "Sydney Morning Herald", "title": "The sandwich and 90s Westraliana rule this tiny Tuart Hill bakery", "description": "Come for nostalgic house-baked treats: stay for the pitch-perfect homage to the suburban lunch bar and corner deli.", "content": "Strollio’s Luncheonette The life of a sourdough starter is a precarious one. One moment your owner is feeding you daily and (over)sharing stories of you online. The next you’re a mystery jar in the back of the fridge. Of all the calamities the sourdough community has faced, few have been asdisastrous as the Great Perth Starter Dry-up of 2020: an extinction event triggered by the easing of COVID restrictions and the reopening of restaurants, cafés and bars almost exactly six years ago to the day....", "image": "https://static.ffx.io/images/$zoom_0.1175%2C$multiply_0.7025%2C$ratio_1.777778%2C$width_1059%2C$x_0%2C$y_141/t_crop_custom/q_86%2Cf_auto/28f25ee04bb674768533fe6bc1d74827bc176fe15004614999326c95ba877a0e", "language": "en_AU", "word_count": 664, "published_date": "2026-05-15T17:00:00Z", "modified_date": "2026-05-15T17:00:00Z", "authors": [ "Max Veenhuyzen" ], "categories": "", "tags": "" } ``` ### Fetch Latest News Set `mode` to `"latest"` to fetch the newest article URLs and titles from SMH instead of extracting a single article. **Input:** ```json { "mode": "latest", "limit": 10 } ``` **Output** - array of objects: ```json [ { "url": "https://www.smh.com.au/business/companies/warner-bros-shareholders-approve-us110-billion-paramount-mega-merger-20260424-p5zqnk.html", "title": "Warner Bros shareholders approve $US110 billion Paramount mega-merger", "published_date": "Fri, 24 Apr 2026 01:18:46 +1000", "source": "Sydney Morning Herald" } ] ``` Source: `https://www.smh.com.au/rss/feed.xml` (RSS feed) ### Cron Schedule: Auto-Fetch Newest Articles Combine `mode: "latest"` and `mode: "article"` to keep a fresh feed running on autopilot: 1. **Schedule** a recurring run of this Actor with `{"mode": "latest", "limit": 20}` via Apify Schedules (UI ▸ Schedules ▸ Create new). A cron expression like `*/30 * * * *` runs it every 30 minutes. 2. **Webhook** the dataset of the latest run into another Actor run with `mode: "article"` and the new URLs as input — Apify integrations let you chain runs via the "Actor finished" webhook without any glue code. 3. The article-mode run extracts the full body, image, authors, and metadata for each URL and appends to your master dataset. Common cron expressions: | Frequency | Cron | |---|---| | Every 15 minutes | `*/15 * * * *` | | Hourly | `0 * * * *` | | Every 6 hours | `0 */6 * * *` | | Daily at 06:00 UTC | `0 6 * * *` | ### Other News Actors Need a different news source? All actors in this collection: | Actor | Source | |---|---| | [`aljazeera-scraper`](https://apify.com/xtracto/aljazeera-scraper) | Al Jazeera | | [`apnews-scraper`](https://apify.com/xtracto/apnews-scraper) | AP News | | [`bbc-scraper`](https://apify.com/xtracto/bbc-scraper) | BBC News | | [`bisnis-scraper`](https://apify.com/xtracto/bisnis-scraper) | Bisnis Indonesia | | [`cnbc-scraper`](https://apify.com/xtracto/cnbc-scraper) | CNBC | | [`dataindonesia-scraper`](https://apify.com/xtracto/dataindonesia-scraper) | Data Indonesia | | [`forbes-scraper`](https://apify.com/xtracto/forbes-scraper) | Forbes | | [`fortune-scraper`](https://apify.com/xtracto/fortune-scraper) | Fortune | | [`ft-scraper`](https://apify.com/xtracto/ft-scraper) | Financial Times | | [`guardian-scraper`](https://apify.com/xtracto/guardian-scraper) | The Guardian | | [`investors-scraper`](https://apify.com/xtracto/investors-scraper) | Investor's Business Daily | | [`msn-scraper`](https://apify.com/xtracto/msn-scraper) | MSN News | | [`nytimes-scraper`](https://apify.com/xtracto/nytimes-scraper) | New York Times | | [`reuters-scraper`](https://apify.com/xtracto/reuters-scraper) | Reuters | | [`scmp-scraper`](https://apify.com/xtracto/scmp-scraper) | South China Morning Post | | [`smh-scraper`](https://apify.com/xtracto/smh-scraper) | Sydney Morning Herald | | [`straitstimes-scraper`](https://apify.com/xtracto/straitstimes-scraper) | The Straits Times | | [`techcrunch-scraper`](https://apify.com/xtracto/techcrunch-scraper) | TechCrunch | | [`thestar-scraper`](https://apify.com/xtracto/thestar-scraper) | The Star (Malaysia) | | [`upi-scraper`](https://apify.com/xtracto/upi-scraper) | UPI | | [`yahoo-finance-scraper`](https://apify.com/xtracto/yahoo-finance-scraper) | Yahoo Finance | # Actor input Schema ## `url` (type: `string`): Single article URL to extract. ## `urls` (type: `array`): List of article URLs to extract. ## `mode` (type: `string`): Operation mode: 'article' to extract a single article (default), 'latest' to fetch newest headlines from the source's RSS feed. ## `limit` (type: `integer`): Number of latest articles to return when mode is 'latest'. Default: 10. ## Actor input object example ```json { "mode": "article", "limit": 10 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("xtracto/smh-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("xtracto/smh-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call xtracto/smh-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=xtracto/smh-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Sydney Morning Herald Article Scraper", "description": "Extract article metadata and visible intro content from smh.com.au. Full articles require a Nine subscription. No browser needed - HTTP-only.", "version": "1.0", "x-build-id": "xXVI3dLHmkhViH5R4" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/xtracto~smh-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-xtracto-smh-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/xtracto~smh-scraper/runs": { "post": { "operationId": "runs-sync-xtracto-smh-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/xtracto~smh-scraper/run-sync": { "post": { "operationId": "run-sync-xtracto-smh-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "url": { "title": "Article URL", "type": "string", "description": "Single article URL to extract." }, "urls": { "title": "Article URLs", "type": "array", "description": "List of article URLs to extract.", "items": { "type": "string" } }, "mode": { "title": "Mode", "enum": [ "article", "latest" ], "type": "string", "description": "Operation mode: 'article' to extract a single article (default), 'latest' to fetch newest headlines from the source's RSS feed.", "default": "article" }, "limit": { "title": "Limit", "type": "integer", "description": "Number of latest articles to return when mode is 'latest'. Default: 10.", "default": 10 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```