# AP News Scraper (`codingfrontend/ap-news-scraper`) Actor

Extract public AP News article metadata from home, section and article pages with optional author, topic and date filters.

- **URL**: https://apify.com/codingfrontend/ap-news-scraper.md
- **Developed by:** [Coding Frontned](https://apify.com/codingfrontend) (community)
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.99 / 1,000 results

This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

### What does AP News Scraper do?

AP News Scraper extracts public article metadata from [AP News](https://apnews.com/). Supply home, section, search or article URLs and receive headlines, canonical URLs, descriptions, authors, publication dates, sections, keywords and images. It is an unofficial AP News API alternative for media monitoring and research.

### Why use this scraper?

Build topic monitors, news dashboards, media research datasets, article popularity workflows and fact-checking queues from structured records. Use author, topic, category and date filters to keep a run focused. Apify provides repeatable schedules, API access, integrations and monitoring.

### What data can it extract?

| Field | Type | Description |
| --- | --- | --- |
| recordType, headline, url | string | Stable article discriminator, identity and canonical link |
| description | string | Public summary metadata |
| author, publisher | string | Attribution metadata |
| datePublished, dateModified | string | ISO 8601 timestamps when present |
| section, keywords | string/array | Editorial classification |
| image | string | Absolute lead image URL |
| sourceUrl, sourceDomain, extractionMethod, transport, scrapedAt | string | Source and extraction provenance |

### How to scrape AP News

1. Add one or more public AP News URLs to startUrls.
2. Set maxItems, choose whether to enrich article details, and optionally set author, topic, category or date filters.
3. Start the Actor and review the dataset.
4. Download JSON, CSV, HTML or Excel, or read the dataset through the API.

You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

### Pricing

Runs use normal Apify compute and network usage. A small maxItems value is useful for testing; schedule larger section or home-page collections when monitoring a beat.

### Input and output

See the input tab for all options. Dates in output are ISO 8601; fields unavailable in public metadata are omitted. The Actor collects metadata rather than reproducing full copyrighted article text.

### Troubleshooting and responsible use

AP News can change page layout or require client rendering for some sections. If a section returns no stories, try an article or section URL that is publicly accessible. Respect AP News terms, copyright and privacy laws, and use the data only for a legitimate purpose. Report issues through the Issues tab.

# Actor input Schema

## `startUrls` (type: `array`):

Public AP News home, section, search, or article URLs.

## `startUrl` (type: `string`):

Compatibility alias for one public AP News URL.

## `url` (type: `string`):

Compatibility alias for one public AP News URL.

## `urls` (type: `array`):

Compatibility alias for startUrls.

## `sourceUrls` (type: `array`):

Compatibility alias for startUrls.

## `maxItems` (type: `integer`):

Maximum unique article records to return.

## `limit` (type: `integer`):

Compatibility alias for maxItems.

## `includeDetails` (type: `boolean`):

Follow bounded next-page links on collection pages.

## `includeDiagnostics` (type: `boolean`):

Emit minimal rows for blocked, failed, invalid, or empty requests.

## `deduplicate` (type: `boolean`):

Remove repeated article URLs from the output.

## `author` (type: `string`):

Optional case-insensitive author filter.

## `topic` (type: `string`):

Optional text filter applied to headline, description, section, and keywords.

## `category` (type: `string`):

Optional AP News section filter.

## `fromDate` (type: `string`):

Inclusive ISO date in YYYY-MM-DD form.

## `toDate` (type: `string`):

Inclusive ISO date in YYYY-MM-DD form.

## `timeoutSeconds` (type: `integer`):

Maximum seconds per public request.

## `requestDelayMs` (type: `integer`):

Optional delay between bounded requests.

## `maxRetries` (type: `integer`):

Maximum retry count for transient failures.

## `maxPages` (type: `integer`):

Maximum bounded next pages to follow for each collection URL.

## `maxResponseBytes` (type: `integer`):

Safety limit while reading each public page.

## `fixtureFile` (type: `string`):

Relative bundled test/fixtures HTML or JSON file for deterministic local QA.

## `fixtureHtml` (type: `string`):

Bounded HTML fixture used only for the exact first URL.

## `fixtureUrl` (type: `string`):

Exact public AP News URL represented by fixtureHtml.

## Actor input object example

```json
{
  "startUrls": [
    "https://apnews.com/"
  ],
  "maxItems": 50,
  "includeDetails": true,
  "includeDiagnostics": true,
  "deduplicate": true,
  "timeoutSeconds": 30,
  "requestDelayMs": 0,
  "maxRetries": 1,
  "maxPages": 1,
  "maxResponseBytes": 5000000
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

## `keyValueStore` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("codingfrontend/ap-news-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("codingfrontend/ap-news-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call codingfrontend/ap-news-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,codingfrontend/ap-news-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/QZ6bVebzc8Frys6r2/builds/TM8paU0Ha8N5jBCUY/openapi.json
