Article Scraper — Extract Article Text & Metadata avatar

Article Scraper — Extract Article Text & Metadata

Pricing

from $2.40 / 1,000 article record returneds

Go to Apify Store
Article Scraper — Extract Article Text & Metadata

Article Scraper — Extract Article Text & Metadata

Scrape article text and metadata from public URLs: title, author, dates, headings, images, word count and reading time. USD 3 per 1,000 articles.

Pricing

from $2.40 / 1,000 article record returneds

Rating

0.0

(0)

Developer

Muhammad Afzal

Muhammad Afzal

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

0

Monthly active users

16 days ago

Last modified

Categories

Features

Limited permissions

Share

Article Scraper extracts readable article text and normalized metadata from public article URLs. Use it for research pipelines, search indexing, content migration, summarization, retrieval-augmented generation, and AI-agent workflows that need one clean record per URL.

What it returns

FieldDescription
textClean article text with common navigation, ads, scripts, and boilerplate removed
title, description, excerptPage title and short summaries
author, publishedAt, modifiedAtMetadata when declared by the source page
canonicalUrl, siteName, language, articleTypePage identity and content metadata
headings, imagesStructured article elements
wordCount, readingTimeMinutesContent size estimates
extractionMethod, warningsTransparent diagnostics about selection and missing metadata

When to use it

Use this actor when you already have public article URLs and need readable text plus metadata. It is not a search engine, sitemap crawler, PDF parser, browser automation tool, or authenticated/paywall bypass. JavaScript-only pages, login walls, and pages that expose no article content produce a successful diagnostic record with extractionMethod: "no-content" when the page can be fetched.

Input

{
"startUrls": [
{ "url": "https://example.com/news/article" },
{ "url": "https://example.org/blog/post" }
],
"maxResults": 10,
"includeHtml": false,
"responseFormat": "detailed"
}

startUrls is required and accepts public http or https URLs. maxResults is capped at 100. Set includeHtml to true to include cleaned article markup; it is false by default to keep agent responses compact. responseFormat: "concise" limits headings and image arrays but does not truncate text.

Output example

{
"sourceUrl": "https://example.com/news/article",
"canonicalUrl": "https://example.com/news/article",
"title": "A practical article title",
"description": "A short page summary",
"excerpt": "The first part of the cleaned article...",
"author": "Jane Doe",
"publishedAt": "2026-01-15T09:30:00Z",
"modifiedAt": null,
"siteName": "Example News",
"language": "en",
"articleType": "NewsArticle",
"text": "The cleaned article body...",
"html": null,
"headings": ["Introduction", "Conclusion"],
"images": ["https://example.com/image.jpg"],
"wordCount": 842,
"readingTimeMinutes": 5,
"extractionMethod": "article-element",
"warnings": [],
"extractedAt": "2026-08-13T10:00:00.000Z"
}

Pricing

This Actor uses pay-per-event pricing. These are the current Apify Store event prices:

EventPrice (USD)When it is charged
apify-actor-start$0.006251 FREE · $0.006094 BRONZE · $0.005938 SILVER · $0.005 GOLD and aboveActor Start — Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
article-record$0.003001 FREE · $0.002925 BRONZE · $0.00285 SILVER · $0.0024 GOLD and aboveArticle record returned — Charged once for each article record stored in the dataset.

Apify platform usage for this Actor run is included alongside the event prices above; no separate per-run platform-usage fee is passed to users.

This covers Apify platform usage for this Actor run. Other Apify products or usage outside this Actor run may still follow your account plan.

Reliability and limits

The actor uses public HTML requests with bounded retries and concurrency. It prefers an article or main container, then scores content-like blocks, and finally uses a body fallback. It does not execute page JavaScript or defeat bot challenges. Respect each website's terms, robots directives, copyright, and applicable privacy laws; only process content you are allowed to access and use.

AI-agent description

Extract clean article text and metadata from public web URLs for research, indexing, summarization, and retrieval workflows. Do not use for search, PDFs, authenticated pages, or paywall bypass. Returns one record per URL with title, author, dates, canonical URL, text, headings, images, word count, reading time, and warnings. Charged $0.003 per article returned plus a $0.006251 start fee per started GB of memory on the FREE tier.

Run Smart Article Extractor with the Apify API

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('muhammadafzal/smart-article-extractor').call({
"startUrls": [
{
"url": "https://example.com/"
}
],
"maxResults": 10,
"includeHtml": false,
"responseFormat": "detailed"
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

You can also run the Actor from Apify Console, schedules, webhooks, the REST API, Make, Zapier, n8n, or the hosted Apify MCP server.

Support

When reporting a problem, include the Actor run ID, a redacted input, the expected result, and a small public example URL when applicable. Do not post API tokens, cookies, credentials, or personal data in an issue.

Frequently asked questions

Can I schedule Smart Article Extractor?

Yes. Use an Apify schedule to run the same saved input at a chosen interval, then connect a webhook or integration to process the dataset when the run finishes.

How should I test a new input?

Begin with the prefilled example or a small limit. Confirm that the output fields, source coverage, runtime, and live charges match your workflow before increasing the scope.

How do I export the results?

Open the run's default dataset in Apify Console and export JSON, CSV, Excel, XML, or RSS. Applications can retrieve the same records through the Apify API client or REST dataset endpoint.

Can an AI agent call this Actor?

Yes. Add muhammadafzal/smart-article-extractor through the hosted Apify MCP server or call it through the API. The Actor's input and dataset schemas help agents construct valid requests and interpret returned records.