# Article & Main Content Extractor (Web Page to Markdown) (`signalfeed/article-extractor`) Actor

Get the readable main content of any web page as clean Markdown or text, with title, author, date and word count. Navigation, ads and boilerplate removed. Ideal for LLMs and RAG. Failures free. $0.50 per 1,000 pages.

- **URL**: https://apify.com/signalfeed/article-extractor.md
- **Developed by:** [Aaron Rabinowe](https://apify.com/signalfeed) (community)
- **Categories:** AI, Developer tools
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.30 / 1,000 pages

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Article & Main Content Extractor: any web page to clean Markdown

**Get just the readable content of web pages (the article, post or doc) as clean Markdown or plain text, for $0.50 per 1,000 pages.** Navigation menus, ads, footers, cookie notices and sidebars are stripped, and headings, lists, bold text and tables are kept. Each result includes the title, author, publish date, site name, description and word count. Failed URLs are never charged.

Example: Wikipedia's "Web scraping" article comes back as about 4,000 words of clean Markdown, and a Cloudflare blog post as about 1,600.

### What people use it for

- **LLMs, RAG & AI agents:** clean, token-efficient text for embeddings, summarization and question answering, without the menus and boilerplate that waste context.
- **Content monitoring & research:** pull the text of articles, blog posts and docs for analysis.
- **Archiving & reading tools:** save readable copies of pages.
- **Datasets:** build text corpora from lists of URLs.

### Input

```json
{ "urls": ["https://en.wikipedia.org/wiki/Web_scraping", "https://docs.python.org/3/tutorial/introduction.html"], "outputFormat": "markdown", "includeLinks": false, "maxPages": 500 }
```

### Output

`url`, `finalUrl`, `httpStatus`, `title`, `author`, `date`, `siteName`, `description`, `language`, `content`, `format`, `wordCount`, `scrapedAt`. URLs that fail (blocked, not HTML, no readable content) are listed with the reason in the `SUMMARY` record.

### Pricing

**$0.50 per 1,000 pages** ($0.0005 each) on the free plan, cheaper on larger Apify plans. Only successful extractions are charged.

### Good to know

- **Built for content pages.** Articles, blogs, docs and news extract best. Homepages and app-like pages have little "main content".
- **No JavaScript rendering.** Fast and cheap; pages that need JavaScript to show their text are reported as having no readable content.
- **Honest crawler.** It identifies itself as a bot (many sites, including Wikipedia, block disguised crawlers) and only fetches the URLs you give it.

### Frequently asked questions

**Why Markdown?**

Markdown keeps headings, lists and links while dropping menus, ads and footers, which makes it ideal input for LLMs, RAG and summarization.

**Does it get the author and date?**

Yes, when the page publishes them: title, author, publish date and word count are returned with the content.

**Does it work on JavaScript-heavy sites?**

It reads the server-rendered HTML, which works for most news sites, blogs and documentation. Pages that render only in the browser may return less text.

**How do I run it on a schedule?**

In Apify Console, open the Actor and click **Schedule**: hourly, daily or any cron expression. Each run's results land in a new dataset you can export as CSV, Excel or JSON.

**Can I call it from my own code or no-code tools?**

Yes. Use the Apify API or the official Python and JavaScript clients, or connect it to Make, Zapier, n8n, Google Sheets or a webhook through Apify's built-in integrations.

**Is there a free trial?**

Apify's free plan includes monthly platform credit, enough to test this Actor on your real data before paying anything.

### More tools from the same developer

- [Ats Jobs Scraper](https://apify.com/signalfeed/ats-jobs-scraper): every open job from a company's careers page (Workday, Greenhouse, Lever, Ashby and more)
- [Tech Job Search](https://apify.com/signalfeed/tech-job-search): search 4,400+ tech and startup career pages by keyword
- [Remote Jobs Search](https://apify.com/signalfeed/remote-jobs-search): remote roles straight from company career pages
- [Job Salary Data](https://apify.com/signalfeed/job-salary-data): real salary ranges from live job postings
- [Hiring Companies Finder](https://apify.com/signalfeed/hiring-companies-finder): companies hiring for a role right now (sales hiring signals)
- [Website Contact Extractor](https://apify.com/signalfeed/website-contact-extractor): emails, phones and social profiles from a list of websites
- [Domain Intelligence](https://apify.com/signalfeed/domain-intelligence): WHOIS/RDAP dates, DNS, email provider and tech stack for domains
- [Sitemap Url Extractor](https://apify.com/signalfeed/sitemap-url-extractor): every URL a website lists in its sitemaps
- [Website Screenshot](https://apify.com/signalfeed/website-screenshot): full-page and mobile screenshots without cookie banners
- [Pdf Text Extractor](https://apify.com/signalfeed/pdf-text-extractor): text from PDFs at any URL, page by page
- [Rss Feed Reader](https://apify.com/signalfeed/rss-feed-reader): any RSS or Atom feed as clean JSON

Questions or a feature request? Open an issue on the Actor's **Issues** tab and I'll usually reply within a day.

# Actor input Schema

## `urls` (type: `array`):

Article, blog, docs or news page URLs.

## `outputFormat` (type: `string`):

Markdown keeps headings, lists, bold and tables; plain text is just the words.

## `includeLinks` (type: `boolean`):

Keep hyperlinks in the Markdown.

## `includeTables` (type: `boolean`):

Keep tables found in the main content.

## `maxPages` (type: `integer`):

You are charged per successfully extracted page.

## Actor input object example

```json
{
  "urls": [
    "https://en.wikipedia.org/wiki/Web_scraping"
  ],
  "outputFormat": "markdown",
  "includeLinks": false,
  "includeTables": true,
  "maxPages": 100
}
```

# Actor output Schema

## `pages` (type: `string`):

No description

## `summary` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "https://en.wikipedia.org/wiki/Web_scraping"
    ],
    "maxPages": 100
};

// Run the Actor and wait for it to finish
const run = await client.actor("signalfeed/article-extractor").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "urls": ["https://en.wikipedia.org/wiki/Web_scraping"],
    "maxPages": 100,
}

# Run the Actor and wait for it to finish
run = client.actor("signalfeed/article-extractor").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "https://en.wikipedia.org/wiki/Web_scraping"
  ],
  "maxPages": 100
}' |
apify call signalfeed/article-extractor --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,signalfeed/article-extractor"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/pUi9OzwSLQVfZkC4m/builds/zi2Vrlz6lx7V6aUGg/openapi.json
