# Medium Articles Scraper: posts, authors, publications, tags (`innocent_archipelago/medium-articles-scraper`) Actor

Scrape Medium articles and blog posts from tags (newest or top), authors, publications (custom domains too), search or URLs: title, author, claps, responses, reading time, tags, member-only flag, image, and the full text as Markdown if you want it. No login, $3 per 1,000.

- **URL**: https://apify.com/innocent\_archipelago/medium-articles-scraper.md
- **Developed by:** [Spyridon Pikoulas](https://apify.com/innocent_archipelago) (community)
- **Categories:** News, Social media, AI
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.00 / 1,000 articles

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Medium Articles Scraper

Get Medium articles, with their stats and optionally their full text, from any of five sources:

- **Tags:** the newest articles in a tag, its most-read of all time, or its most-read of a given
  month or year.
- **Authors:** everything a writer has published.
- **Publications:** a publication's articles, including ones on custom domains such as
  `betterprogramming.pub`.
- **Search:** the same results as Medium's own search.
- **Article URLs:** specific articles.

For each article you get the title, subtitle, author, publication, publish and update dates,
claps, responses, reading time, tags, whether it is member-only, the cover image and, if you ask
for it, the text as Markdown.

It reads Medium's own data API, so it needs no browser and no login, and it is fast: well over 100
articles in under 10 seconds. It costs **$3 per 1,000 articles**.

### What people use it for

- **Content research:** see what is working in a niche by finding the most-clapped articles in a
  tag, month by month.
- **Monitoring:** track new posts from a set of authors or publications.
- **AI and NLP datasets:** collect article text by topic.
- **Outreach:** find the writers who publish on your topic.

### How to use it

Fill in one or more of **Tags**, **Authors**, **Publications**, **Search queries** and
**Article URLs**. Then set **Max articles per source** and turn on **Include full text** if you
need the body.

```json
{
  "tags": ["python", "artificial-intelligence"],
  "topPeriod": "2026-08",
  "authors": ["@karpathy"],
  "publications": ["towards-data-science"],
  "maxArticlesPerSource": 200,
  "includeContent": true
}
```

### Output

```json
{
  "id": "a64152b37c35",
  "title": "Software 2.0",
  "subtitle": "I sometimes see people refer to neural networks as just “another tool in your machine learning toolbox”…",
  "url": "https://karpathy.medium.com/software-2-0-a64152b37c35",
  "author": "Andrej Karpathy",
  "authorUsername": "karpathy",
  "publication": null,
  "publishedAt": "2017-11-11T22:18:53.751000+00:00",
  "readingTimeMinutes": 8.8,
  "claps": 61025,
  "responses": 194,
  "memberOnly": false,
  "tags": ["machine-learning", "artificial-intelligence", "programming"],
  "imageUrl": "https://miro.medium.com/v2/resize:fit:1200/1*CHcu2L0NmAZwCpQgmS1ByA.jpeg",
  "source": "url:https://medium.com/@karpathy/software-2-0-a64152b37c35",
  "contentMarkdown": "## Software 2.0\n\nI sometimes see people refer to neural networks…"
}
```

Each article appears once per run, even when several sources list it.

### Use it as an API

One call runs it and returns the results as JSON (for runs under 5 minutes; longer ones start a
run and read its dataset). Apify's Python and JavaScript clients, and its Make, Zapier and n8n
integrations, work the same way.

```bash
curl -X POST "https://api.apify.com/v2/acts/innocent_archipelago~medium-articles-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"tags": ["python"], "maxArticlesPerSource": 10}'
```

### Pricing

You pay **$0.003 per article**, which is $3 per 1,000, full text included. Runs that go through
Apify's residential proxy also pay its traffic, $0.0012 per 100 KB. There are no monthly fees.

### Good to know

- Medium keeps about 18 articles in any "most read" list, so a tag's all-time or monthly top stops
  there. The newest-first order goes back as far as you ask.
- For member-only articles, Medium serves only the preview part of the text without a paid
  login. `contentIsPreview` tells you when that is the case.
- If Medium starts refusing requests on a very large run, turn on Apify Proxy in the input.

# Actor input Schema

## `tags` (type: `array`):

Medium tags, as in medium.com/tag/<tag>: python, artificial-intelligence.

## `tagSort` (type: `string`):

Order of the tag's articles.

## `topPeriod` (type: `string`):

YYYY or YYYY-MM: the tag's most-read articles of that year or month. Overrides tag order. Medium keeps about 18 articles in any most-read list.

## `authors` (type: `array`):

Usernames or profile URLs: @karpathy, https://medium.com/@karpathy, name.medium.com.

## `publications` (type: `array`):

Slugs, medium.com URLs or custom domains: towards-data-science, betterprogramming.pub.

## `searchQueries` (type: `array`):

Same results as Medium's own search.

## `articleUrls` (type: `array`):

Specific articles, on medium.com or a custom domain.

## `maxArticlesPerSource` (type: `integer`):

Per tag, author, publication or query.

## `includeContent` (type: `boolean`):

The article body as Markdown. For member-only articles Medium serves only the preview part.

## `proxyConfiguration` (type: `object`):

Use one if Medium starts refusing requests.

## Actor input object example

```json
{
  "tags": [
    "python"
  ],
  "tagSort": "newest",
  "maxArticlesPerSource": 100,
  "includeContent": false,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `overview` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "tags": [
        "python"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("innocent_archipelago/medium-articles-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "tags": ["python"] }

# Run the Actor and wait for it to finish
run = client.actor("innocent_archipelago/medium-articles-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "tags": [
    "python"
  ]
}' |
apify call innocent_archipelago/medium-articles-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,innocent_archipelago/medium-articles-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/paH8qUMoPVyIkbZwd/builds/p3Ru2rvQ5tT48LDE7/openapi.json
