Medium Article Scraper — Articles, Tags & Authors

Extract public Medium RSS articles by tag, author, publication, URL, or tag-style query. Get titles, URLs, dates, tags, author data, images, word counts, and optional content as text or HTML.

What Can You Extract?

Field	Description
title / subtitle	Article title and subtitle
content / contentHtml	Optional article text or HTML from the RSS feed
author	Author name, username, and profile URL when available
tags	Topic tags
isMemberOnly	Whether article is behind paywall
publishedDate	Publication date (ISO 8601)
featuredImage	Cover image URL
wordCount	Approximate word count
language	Detected language

How to Use

Scrape by tag (zero-config):

{}

Extracts one article tagged "web-scraping" by default.

Scrape specific articles:

{
  "articleUrls": [
    "https://medium.com/@user/article-title-abc123",
    "https://betterprogramming.pub/some-article-def456"
  ]
}

Scrape by author:

{
  "authorUrls": ["https://medium.com/@towardsdatascience"],
  "maxArticlesPerSource": 10,
  "includeContent": true,
  "contentFormat": "text"
}

Scrape by publication with date filters:

{
  "publicationUrls": ["https://betterprogramming.pub"],
  "dateFrom": "2025-01-01",
  "memberOnly": "free"
}

Input Configuration

Parameter	Type	Default	Description
articleUrls	array	[]	Direct Medium article URLs
tags	array	["web-scraping"]	Medium topic tags
authorUrls	array	[]	Author profile URLs
publicationUrls	array	[]	Publication homepage URLs
searchQueries	array	[]	Query terms mapped to Medium tag feeds
maxArticlesPerSource	integer	1	Max articles per tag/author/publication/query
includeContent	boolean	false	Extract article content from the RSS feed
contentFormat	string	"text"	text or html
dateFrom	string	—	Filter: only articles after this date
dateTo	string	—	Filter: only articles before this date
memberOnly	string	"all"	all, free, or member_only
sortBy	string	"relevance"	relevance or latest

Output Example

{
  "url": "https://medium.com/@user/the-complete-guide-abc123",
  "articleId": "abc123",
  "title": "The Complete Guide to Web Scraping in 2026",
  "subtitle": "Everything you need to know",
  "author": {
    "name": "John Smith",
    "username": "johnsmith",
    "url": "https://medium.com/@johnsmith"
  },
  "content": "Full article text content...",
  "tags": ["web-scraping", "python", "automation"],
  "isMemberOnly": false,
  "publishedDate": "2026-02-15T10:30:00.000Z",
  "wordCount": 3200,
  "featuredImage": "https://miro.medium.com/...",
  "scrapedAt": "2026-03-11T12:00:00.000Z"
}

Edge Cases

• Member-only articles: The RSS marker is retained; content is included only when present in the feed
• Custom domain publications: The actor requests the publication's /feed endpoint
• Unavailable feeds: No article rows or source event are emitted when a feed cannot be fetched
• Non-English articles: Unicode content is preserved; language detection is not performed

Pricing

$17.19 per 1,000 Medium sources processed ($0.01719 per tag, author, publication, or article source) using the live Store pricing entry and medium-source-processed event. A one-time actor-start event is scheduled at $0.0125 per run.

Platform usage handling follows the actor's live Store pricing entry.

Run Type	Sources	Cost
Tag research	1	$0.03
Author archive	10	$0.18
Publication scrape	100	$1.73
Research batch	1,000	$17.20

FAQ

Can I scrape member-only (paywalled) articles?

Titles, authors, dates, and tags are returned when present in the RSS feed. Member-only content is included only when the feed provides it; the actor does not bypass authentication.

What content formats are supported?

Plain text and HTML from the RSS feed.

Can I filter articles by date or popularity?

Use dateFrom and dateTo for date-range filtering. RSS does not expose a reliable clap count, so popularity filtering is not offered.

Does it work with custom domain publications?

Yes. Publications on custom domains (e.g., betterprogramming.pub) are detected as Medium via meta tags and extracted normally.

Can I use this for AI training data?

Text output can support downstream analysis and RAG workflows. Respect author copyright and do not republish content without permission.

---

Legal notice: Medium's ToS prohibits automated access, but article content is publicly available and indexed by search engines. Use responsibly. Do not circumvent authentication or republish scraped content.

Related actors by Junipr: Spotify Playlist Scraper | AI Content Detector