Medium Scraper – Articles by Tag, Author, Publication or Search

Turn Medium into a clean dataset. Give it topic tags, authors, publications, keywords or single article links, and get one row per article with the title and subtitle, author name and profile, publication, publish and update dates, reading time, word count, clap count, number of responses, tags, cover image and whether the story is behind the member paywall. Switch on Include full article text to also get the body as Markdown and plain text.

Feeds are paginated, so you are not limited to the ten latest stories an RSS feed shows: ask for 500 articles from a tag or an author's whole back catalogue.

What people use it for

• Content research and trend spotting – see which stories in a topic collect the most claps and responses this week, month or year.
• Competitor and creator monitoring – track what an author or publication posts and how each story performs.
• Datasets for AI and NLP – collect free articles as Markdown with tags and language for training, retrieval or summarisation.
• Newsletters and aggregators – pull the newest stories for a set of tags on a schedule.
• Outreach – find active writers in a niche with their profile links.

How to use it

1. Add one or more inputs: Tags (machine-learning), Authors (@karpathy), Publications (better-programming or a custom domain such as levelup.gitconnected.com), Search keywords or Article URLs.
2. For tags, choose the feed order: newest, trending, or top stories of the week, month, year or all time.
3. Set Max articles per input (default 50).
4. Tick Include full article text if you need the body.
5. Run, then download JSON, CSV or Excel, or read the dataset through the API.

Output example

{
  "id": "a64152b37c35",
  "url": "https://karpathy.medium.com/software-2-0-a64152b37c35",
  "title": "Software 2.0",
  "subtitle": "I sometimes see people refer to neural networks as just “another tool in your machine learning toolbox”. They have some pros and cons, they…",
  "authorName": "Andrej Karpathy",
  "authorUsername": "karpathy",
  "authorUrl": "https://medium.com/@karpathy",
  "publicationName": null,
  "publishedAt": "2017-11-11T22:18:53.751Z",
  "readingTimeMinutes": 8.8,
  "wordCount": 2146,
  "claps": 61027,
  "responses": 194,
  "tags": ["machine-learning", "artificial-intelligence", "programming", "software-development", "future"],
  "imageUrl": "https://miro.medium.com/v2/resize:fit:1400/1*CHcu2L0NmAZwCpQgmS1ByA.jpeg",
  "isMemberOnly": false,
  "language": "en",
  "markdown": "## Software 2.0\n\nI sometimes see people refer to neural networks as ...",
  "contentIsPreview": false,
  "sourceType": "author",
  "sourceValue": "@karpathy"
}

markdown, text and contentIsPreview appear only with Include full article text. Member-only stories return the public preview, flagged with contentIsPreview: true.

Pricing

You pay per article in the dataset. Inputs that fail (unknown tag, removed article) are listed in the dataset for free.

Apify plan	Price per 1,000 articles
Free	$5.00
Starter	$5.00
Scale	$5.00
Business	$5.00

Full text is included at no extra charge.

FAQ

Can it read member-only articles in full? No. It works without a login, so paywalled stories come with metadata and the free preview only.

Why can a tag return fewer articles than I asked for? Some feeds are short, and an article that already appeared under another input in the same run is not repeated.

Does it work with custom-domain publications? Yes, enter the domain in Publications or paste article links from it.

Legal note: this Actor collects publicly available information. You are responsible for using the data in line with Medium's terms, copyright and privacy law in your jurisdiction.