Medium Scraper - Articles by Author, Publication & Tag

Scrape Medium articles from any author, publication, tag or custom-domain Medium blog. Add as many sources as you like and get clean, deduplicated rows with title, author, date, tags, cover image and text, for $6 per 1,000 articles.

• Authors: @karpathy, https://medium.com/@karpathy or https://karpathy.medium.com. Full article text, word count and reading time.
• Publications: towards-data-science, any medium.com/<publication> URL, or a custom-domain Medium blog.
• Tags: artificial-intelligence, "machine learning". Returns the newest articles under each tag.
• Filters: keywords, published in the last N days. You only pay for articles that pass.
• Fast and cheap: uses Medium's own public feeds. No login, no proxy, no browser. Runs in seconds.

Output

{
  "articleId": "a64152b37c35",
  "title": "Software 2.0",
  "url": "https://karpathy.medium.com/software-2-0-a64152b37c35",
  "author": "Andrej Karpathy",
  "publishedAt": "2017-11-11T22:18:53+00:00",
  "updatedAt": "2021-03-13T18:18:43.264Z",
  "tags": ["programming", "software-development", "artificial-intelligence", "future", "machine-learning"],
  "image": "https://cdn-images-1.medium.com/max/1017/1*CHcu2L0NmAZwCpQgmS1ByA.jpeg",
  "excerpt": "I sometimes see people refer to neural networks as just another tool in your machine learning toolbox...",
  "isFullText": true,
  "wordCount": 2127,
  "readingTimeMinutes": 8,
  "text": "I sometimes see people refer to neural networks as ...",
  "source": "@karpathy",
  "feedTitle": "Stories by Andrej Karpathy on Medium"
}

Export to JSON, CSV, Excel or Google Sheets, or send it to Make, Zapier or n8n.

Use cases

• Content monitoring: schedule daily runs on tags or competitors' publications with publishedWithinDays: 1.
• Datasets for LLMs and RAG: full plain-text articles from the authors you choose.
• Influencer and writer research: find who publishes most on a topic, and how often.
• Newsletters and aggregators: pull the newest articles on any topic into your pipeline.

Input

{
  "authors": ["@karpathy"],
  "publications": ["towards-data-science"],
  "tags": ["artificial-intelligence", "python"],
  "keywords": ["llm", "agent"],
  "publishedWithinDays": 7,
  "includeContent": true,
  "includeHtml": false
}

Pricing

$6 per 1,000 articles ($0.006 per article), only for articles that match your filters. No monthly rental.

FAQ

How many articles per source? Medium's feeds return the latest ~10 articles per author, publication or tag. For ongoing monitoring, schedule the Actor (for example daily) and every new article is captured.

Why is the text short for tags and publications? Medium only publishes a teaser in tag and publication feeds (isFullText: false). Author feeds include the full article. To get full text, add the article's author to authors.

Member-only (paywalled) articles? You get the metadata and whatever Medium makes public. Paywalled text isn't included.