Medium Scraper

Slug: fatihtahta/medium-scraper

Overview

Medium Scraper turns any selection of Medium searches, profiles, or individual stories into a structured dataset that is ready for analysis or integration. Aim it at the Medium platform and it automatically collects rich blog post and author details—including publication metadata, engagement indicators, tags, and full text—so you can focus on insights instead of manual copy-paste.

Medium is one of the web’s most active publishing communities, making it a prime source for trend discovery, competitive tracking, and thought-leadership monitoring. This actor keeps the collection process hands-off, consistent, and dependable, freeing your team from repetitive research work.

Why Use This Actor

• Marketing and content teams can follow emerging themes, measure article performance, or curate inspiration with minimal effort.
• Market and competitive researchers capture story volume, positioning, and reactions for benchmarking or sentiment review.
• Product managers and founders watch topic-specific publications to surface customer narratives, pain points, and product chatter.
• Developers and data engineers enrich internal dashboards or build discovery tools with clean, ready-to-use Medium data.

Typical use cases include lead and partnership prospecting, competitive intelligence, market landscaping, editorial planning, and building searchable Medium directories. Every run delivers consistent results without manual intervention.

Input Parameters

Parameter	Type	Description	Default
pageAndProfileUrls	array	List of specific Medium stories or profile URLs to capture in detail.	–
searchResultType	string	Chooses the Medium search category (stories, profiles, publications, topics, or lists) when expanding your queries.	"Stories"
searchQueriesOrUrls	array	Medium search phrases or search results URLs to expand into comprehensive datasets.	–
limit	integer	Maximum number of records to save per input before the actor stops. Minimum of 10.	50000
proxyConfiguration	object	Connection setup for the run. The default Apify Residential proxy is preselected for reliability.	{ "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }

Example Input

{
  "pageAndProfileUrls": [
    "https://medium.com/@anilmatcha",
    "https://medium.com/@cly11204/from-goldman-to-green-tea-why-burnout-tastes-like-ceremonial-grade-0e6d3695ba53"
  ],
  "searchResultType": "Stories",
  "searchQueriesOrUrls": [
    "Youtube",
    "https://medium.com/search?q=youtube"
  ],
  "limit": 250,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Example Output

{
  "requestUrl": "https://medium.com/REDACTED/REDACTED",
  "postId": "REDACTED",
  "title": "Why Every Investment Banker  ... ",
  "mediumUrl": "https://medium.com/@cly11204/REDACTED3",
  "canonicalUrl": "https://medium.com/@cly11204/REDACTED",
  "subtitle": "Inside the Investment Banker-to-Matcha Brand Pipeline…",
  "firstPublishedAt": 1750182485763,
  "latestPublishedAt": 1750811376100,
  "readingTimeMinutes": 13.09433962264151,
  "wordCount": 3099,
  "clapCount": 31,
  "votersCount": 5,
  "isLocked": false,
  "isLockedPreviewOnly": false,
  "author": {
    "id": "REDACTED",
    "name": "REDACTED",
    "username": "REDACTED",
    "bio": "Product | UX | Business | Plant Mom | Gym Girlie",
    "imageId": "REDACTED"
  },
  "collection": null,
  "tags": [
    { "id": "business", "title": "Business", "slug": "business" },
    { "id": "banking", "title": "Banking", "slug": "banking" }
  ],
  "sections": [
    { "name": "c264", "startIndex": 0 }
  ],
  "paragraphs": [
    {
      "id": "f1569197a174_0",
      "name": "1f7c",
      "type": "IMG",
      "text": "Image courtesy of Unsplash",
      "layout": "INSET_CENTER",
      "href": null,
      "markups": []
    }
   .....
  ],
  "plainText": "Why Every Investment Banker is Starting a Matcha Company: A Business Breakdown..."
}

• requestUrl, mediumUrl, and canonicalUrl point to the exact story captured.
• postId uniquely identifies the Medium story.
• title, subtitle, and plainText summarize the written content.
• firstPublishedAt and latestPublishedAt are publication timestamps.
• readingTimeMinutes, wordCount, clapCount, and votersCount describe engagement and scope.
• author contains key profile information for the writer.
• tags, sections, and paragraphs break down topical coverage and structured content elements.

Notes & Limitations

Please use Medium Scraper responsibly and respect Medium’s terms of service and applicable data privacy regulations. Always ensure that the way you store, process, and share the collected information aligns with your legal obligations.

Support

Questions or custom needs? Open an issue on the Issues tab of the actor page in Apify Console and it will be resolved around the clock.

Happy Scraping,

• Fatih