Medium Publication Scraper Pro

Enterprise-grade Medium data extraction with comprehensive filtering and multi-mode support

Description

Enterprise-grade Medium data extraction with comprehensive filtering and multi-mode support. Extract publications, authors, articles and trending content without API keys.

Features

📌 Status 🧠 Context [2026-03-12] — outputSchema description added (spec-005)

How It Works

This actor uses intelligent extraction with Apify's proxy infrastructure to gather public data from Medium Publication Scraper Pro. It handles authentication, pagination, and error recovery automatically.

Quick Start

# Run via Apify API
apify run -a red.cars/medium-publication-scraper

# Or configure input and click Run on:
# https://apify.com/red.cars/medium-publication-scraper

Using as an MCP Tool

Running on Apify Platform

Set API_KEY in your Apify Console secrets, configure input via the Actor input schema UI, and click Run.

Input Schema

Parameter	Type	Description	Default
mode	string	Choose what type of Medium data to extract Options: publication, author, articles, trending, tags, bulk	publication
urls	array	List of Medium URLs to scrape. Supports @username, @publication, and article URLs.	-
publications	array	List of Medium publication handles (e.g., @towards-data-science, @freecodecamp).	towards-data-science,freecodecamp
authors	array	List of Medium author handles (e.g., @tim, @medium).	tim,medium
tags	array	List of Medium topic tags to analyze (e.g., artificial-intelligence, startup, programming).	artificial-intelligence,startup,programming
maxArticles	integer	Maximum number of articles to extract per publication/author	100
includeContent	boolean	Extract complete article text content (may slow down scraper significantly)	false
includeMetrics	boolean	Extract claps, responses, and reading time data	true
includeAuthorInfo	boolean	Extract detailed author information and follower counts	true
extractionDepth	string	How deep to extract data from each source Options: basic, standard, comprehensive	standard
maxResults	integer	Maximum total number of items to extract across all sources	500
proxyType	string	Choose your preferred balance of cost vs reliability. Standard (Datacenter) is faster; Premium (Residential) is most reliable for high-security targets. Options: DATACENTER, RESIDENTIAL	RESIDENTIAL
debugMode	boolean	Enable minimal extraction for health checks and testing. Guarantees success within 300s.	false
checkOnly	boolean	When true, returns immediately with capability metadata without scraping. Used by AI agents to verify availability before committing to a paid run. Free, <5 seconds.	false

Output Schema

Field	Type	Description
results	string	Medium articles and publication posts with full content. Each result contains: type, title, url, excerpt, wordCount, content, author, publishedAt, tags, clapCount, cleanMarkdown. Use for thought leadership monitoring, content competitive analysis, writer discovery, industry trend research. AI agents: supply publication URL, author handle, or topic tag name.

Example Output

{
  "results": [
    {
      "url": "https://example.com/profile",
      "username": "example_user",
      "fullName": "Example User",
      "followersCount": 10000,
      "followingCount": 500,
      "postsCount": 250,
      "isVerified": false,
      "biography": "Example bio text",
      "latestPosts": [],
      "scrapedAt": "2026-03-23T13:24:22.675Z"
    }
  ]
}

Pricing

Use Cases

• Influencer Research: Identify and evaluate potential influencers by engagement metrics and audience quality
• Competitor Monitoring: Track competitor presence and activity on Target Platform
• Lead Generation: Build targeted lead lists from public profiles and contact information
• Market Intelligence: Gather market intelligence and trend data for business decisions
• Content Aggregation: Collect content for analysis, archiving, or republication

FAQ

Do I need an API key?

Yes, this actor requires an API key. Set it via the secret environment variable in Apify Console.

How does pricing work?

This actor uses Apify's Pay-Per-Event model. You are charged per successful result returned. No charge for queries that return zero results.

What are the rate limits?

Rate limits depend on your Apify plan. Higher-tier plans provide more compute units and faster extraction.

How do I increase success rate?

• Enable Premium (Residential) proxy for high-security targets
• Reduce concurrency for rate-limited profiles
• Use debug mode to test before full extraction

Can I run this on a schedule?

Yes, use Apify Scheduler to run this actor on a cron schedule for continuous monitoring.

How do I export to CRM?

Set exportFormat to salesforce or hubspot for direct CRM import format.

Troubleshooting

Error	Cause	Fix
NETWORK_ERROR	Network connectivity issue	Check internet connection, retry with proxy
VALIDATION_ERROR	Invalid input parameters	Review input schema and retry

Known Limitations

• Private accounts: Cannot extract data from private accounts without following
• Rate limiting: Platform may temporarily block repeated requests from same IP
• Data freshness: Extracted data reflects moment of extraction; historical data may be limited
• Proxy requirements: High-security targets may require residential proxy for reliable extraction
• Content limits: Platform-imposed limits on historical post retrieval

Legal

Data Source: the target platform (the target platform.com)

Terms of Service: This actor is provided for legitimate data collection purposes only. Users must comply with the target platform's Terms of Service and applicable laws. Red.cars is not responsible for misuse of this tool.

Privacy: All extracted data is processed in accordance with applicable privacy laws. Do not use this tool for unauthorized data collection or privacy-violating activities.

Attribution: When using the target platform data, comply with their attribution requirements and data policies.

---

red.cars Intelligence Fleet • apify.com/red.cars