Substack Scraper

Pricing

from $0.35 / 1,000 posts

Substack Scraper

Extract complete data from Substack newsletters including posts, authors, engagement metrics, and article text. 13 fields per post. Fast and reliable.

Pricing

from $0.35 / 1,000 posts

Rating

0.0

(0)

Developer

LIAICHI MUSTAPHA

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

19 hours ago

Last modified

What does this Actor do? 🎯

This actor scrapes Substack newsletters and extracts 13 data points per post:

Content Data

Post headline & subheading
Full article text (or preview for paid posts)
Post URL

Author Information

Author name
Author profile URL

Publishing Data

Publication date
Free vs Paid status

Engagement Metrics

Number of likes ❤️
Number of comments 💬
Number of restacks 🔄

Perfect for 💡

Content Researchers - Analyze trends across newsletters
Competitive Analysis - Track what competitors publish
Data Scientists - Build training datasets
Writers - Research popular topics
AI Developers - Collect training data

Input

{
  "substackUrls": [
    "https://tedhope.substack.com",
    "https://theankler.com"
  ],
  "scrapingMethod": "sitemap",
  "maxPostsPerSubstack": 100,
  "batchSize": 20
}

Field	Type	Required	Description
substackUrls	Array	Yes	List of Substack URLs
scrapingMethod	String	No	"sitemap" or "archive"
maxPostsPerSubstack	Number	No	Limit posts (0 = unlimited)
batchSize	Number	No	Substacks per batch

Output

{
  "substack_url": "https://example.substack.com",
  "post_url": "https://example.substack.com/p/post-title",
  "headline": "Amazing Post Title",
  "subheading": "Subtitle here",
  "author_name": "John Doe",
  "author_url": "https://substack.com/@johndoe",
  "date": "December 10, 2024",
  "free_or_paid": "Free",
  "likes": 156,
  "comments": 23,
  "restacks": 12,
  "article_text": "Full article content...",
  "content_type": "full"
}

Features ✨

Two scraping methods - Sitemap (fast) or Archive (fallback)
Complete metadata - 13 fields per post
Engagement metrics - Likes, comments, restacks
Smart extraction - Handles paywalled content
Structured output - Clean JSON/CSV format

Pricing 💰

Based on Compute Units (CUs):

Scale	Approximate Cost	Time
10 Substacks	$0.01-0.05	2-5 min
100 Substacks	$0.50-1.00	30-60 min
1,000 Substacks	$5-10	5-10 hours

Start with Apify's free tier - includes $5 monthly credit!

Tips 💪

Test first - Try 2-3 Substacks initially
Use sitemap - Faster and more reliable
Set limits - Use maxPostsPerSubstack for large newsletters
Schedule runs - Set up weekly/monthly automation

FAQ ❓

Q: Can I scrape paywalled content? A: You'll get previews for paid posts, not full content.

Q: How long does it take? A: ~10-30 seconds per Substack with 100 posts.

Q: What if sitemap doesn't work? A: Use "archive" method as fallback.

Support 📧

📖 Apify Documentation
💬 Contact Support

About 👨‍💻

Built by MUSTAPHA LIAICHI - Automation & Web Scraping Specialist

Happy Scraping! 🚀

Substack Scraper

qpayre/substack-scraper

The Substack Author Scraper is a powerful Apify actor that makes it easy for content creators to scrape and retrieve all posts from their favorite Substack authors. With structured data presented in a user-friendly format, analyzing and processing valuable information has never been easier.

QPS

358

Substack Posts Scraper 📚

easyapi/substack-posts-scraper

Scrape Substack posts and articles by keywords. Extract comprehensive post data including title, author, publication details, podcast information, reactions, and more. Perfect for content analysis and research.

EasyApi

5.0

(1)

Substack Leaderboard Scraper 📊

easyapi/substack-leaderboard-scraper

Scrape detailed publication data from Substack leaderboards. Get comprehensive insights about top newsletters including subscriber counts, pricing, author details, and more. Perfect for newsletter research and market analysis.

EasyApi

5.0

(1)

Substack Scraper

dacoder/substack-scraper

A powerful Apify actor that extracts data from Substack newsletters. Collects author profiles, post content, engagement metrics, and publication details. Perfect for content analysis, archiving, and competitive research. Outputs clean, structured data with clickable links and formatted images.

Da Coder

1.0

(1)

Substack Publications Scraper 📚

easyapi/substack-publications-scraper

Scrape detailed publication information from Substack based on keywords. Get comprehensive data about newsletters, authors, subscriber counts, and publication metrics in structured JSON format.

EasyApi

5.0

(1)

Substack Notes Scraper 🔍

easyapi/substack-notes-scraper

Extract notes and comments from Substack's search results with images, user info, and engagement metrics. Perfect for content analysis, user research, and tracking discussions around specific topics on Substack.

EasyApi

Substack Newsletter Scraper

red.cars/substack-newsletter-scraper

Extract newsletter content, subscriber counts, post analytics, and creator intelligence from any Substack publication - completely free, no authentication needed!

AutomateLab

1.0

(2)

Substack Leaderboards Scraper 📈📥 - Cheap

scrapestorm/substack-leaderboards-scraper---cheap

🔍 Scrape Substack Leaderboards Easily Enter a leaderboard URL (e.g. /browse/business) to collect top newsletters with author name, handle, bio, publication title, domain & more 🏅📊 Perfect for lead gen, influencer research, and automation with tools like Google Sheets ⚡🧩

Storm_Scraper

5.0

(1)

📚 Substack People Scraper

easyapi/substack-people-scraper

A powerful scraping tool that extracts comprehensive Substack author and publication data using keywords. Get detailed insights about writers, their publications, themes, and engagement metrics to understand the newsletter ecosystem.

EasyApi

5.0

(1)

Substack Leaderboard Scraper

saswave/substack-leaderboard-scraper

Substack leaderboard scraper. Collect data at scale about subscriptions. Get data about author, subscriptions plans details, number of subscriber, category, content type, ranking details by languages, show links and more

SASWAVE

Substack Newsletter Scraper

digispruce/substack-scraper

Extract comprehensive Substack newsletter data including author profiles, subscriber counts, social media links, and contact information for B2B outreach and market research.