Pricing

from $1.99 / 1,000 results

Substack Newsletter Scraper

Substack Newsletter scraper extracts publicly available newsletter posts, titles, authors, publication dates, subscriber-facing content, and metadata 📰📊 Perfect for content research, trend analysis, competitive intelligence, and newsletter monitoring.

Pricing

from $1.99 / 1,000 results

Rating

0.0

(0)

Developer

Scrapers Hub

Actor stats

Bookmarked

Total users

Monthly active users

11 hours ago

Last modified

Input

Field	Type	Default	Description
`newsletterUrls`	array	–	List of newsletter URLs, e.g. `[{ "url": "https://www.lennysnewsletter.com" }]`. Custom domains and `*.substack.com` both work.
`postScrapingMode`	string	`information_and_content`	`information_only` (metadata only) or `information_and_content` (also fetch full post text).
`maxItems`	integer	`12`	Max items scraped overall, across all newsletters combined.
`delayBetweenRequests`	integer	`3000`	Delay between HTTP requests, in milliseconds.
`maxRetries`	integer	`2`	Retries per request before giving up (falls back to curl_cffi).

{
  "newsletterUrls": [
    { "url": "https://www.lennysnewsletter.com" },
    { "url": "https://andrewsullivan.substack.com" }
  ],
  "postScrapingMode": "information_and_content",
  "maxItems": 12,
  "delayBetweenRequests": 3000,
  "maxRetries": 2
}

Output

One dataset item per newsletter: author fields (author_*), publication fields (publication_*), leaderboard ranking, all_publications, and a posts array where each post has url, title, subtitle, date, author, likes, comments_count, content_preview, content, and word_count.

How it works

Fetch the newsletter homepage and extract the embedded window._preloads JSON (regex + parsel) → publication object.
Fetch the author's public profile (substack.com/api/v1/user/{handle}/public_profile) → follower count, socials, leaderboard, all publications.
List posts via /api/v1/archive, and (in content mode) fetch each post's body_html via /api/v1/posts/{slug}, then strip it to plain text.

Run locally

pip install -r requirements.txt
# via the Apify CLI (recommended):
apify run
# or drive the scraper directly without the Apify SDK:
python _local_test.py

📬 Contact & Support

Have a question, need a custom feature, or want to request data removal? Email us at scraperhubapi@gmail.com — we're happy to help.

Substack Scraper - Download Newsletter Content Fast

scrapers-hub/substack-scraper-download-newsletter-content-fast

Substack scraper extracts publicly available newsletter posts, titles, authors, publication dates, content, and metadata quickly 📰⚡ Perfect for content research, trend analysis, AI workflows, knowledge management, and newsletter monitoring.

Scrapers Hub

Substack Posts Scraper 📚

scrapers-hub/substack-posts-scraper

Substack Posts scraper extracts publicly available newsletter posts, titles, authors, publication dates, tags, post URLs, and metadata 📰📊 Perfect for content research, trend analysis, competitive intelligence, and newsletter monitoring.

Scrapers Hub

Substack Newsletter Scraper

red.cars/substack-newsletter-scraper

Extract newsletter content, subscriber data, and author insights from any Substack publication - no API key required!

AutomateLab

1.0

Substack Newsletter Author Lead Scraper

meticulous_snail/substack-newsletter-leads

Find Substack newsletter authors by topic and subscriber tier. Extract author name, newsletter name, category, subscriber signals, website, and social links. Perfect for newsletter sponsorship, media outreach, and content creator partnerships.

Beatsync Pro

Substack Posts Scraper for Newsletter Research

skootle/substack-posts

Scrape Substack posts, authors, publication names, dates, excerpts, URLs, and metadata for newsletter research, creator tracking, content monitoring, and AI agents.

Skootle

Substack Newsletter Scraper

cloud9_ai/substack-scraper

Scrape posts from any Substack newsletter publication. Returns post titles, URLs, publish dates, authors, and content previews via RSS feed.

cloud9

Substack Newsletter Scraper

opalescent_quintet/substack-newsletter-scraper

Substack-Newsletter-Scraper Extract complete newsletter archives from any Substack publication with advanced filtering, multiple export formats, and engagement analytics. ## Features - Scrape entire newsletter archives from Substack - Extract full metadata: titles, content, author details etc.

Aryan

Substack Posts Scraper - Newsletter Data Extractor

klondikeking/substack-posts-scraper

Extract posts, engagement metrics, and newsletter data from Substack publications. Perfect for content research.

Pierrick McD0nald

Substack Posts Scraper - Newsletter Data

benthepythondev/substack-posts-scraper

Scrape public Substack newsletter posts from one or many publications. Extract titles, authors, dates, full content, images, categories and post URLs.

Ben

Substack Scraper — Newsletter Posts & Content

fast_api/substack-scraper

Extract Substack newsletter posts, titles, subtitles, publication dates, engagement metrics, and optional full text. Useful for media monitoring, creator research, market intelligence, and AI/RAG datasets.