Substack Scraper – Posts, Newsletters & Stats

Scrape posts from any Substack newsletter, including those on custom domains: title, subtitle, publish date, free or paid, authors, likes, comments, restacks, word count, tags, cover image and the full text of free posts. Scrape many publications in one run, or find publications by keyword. An only-new mode makes it a cheap daily monitor.

What data can I get?

Field	Example
publication, publicationName, publicationSubscribers	www.lennysnewsletter.com, name and free-subscriber count (when found through search)
title, subtitle, url	post title, subtitle and canonical link
publishedAt, updatedAt	ISO dates
audience, isPaid	free / paid / founding, true
authors	["Lenny Rachitsky"] (names as printed on the post)
likes, comments, restacks	371, 18, 9
wordCount, tags, language, type	933, ["Career"], en, newsletter / podcast / thread
coverImage, podcastUrl	image and audio links
bodyText, bodyTruncated	full text of free posts; the public preview of paid posts, flagged true

How much does it cost?

$2 per 1,000 posts. You pay only for posts delivered. Scraping the last 50 posts of 10 newsletters costs $1.

How do I use it?

1. Add publications, one per line: lenny, noahpinion.substack.com, https://www.lennysnewsletter.com, or a post URL.
2. Or type a topic in Find publications by keyword (e.g. AI agents) to discover newsletters and scrape them.
3. Set how many recent posts per publication, a date window, and free/paid.
4. Run, then download JSON, CSV or Excel, or call the API.

{
  "publications": ["lenny", "https://www.noahpinion.blog"],
  "searchQuery": "product management",
  "maxPublications": 10,
  "maxPostsPerPublication": 50,
  "postedAfter": "2026-01-01",
  "audience": "all",
  "includeBody": true
}

How do I monitor newsletters for new posts?

Turn on Only new posts and schedule the Actor. Each run looks at the newest posts of each publication (up to "Max posts per publication") and returns only the ones you haven't received yet, so you never pay twice for a post.

Use cases

• Content research: which topics get the most likes and comments in your niche.
• Competitor and creator tracking: every new post from a list of newsletters, in one sheet or feed.
• Sponsorship and partnerships: find newsletters by topic with their subscriber counts.
• AI and search pipelines: clean full text of free posts for summarisation or RAG.

FAQ

Can it read paid posts? No. It never logs in or bypasses the paywall. Paid posts come with their public preview and bodyTruncated: true.

Is it legal? It reads the same public JSON that Substack's own web app loads for any visitor. It does not collect subscriber lists, commenter names or emails.

Do I need a proxy? No. It runs at 256 MB without a proxy.

A custom-domain newsletter isn't found. Paste any post URL from it; the Actor reads the host from the link.

More scrapers by the same developer

• ATS Jobs Scraper: Job postings straight from company career boards on Greenhouse, Lever, Ashby, Workday, Workable, Recruitee and SmartRecruiters in one schema, with salary ranges and an only-new mode.
• Chotot Scraper: Scrape Chợ Tốt (chotot.com), Vietnam's largest classifieds site: cars, motorbikes, real estate, phones, laptops and more, with prices in VND, location and all item attributes. Pay per listing.
• EU Company Registry Scraper: Companies from the official open registries of France (SIRENE), Norway (Brønnøysund) and Finland (PRH): legal form, status, activity code, address, workforce and French revenue. New-registration monitoring.
• Events Scraper: Upcoming events in any city from Eventbrite, Meetup and Luma in one schema: time in UTC, venue, online or in person, organizer, price and attendance.
• Hacker News Scraper: Hacker News front page feeds, keyword search over stories and comments, and Who Is Hiring job posts parsed into company, role, location, remote, salary and stack. Only-new mode for alerts.
• Prediction Markets Scraper: Kalshi and Polymarket markets in one schema: yes/no probabilities, bid/ask, volume, liquidity, close time and results, with keyword and category filters and an only-changed mode for monitoring.
• Remote Jobs Scraper: Remote job listings from Himalayas, Remote OK, We Work Remotely, Jobicy and Arbeitnow in one schema, deduplicated across boards, with salaries and an only-new mode.
• SEEK, JobStreet & JobsDB Jobs Scraper: Job listings from SEEK (Australia, New Zealand), JobStreet (Malaysia, Singapore, Philippines, Indonesia) and JobsDB (Hong Kong, Thailand) in one schema, with salary, work type, classification and an only-new mode.
• Telegram Channel Scraper: Scrape public Telegram channels: posts, views, reactions, media, links, forwards, plus channel stats. Incremental mode for daily monitoring. Pay per post.
• Vietnam Jobs Scraper: Scrape job postings from VietnamWorks, TopCV and ITviec in one unified schema. Extract title, company, salary in VND/USD, location, level, skills, deadline and full description. Pay per job, JSON/CSV export, API and MCP access.