Substack Scraper: Newsletter Posts, Reactions & Monitor avatar

Substack Scraper: Newsletter Posts, Reactions & Monitor

Pricing

from $1.00 / 1,000 posts

Go to Apify Store
Substack Scraper: Newsletter Posts, Reactions & Monitor

Substack Scraper: Newsletter Posts, Reactions & Monitor

Scrape any public Substack newsletter without a login: titles, dates, authors, tags, reactions, comments, restacks and text. Search a newsletter, filter by date or free posts, and use the built-in monitor to get only new posts.

Pricing

from $1.00 / 1,000 posts

Rating

0.0

(0)

Developer

Web Obsidians

Web Obsidians

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Categories

Features

Limited permissions

Share

Substack Scraper

Get the posts of public Substack newsletters in one clean format: title, subtitle, date, authors, tags, reactions, comments, restacks, word count, free or paid, cover image and text. Paste newsletter names or addresses, optionally search inside a newsletter, set a date range or keep only the free posts, and download the result.

Turn on Return only new posts and schedule the Actor to monitor newsletters: each run returns only the posts that appeared since the last run.

Why this Actor

  • No login, no API keys. It reads the public post list that every Substack newsletter publishes, on name.substack.com or on its own domain. No browser, no proxies.
  • The numbers that matter. Reactions, comments, restacks, word count, authors, tags, section and podcast link come with every post (null or an empty list when a post has none).
  • Free and paid posts. Every post says whether it is free or for paid subscribers. For a paid post you get its details and the short preview that Substack shows to everyone, never the paywalled text.
  • Full text on request. Turn on Include the full text to get the text of every free post.
  • Search and date range. Use Substack's own search inside a newsletter, or stop at a date.
  • Monitoring built in. The monitor remembers the newest post it returned and gives you only newer posts on the next run, oldest first.
  • Cheap and predictable. $1.00 per 1,000 posts, plus $0.00005 per run start. Platform usage is included.

Use cases

  • Newsletter research: see which posts, topics and authors get the most reactions and comments.
  • Competitor and market monitoring: watch newsletters and send each new post to Slack or a webhook.
  • Finding writers: collect authors, tags and engagement across the newsletters of a niche.
  • AI agents and analysis: give your agent the clean text of free posts with their dates and links.

How to use

  1. Add newsletters to Newsletters, one per line: astralcodexten, astralcodexten.substack.com, https://www.lennysnewsletter.com or a link to any of their posts.
  2. Optionally set a search word, a date range, free posts only, full text, or how many posts you want per newsletter.
  3. Click Start. Download the results as JSON, CSV or Excel, or send them on with Apify integrations and webhooks (for example to Slack).

Input example

This is the input of a real run of this Actor:

{
"publications": ["astralcodexten", "https://www.lennysnewsletter.com"],
"maxPostsPerPublication": 3,
"includeBody": true
}

Get only new posts every hour

Set Return only new posts to on and give the monitor a name (for example ai-newsletters). Then create a schedule in Apify Console. The first run returns the latest posts and remembers where it stopped. Each later run returns only posts that are newer than the last post it returned, oldest first. If a run could not return everything (your per-newsletter limit or your maximum cost per run was reached), the rest is returned by the next run. You pay only for the posts that are returned.

Output

Each post is one item in the dataset. This is a real item from a run of this Actor, shortened (the image link and the text are cut):

{
"publication": "www.lennysnewsletter.com",
"postId": 224206488,
"title": "State of the tech job market: late 2026",
"subtitle": "PMs are winning, engineers are plateauing, designers are hurting, and the biggest AI hiring boom isn’t in software",
"url": "https://www.lennysnewsletter.com/p/state-of-the-tech-job-market-late",
"date": "2026-11-10T15:04:03Z",
"audience": "paid",
"type": "newsletter",
"authors": ["Lenny Rachitsky"],
"tags": ["Career"],
"reactions": 404,
"comments": 42,
"restacks": 37,
"wordcount": 2183,
"description": "PMs are winning, engineers are plateauing, designers are hurting, and the biggest AI hiring boom isn’t in software",
"coverImage": "https://substackcdn.com/image/fetch/…",
"podcastUrl": null,
"sectionName": null,
"text": "(the post preview text, cut here)",
"scrapedAt": "2026-11-19T05:25:13Z"
}

Field notes:

  • publication is the host name of the newsletter (astralcodexten becomes astralcodexten.substack.com; a custom domain stays as you wrote it). date and scrapedAt are UTC.
  • audience is free or paid. Any other value that Substack uses (for example founding) is passed on as it is.
  • type is the kind of post that Substack reports: newsletter, podcast, thread and so on. podcastUrl is the podcast link that Substack gives for the post, null for other posts.
  • authors and tags are lists of names. reactions, comments, restacks and wordcount are whole numbers, or null when Substack does not show one.
  • text is the short preview that Substack's post list shows. Some newsletters show no preview for their free posts; then text is null. With Include the full text on, text is the whole post as plain text for every free post: paragraphs are separated by a blank line, list items start with - , links keep only their words, and images are left out. A paid post always keeps its preview.
  • A per-newsletter summary (posts returned, any error, and with full text on, how many posts could not be read) is saved to the key-value store as SUMMARY.

Pricing

This Actor uses pay-per-event pricing:

  • $1.00 per 1,000 posts saved to the dataset ($0.001 per post).
  • $0.00005 per run start.

Platform usage (compute and storage) is included, and the full text costs nothing extra: it is still $0.001 per post. For example, 100 posts cost about $0.10, and an hourly monitor that returns 5 new posts a day costs about $0.19 a month ($0.15 for 150 posts plus $0.04 for 720 run starts). If you set a maximum cost per run, the Actor stops cleanly when it is reached.

FAQ

Which newsletters work? Any public Substack newsletter, on name.substack.com or on its own domain. A name that does not exist, an address that is not a Substack newsletter, and a link to a Substack profile or home page (substack.com/@name) are reported in SUMMARY with an error and cost nothing.

Do I need a Substack account? No. The Actor reads the same post list that anyone can open without logging in.

Does it get paid posts? It lists them with their title, date, authors, tags and numbers, but it does not collect the paywalled text. For a paid post text is only the preview that Substack shows to everyone.

What does it not get? The text of comments, subscriber lists, Notes, and anything that sits behind a paywall or a login.

How many posts can I get? Up to 10,000 posts per newsletter in one run, newest first (1,000 when the full text is on). Substack gives 25 posts per request and the Actor pauses between requests, so a large run takes a few minutes. The full text needs one more request for each free post.

How do the search and the date range work? dateFrom and dateTo are UTC days (for example 2026-11-01) and both days are included. Without a search, the Actor reads from the newest post backwards and stops when it reaches dateFrom. Substack ranks search results by relevance, not by date, so with a search the Actor reads all the results and keeps the ones inside your date range.

How does the monitor know what is new? It remembers the date and id of the newest post it returned for each newsletter. A post that was written long ago but published today is new, because the publication date decides. Each monitor run looks at the newest 2,000 posts that are newer than the last returned one, so run it more often for a very busy newsletter.

Why are some numbers different from what I see on Substack? Reactions, comments and restacks are the numbers that Substack reports at the moment of the run, and they keep changing.