Substack Publication Scraper
Pricing
from $1.50 / 1,000 post scrapeds
Go to Apify Store
Substack Publication Scraper
Pricing
from $1.50 / 1,000 post scrapeds
One or more Substack publications to scrape. Accepts a bare subdomain (e.g. "platformer"), a full URL (e.g. "https://newsletter.pragmaticengineer.com") or a custom domain (e.g. "www.astralcodexten.com"). The host is normalized automatically.
Maximum number of posts to fetch from each publication. The scraper paginates until this many are collected or the archive ends (1-5000).
Attach a compact publicationMeta object (name, description, author, logo, language, URL) to every post. One extra request per publication (reads the public RSS feed).
Also fetch the full article body for each post (body_html and a plain-text body_text). Free/public posts return the full text; paid posts return the public preview. This makes one extra request per post, so runs take longer.
How many publications to scrape at the same time (1-10).
Timeout for each request to the Substack API (5-120).
