Substack Scraper: Posts, Full Text & Newsletter Data
Pricing
from $1.00 / 1,000 posts
Scrape any Substack newsletter, custom domains too: every post with full text as clean Markdown, likes, comments, restacks, tags, authors, paid/free flag and subscriber counts. Optional comments and Substack-wide keyword search. Fast JSON, no browser. Built for AI/RAG and research.
Newsletter URLs (https://name.substack.com), custom domains (www.lennysnewsletter.com), bare subdomains (lenny), author handles (@lenny) or single post URLs (…/p/post-slug).
[ "https://www.lennysnewsletter.com", "oneusefulthing"]Keyword search across every Substack newsletter (e.g. "AI agents", "creator economy"). Matching posts are returned in the same format. Leave empty to only scrape the newsletters above.
Upper limit of posts returned from the search query.
Newest posts first. 0 = the entire archive.
Only posts published on or after this date (e.g. 2026-01-01) or within a relative window (e.g. 7 days). Great for daily or weekly scheduled runs. Empty = any date.
Keep all posts, only free (public) posts, or only paid/subscriber posts. Paid posts include the free preview only.
Adds the post body as clean Markdown, plain text and HTML. For paid posts you get the public free preview and paywalled: true. Turn off for metadata-only runs.
Also return the original body HTML (content_html). Turn off to keep datasets small when you only need Markdown/text.
Adds public comments and replies to each post (charged per comment).
Upper limit of comments (including replies) per post when comments are on.