Substack Scraper
Pricing
from $0.40 / 1,000 posts
Substack posts with their likes, comments, restacks and full text, found by keyword across all of Substack or read from the archives of newsletters you name. Comment threads, newsletter details and a new-posts-only mode are there for daily monitoring.
Row type
type
Required
Kind of row: newsletter, post or comment. Each type fills its own subset of the fields below; fields of the other types are absent.
Record key
key
Required
Stable key of the row: newsletter:, dir::: for directory listings, post: or comment:. The newOnly mode compares runs by this key.
ID
id
Optional
Substack ID of the object: the publication ID on newsletter rows, the post ID on post rows, the comment ID on comment rows. Null when Substack does not expose the publication ID.
Newsletter name
name
Optional
Name of the newsletter. Newsletter rows only.
Subdomain
subdomain
Optional
Substack subdomain of the newsletter, the part before .substack.com. Null when unknown. Newsletter rows only.
Custom domain
customDomain
Optional
Custom domain the newsletter uses instead of substack.com. Null when it has none. Newsletter rows only.
URL
url
Optional
On newsletter rows the home page of the newsletter (its custom domain when it has one); on post rows the canonical URL of the post.
Description
description
Optional
On newsletter rows the tagline shown on the home page; on post rows the post description, usually its subtitle or search snippet. Null when empty.
Logo
logo
Optional
URL of the newsletter logo. Null when none. Newsletter rows only.
Cover image
coverImage
Optional
Cover image URL: the newsletter cover photo on newsletter rows, the post cover image on post rows. Null when none.
Language
language
Optional
Language code of the newsletter, for example en. Null when not set. Newsletter rows only.
Launched at
launchedAt
Optional
When the publication was created on Substack, as an ISO 8601 UTC timestamp. Newsletter rows only.
First post at
firstPostAt
Optional
Date of the first post, as an ISO 8601 UTC timestamp. It can be earlier than launchedAt when an archive was imported. Newsletter rows only.
Paid subscriptions
paidEnabled
Optional
True when the newsletter takes paid subscriptions. Null when unknown. Newsletter rows only.
Paid subscriber tier
subscriberTier
Optional
Size of the paid audience as Substack words it, for example Tens of thousands of paid subscribers. Substack does not publish exact paid counts. Null when not shown, including small newsletters where Substack shows only how long ago they launched. Newsletter rows only.
Free subscribers
freeSubscribers
Optional
Free subscriber count Substack displays for the publication, often rounded. Null when hidden. Newsletter rows only.
Has podcast
hasPodcast
Optional
True when the newsletter publishes a podcast. Newsletter rows only.
Explicit
explicit
Optional
True when the newsletter is marked as explicit content. Newsletter rows only.
Directory category
category
Optional
Category the newsletter was listed in, for example Technology. Filled on directory listings only; null elsewhere.
Category ID
categoryId
Optional
Substack ID of that category, for example 4 for Technology. Directory listings only.
Rank
rank
Optional
Position of the newsletter in the category ranking, 1 being the top. Directory listings only; null elsewhere.
Ranking list
rankingList
Optional
Which ranking the position comes from: all (overall) or paid (by paid subscriptions). Directory listings only.
Checked at
checkedAt
Optional
When the newsletter was read, as an ISO 8601 UTC timestamp. Newsletter rows only.
Post slug
slug
Optional
URL slug of the post, the part after /p/. Post rows only.
Post title
title
Optional
Title of the post. Post rows only.
Post subtitle
subtitle
Optional
Subtitle of the post. Null when none. Post rows only.
Published at
publishedAt
Optional
When the post or comment was published, as an ISO 8601 UTC timestamp.
Audience
audience
Optional
Who can read the full post: everyone (free), only_paid or founding (founding members only). Post rows only.
Post type
postType
Optional
Kind of post: newsletter, podcast, thread or video. Post rows only.
Section
section
Optional
Newsletter section the post is filed under. Null when the newsletter has no sections. Post rows only.
Word count
wordCount
Optional
Length of the post in words, as Substack reports it. Post rows only.
Likes
likes
Optional
Number of likes (reactions): on the post for post rows, on the comment for comment rows. Null when not shown.
Restacks
restacks
Optional
Number of restacks, that is shares inside Substack. Post rows only.
Podcast audio URL
podcastUrl
Optional
Audio file URL of a podcast episode. Null for posts that are not podcasts. Post rows only.
Podcast duration (seconds)
podcastDurationSeconds
Optional
Length of the podcast episode in seconds. Null for posts that are not podcasts. Post rows only.
Preview text
previewText
Optional
Free preview of the post text as Substack cuts it for listings. Post rows only.
Body text
bodyText
Optional
Full text of the post as plain text, with paragraphs kept. Filled only when includeBody is on; for paywalled posts only the free part (see bodyIsPreview). Null otherwise. Post rows only.
Body HTML
bodyHtml
Optional
Body of the post as HTML, under the same conditions as bodyText. Null otherwise. Post rows only.
Body is preview
bodyIsPreview
Optional
True when the post is paywalled and the body holds only the free part. Null when the body was not requested. Post rows only.
Post ID
postId
Optional
ID of the post the comment belongs to. Comment rows only.
Post URL
postUrl
Optional
URL of the post the comment belongs to. Comment rows only.
Post title
postTitle
Optional
Title of the post the comment belongs to. Null when unknown. Comment rows only.
Parent comment ID
parentId
Optional
ID of the comment this one replies to; null for a top-level comment. Comment rows only.
Thread depth
depth
Optional
Nesting level in the thread: 0 for a top-level comment, 1 for a direct reply, and so on. Comment rows only.
Comment text
body
Optional
Text of the comment. Null when empty. Comment rows only.
Replies
replies
Optional
Number of direct replies to the comment. Comment rows only.
Edited
edited
Optional
True when the commenter edited the comment after posting. Comment rows only.
Search term
searchQuery
Optional
The keyword from searchQueries that found this post or newsletter. A post found by several keywords appears once, under the first. Null for rows read from newsletters.
Search position
searchRank
Optional
Position of the post in Substack's search results for that keyword, 1 being the first, counted before your filters. Search post rows only; null elsewhere.
Comments
comments
Optional
Number of comments on the post. Post rows only.