Substack Scraper | $5 / 1k | All-In-One

Slug: fatihtahta/substack-scraper

---

Overview

Substack is home to independent newsletters, podcasts, and creators building direct relationships with their audiences. "Substack Scraper | $5 / 1k | All-In-One" automates the discovery and collection of public Substack information so you can keep pace with the latest voices and trends. The actor gathers key details from posts, publications, people, and notes, transforming hours of manual browsing into a structured dataset ready for analysis or enrichment.

Why Use This Actor

• Market researchers & analysts get a consistent pulse on emerging publications, content themes, and audience signals.
• Growth teams & lead generators build prospect lists around niche topics, authors, or subscriber thresholds.
• Product and partnership teams monitor creator activity, audience size, and social presence to qualify opportunities.
• Data professionals & developers integrate Substack insights into dashboards, CRMs, or internal knowledge bases without building their own scraper.

Use it for lead generation, competitive analysis, market mapping, content monitoring, or directory building—without the repetitive work.

Input Parameters

Parameter	Type	Description	Default
resultType	string	Select which Substack entities to return when running a search query (all results, posts only, publications only, people, or notes).	all
queries	array	Provide one or more search phrases to find matching Substack content or creators.	–
startUrls	array	Paste direct URLs to Substack searches, profiles, or individual posts to capture those pages.	–
limit	integer	Maximum number of results to save per input before the actor stops. Minimum value is 10.	50000
proxyConfiguration	object	Choose how the actor connects to Substack. Defaults to Apify Residential proxies for dependable coverage.	Default Apify Residential proxy

Example Input

{
  "resultType": "publications",
  "queries": ["climate tech", "digital media"],
  "startUrls": [
    "https://substack.com/@nymag",
    "https://substack.com/home/post/p-176435918"
  ],
  "limit": 2500
}

Example Output

Substack returns distinct entity types. Below are representative single-record samples for each to help you map the fields.

People & Publications (resultType: "profile")

{
  "query": "new york",
  "resultType": "profile",
  "id": 202322855,
  "title": "New York Magazine",
  "handle": "nymag",
  "url": "https://nymag.substack.com",
  "subscriberCount": "56K+ subscribers",
  "followerCount": 72513,
  "publicationName": "New York Magazine",
  "publicationUrl": "https://nymag.substack.com",
  "isPaid": false,
  "details": {
    "name": "New York Magazine",
    "bio": "",
    "userLinks": [
      { "type": "bluesky", "url": "https://bsky.app/profile/nymag.com" },
      { "type": "twitter", "url": "https://twitter.com/nymag" },
      { "type": "instagram", "url": "https://instagram.com/nymag" }
    ],
    "primaryPublication": {
      "name": "New York Magazine",
      "subdomain": "nymag",
      "hero_text": "Obsessively chronicling the ideas, people, and cultural events that are forever reshaping our world."
    }
  }
}

This record focuses on the creator or publication profile, including handles, subscriber signals, social links, and rich publication context inside details.

Notes (resultType: "comment")

{
  "query": "new york",
  "resultType": "comment",
  "id": 173235826,
  "title": "Few of my favourite shots from New York. What an amazing city for photography!\n\nShon on The Leica M6",
  "handle": "filmgrn",
  "url": "https://substack.com/@filmgrn/note/173235826",
  "publicationName": "Thomas’s Substack",
  "isPaid": false,
  "details": {
    "type": "feed",
    "date": "2025-11-03T21:04:38.100Z",
    "body": "Few of my favourite shots from New York. What an amazing city for photography!\n\nShon on The Leica M6",
    "reaction_count": 92,
    "restacks": 1,
    "attachments": [
      {
        "type": "image",
        "imageUrl": "https://substack-post-media.s3.amazonaws.com/public/images/ffab4b93-8381-4478-a961-b6df7afbf1ea_3130x2075.jpeg"
      }
    ]
  }
}

Notes provide social-style updates from creators. Key information includes timestamps, engagement metrics, and any attached media inside details.

Posts (resultType: "post")

{
  "query": "new york",
  "resultType": "post",
  "publicationName": "New York Magazine",
  "publicationUrl": "https://nymag.substack.com",
  "isPaid": false,
  "details": {
    "entity_key": "p-177931552",
    "title": "All Is Not Lost for the Democrats?",
    "subtitle": "Fingers crossed!",
    "post_date": "2025-11-03T22:05:07.489Z",
    "wordcount": 1086,
    "section_name": "Dinner Party",
    "reactions": { "❤": 9 },
    "comment_count": 1,
    "cover_image": "https://substackcdn.com/image/fetch/$s_!aaUM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ca89e5c-24ed-45ce-a6d2-8a644030b031_1140x1425.jpeg"
  }
}

Post results highlight editorial content. The nested details block carries article metadata such as title, publish time, section, engagement, and imagery.

Notes & Limitations

Use this actor responsibly and in accordance with Substack’s terms of service, privacy guidelines, and local regulations. Always ensure you have the right to process and store the data you collect.

Support

Questions or custom needs? Open an issue on the Issues tab of the actor page in Apify Console and it will be resolved around the clock.

Happy Scraping,

• Fatih