📋 Substack Scraper

❗ Version 1 Notes

• Currently, only the last 20 Posts are return, need more? Create a new issue
• There are more data points available, we've started with the most popular, want something in particular? Create a new issue

🚀 What It Does

Enter a Substack and retrieve all published content. This scraper extracts the complete content data from the Substack page, including posts and author details

💡 Why Use It?

This scraper is perfect for:

• Content analysis of Substack publications
• Archiving Substack content
• Monitoring specific publications
• Data collection for research purposes

🔍 Substack Username Guidelines

The scraper accepts Substack names in their basic form. Here are some examples:

• Correct: marketingideas
• Correct: mattlevine
• Correct: noahpinion

Note: Do not include '@' or '.substack.com' in the username.

🛠️ How to Use

1. Run the scraper through Apify platform
2. Enter the Substack name in the input field
3. The scraper will automatically:
   • Visit the Substack page
   • Extract all available content
   • Save the data to Apify Dataset
   • Stop when complete

📝 Sample Output

The scraper saves data in a structured format including:

{
    "substack": "nickcohen",
    "author": {
        "author_url": "https://substack.com/@nickcohen",
        "author_id": 5183845,
        "author_name": "Nick Cohen",
        "author_handle": "nickcohen",
        "author_photo_url": "https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fe1db7a9b-2f54-4a2e-9799-917685c71adb_960x640.jpeg",
        "author_bio": "Journalist and commentator from the UK",
        "twitter_screen_name": "NickCohen4"
    },
    "posts": [
        {
            "id": 165338922,
            "title": "How aristocratic snobbery wrecked the UK",
            "description": "Michael Gove, Sarah Vine and the fury of the left-behind middle class",
            "slug": "how-aristocratic-snobbery-wrecked",
            "post_date": "2025-06-07T07:59:10.680Z",
            "url": "https://nickcohen.substack.com/p/how-aristocratic-snobbery-wrecked",
            "word_count": 1397,
            "audience": "only_paid",
            "reactions": {
                "❤": 75
            },
            "comment_count": 26,
            "truncated_body_text": "Image by Mike Finn. Flickr creative commons",
            "cover_image": "https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F175d86d3-ebc0-4be8-a78d-c676c9f5abc3_750x536.webp",
            "subtitle": "Michael Gove, Sarah Vine and the fury of the left-behind middle class"
        },
        {
            "id": 165307596,
            "title": "Don’t ally with Elon Musk ",
            "description": "Your enemy’s enemy is NOT your friend",
            "slug": "dont-ally-with-elon-musk",
            "post_date": "2025-06-05T23:17:58.140Z",
            "url": "https://nickcohen.substack.com/p/dont-ally-with-elon-musk",
            "word_count": 812,
            "audience": "everyone",
            "reactions": {
                "❤": 89
            },
            "comment_count": 18,
            "truncated_body_text": "I try to keep posts about our crisis free to read so that they can receive a wide audience. But, if you can afford to, please consider supporting my journalism by becoming a paid subscriber.",
            "cover_image": "https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F809b427b-a403-45e3-9d0d-9e7f4c3fd547_503x432.png",
            "subtitle": "Your enemy’s enemy is NOT your friend"
        }
    ]
}