# Substack Explore Leaderboards Scraper - Low-costπŸ’²πŸ”₯πŸ“°πŸ“ˆ (`delectable_incubator/substack-explore-leaderboards-scraper-low-cost`) Actor πŸ” Scrape Substack leaderboards and extract top newsletters, publication titles, author names, handles, bios, custom domains, categories, and URLs. Ideal for lead generation, influencer discovery, newsletter research, competitive analysis, and AI automation workflows πŸš€πŸ“Š - **URL**: https://apify.com/delectable\_incubator/substack-explore-leaderboards-scraper-low-cost.md - **Developed by:** [Prime Scrape](https://apify.com/delectable_incubator) (community) - **Categories:** Automation, Social media, Videos - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.00005 / actor start This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README

PrimeScrape Substack Leaderboards Scraper

--- ## πŸ“°πŸ“ˆ Substack Leaderboards Scraper | Bulk Creator & Publication Scraper | Apify Actor ### πŸš€ Extract Substack Leaderboards Data in Seconds (No Code) The **Substack Leaderboards Scraper (Apify Actor)** is a powerful, scalable, and SEO-optimized scraping tool built to extract public leaderboard data from Substack discovery pages. Scrape top creators, publications, newsletter rankings, author profiles, and publication metadata in bulk for market research, lead generation, influencer discovery, AI datasets, competitive intelligence, and CRM enrichment. --- ### πŸ”₯ Why This Substack Leaderboards Scraper? βœ” Best Substack leaderboard scraper on Apify βœ” Supports bulk leaderboard URLs (multi-URL mode) βœ” Fast & scalable creator data extraction βœ” 100% structured JSON / CSV / Excel output βœ” Ideal for newsletter market intelligence βœ” Perfect for marketers, agencies, startups & researchers βœ” No coding required --- ### 🎯 What This Scraper Does (Substack Leaderboards Data Extraction) This Apify Actor extracts structured creator and publication data directly from Substack leaderboard pages. #### πŸ“Œ Core Features βœ… Scrape Substack leaderboard pages βœ… Bulk URL scraping (SEO BOOST πŸš€) βœ… Extract creators, authors & publications βœ… Extract author bio & profile information βœ… Extract publication metadata βœ… Extract Twitter/X handles βœ… Extract bestseller & subscriber tiers βœ… Extract publication domains βœ… Auto pagination handling (when available) βœ… Clean structured dataset output βœ… High-speed extraction engine --- ### ⚑ Input Configuration (Simple & Powerful) #### πŸ”₯ BULK URL MODE (SEO BOOST πŸš€) ```` { "urls": \[ "https://substack.com/browse/business", "https://substack.com/browse/technology", "https://substack.com/browse/politics", "https://substack.com/browse/finance", "https://substack.com/browse/science" ], "max\_items": 200 } ``` --- ### πŸ“Š Extracted Leaderboard Data (Structured Output) | Field | Description | |------|-------------| | id | Unique creator ID | | name | Creator name | | handle | Substack username | | previousName | Previous display name | | photoUrl | Profile photo | | bio | Author biography | | profileSetUpAt | Profile creation date | | readerInstalledAt | Reader installation date | | twitterScreenName | Twitter/X username | | isGuest | Guest contributor | | bestsellerTier | Bestseller level | | subscriberTier | Subscriber tier | | publicationName | Publication name | | publicationSubdomain | Publication subdomain | | customDomain | Custom domain | | publicationLogo | Publication logo | | publicationCreatedAt | Publication creation date | | foundingPlan | Founding membership plan | | paymentsState | Monetization status | --- ### πŸ’‘ Use Cases (High Demand SEO Keywords) This Substack scraper is used for: πŸ“° Newsletter creator discovery πŸ“ˆ Newsletter market analysis πŸ“© Lead generation 🎯 Influencer discovery 🏒 Creator intelligence πŸ€– AI training datasets πŸ“Š Media research πŸ“‘ Competitive intelligence ⚑ CRM enrichment πŸ“¬ Outreach automation --- ### πŸš€ Key Features (Apify SEO Optimized) ⚑ Bulk URL scraping support 🌍 Scrape every public Substack leaderboard πŸ“Œ Smart pagination system 🧠 Clean structured output πŸ“Š High-speed scraping engine πŸ” Auto retry & stability system πŸ’Ύ Export-ready datasets βš™οΈ Scalable cloud execution (Apify Actor) --- ### πŸ“€ Output Formats Supported βœ” JSON (structured API ready) βœ” CSV (Excel analysis) βœ” Excel XLSX (business reports) βœ” XML (data pipelines) βœ” HTML (dashboards) --- ### πŸ“¦ Example Output ``` { "id": 4937458, "name": "Ted Gioia", "handle": "tedgioia", "photoUrl": "https://substackcdn.com/photo.jpg", "bio": "Author of The Honest Broker.", "twitterScreenName": "tedgioia", "publicationName": "The Honest Broker", "publicationSubdomain": "tedgioia", "customDomain": "www.honest-broker.com", "publicationCreatedAt": "2021-02-24T05:12:42.216Z", "foundingPlan": "Founding Member", "paymentsState": "enabled" } ```` --- ### πŸ”₯ Why This is the BEST Substack Leaderboards Scraper on Apify? βœ” Optimized for Apify search ranking βœ” High-performance extraction engine βœ” Bulk URL support (rare feature) βœ” Complete creator & publication metadata βœ” Enterprise-ready scalability βœ” Perfect for SEO traffic & marketplace visibility --- ### πŸ’Έ Pricing This scraper runs on a pay-per-result pricing model. You only pay for successfully extracted records. πŸ’³ **Price:** $2.38 / 1,000 results --- ### ❓ FAQ (SEO BOOST SECTION) #### Can I scrape multiple leaderboard URLs at once? Yes β€” bulk URL mode is fully supported. #### Can I scrape every Substack category? Yes β€” simply provide any public leaderboard URL. #### Is this scraper fast? Yes β€” optimized for high-speed extraction. #### Is coding required? No β€” 100% no-code Apify Actor. #### Can I export the data? Yes β€” JSON, CSV, Excel, XML and HTML are supported. --- ### ⚠️ Disclaimer This tool is not affiliated with Substack. It is an independent public data extraction solution. --- ### πŸ”— Related Actors (Newsletter Intelligence Ecosystem) We are building a complete **PrimeScrape Newsletter Intelligence Suite** πŸ‘‰ Coming Soon πŸš€ --- ### 🌍 PrimeScrape Ecosystem Built for data scraping, automation, AI training datasets, and market intelligence at scale. πŸ“° Newsletter intelligence πŸ‘€ Creator intelligence πŸ“Š Market analytics πŸ€– AI datasets 🏒 Company intelligence πŸ“ˆ Competitive monitoring βš™οΈ Automation pipelines --- ### πŸ“¬ Support ⭐⭐⭐⭐⭐ Leave a review if you like this scraper. πŸ“© Contact us for custom scraping solutions, enterprise requests, or private Apify Actors. # Actor input Schema ## `urls` (type: `array`): List of Substack URLs (e.g. /explore/category/... or /browse/... pages). Each URL will be scraped separately, with its own entry limit (see maxItemsPerUrl). ## `maxItemsPerUrl` (type: `integer`): Maximum number of leaderboard entries to extract for EACH URL in the 'urls' list (not a global total). ## `proxy` (type: `object`): Select the proxy configuration to use for the actor. ## Actor input object example ```json { "urls": [ "https://substack.com/explore/category/culture" ], "maxItemsPerUrl": 40, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } } ```` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://substack.com/explore/category/culture" ], "maxItemsPerUrl": 40, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }; // Run the Actor and wait for it to finish const run = await client.actor("delectable_incubator/substack-explore-leaderboards-scraper-low-cost").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://substack.com/explore/category/culture"], "maxItemsPerUrl": 40, "proxy": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "US", }, } # Run the Actor and wait for it to finish run = client.actor("delectable_incubator/substack-explore-leaderboards-scraper-low-cost").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://substack.com/explore/category/culture" ], "maxItemsPerUrl": 40, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }' | apify call delectable_incubator/substack-explore-leaderboards-scraper-low-cost --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=delectable_incubator/substack-explore-leaderboards-scraper-low-cost", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Substack Explore Leaderboards Scraper - Low-costπŸ’²πŸ”₯πŸ“°πŸ“ˆ", "description": "πŸ” Scrape Substack leaderboards and extract top newsletters, publication titles, author names, handles, bios, custom domains, categories, and URLs. Ideal for lead generation, influencer discovery, newsletter research, competitive analysis, and AI automation workflows πŸš€πŸ“Š", "version": "0.0", "x-build-id": "NuaKgyrmjcHbmcubt" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/delectable_incubator~substack-explore-leaderboards-scraper-low-cost/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-delectable_incubator-substack-explore-leaderboards-scraper-low-cost", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/delectable_incubator~substack-explore-leaderboards-scraper-low-cost/runs": { "post": { "operationId": "runs-sync-delectable_incubator-substack-explore-leaderboards-scraper-low-cost", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/delectable_incubator~substack-explore-leaderboards-scraper-low-cost/run-sync": { "post": { "operationId": "run-sync-delectable_incubator-substack-explore-leaderboards-scraper-low-cost", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "urls" ], "properties": { "urls": { "title": "Leaderboard/Explore URLs to Scrape #️⃣", "type": "array", "description": "List of Substack URLs (e.g. /explore/category/... or /browse/... pages). Each URL will be scraped separately, with its own entry limit (see maxItemsPerUrl).", "default": [ "https://substack.com/explore/category/culture" ], "items": { "type": "string" } }, "maxItemsPerUrl": { "title": "Maximum Number of Entries to Scrape per URL πŸ“Š", "minimum": 1, "type": "integer", "description": "Maximum number of leaderboard entries to extract for EACH URL in the 'urls' list (not a global total).", "default": 40 }, "proxy": { "title": "Proxy Configuration", "type": "object", "description": "Select the proxy configuration to use for the actor.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```