# Skool Post & Comment Scraper (`goat255/skool-post-scraper`) Actor Bulk export posts and full comment threads (with nested replies) from any Skool.com community you've joined. Author profiles, engagement, date filters, multi-group runs. Residential proxies built in. - **URL**: https://apify.com/goat255/skool-post-scraper.md - **Developed by:** [Goutam Soni](https://apify.com/goat255) (community) - **Categories:** Social media, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $8.00 / 1,000 posts This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Skool Post Scraper - Extract Posts, Comments & Replies from Skool Communities Scrape posts and full comment threads (with nested replies) from any Skool.com community you have joined. Bulk-export Skool community content, conversations, engagement metrics, and author profiles in clean JSON — no Skool API key, no manual copy-paste. > Looking to **discover Skool communities** by keyword or pull **community-level data** (members, pricing, MRR)? Use the [Skool Scraper Goat](https://apify.com/goat255/skool-scraper-goat) instead. ### What this Skool post scraper does Point it at one or more Skool group URLs (or just group names) you've joined, paste your Skool cookies once, and the actor returns one clean record per post containing: - Post **title**, full **content**, post URL, post type, created/updated timestamps - Engagement: **upvote count**, **comment count**, pinned flag - **Author profile** — name, bio, picture, MRR status, full social links - **Contributors** (everyone tagged on the post) - **Attachments**, image preview, video IDs, label IDs - **Nested comment threads** (optional) with full reply tree - Comment author profiles, upvotes, created/updated dates - Date-range filtering (`postsDateFrom` / `postsDateTo`) Perfect for **community research, content audits, sentiment analysis, lead extraction, and AI training data** on the Skool platform. ### Why use this scraper - **No URL needed** — list all the communities your account has joined, or paste community names instead of full URLs. - **Posts and comments in one pass** — comments are nested directly inside each post, with optional reply trees. - **Date filtering** — only scrape posts created in your target window, not the whole archive. - **Residential proxy rotation** with adaptive retry/backoff — survives Skool's rate limits. - **No primary-key surprises** — pay per post and per comment separately, only scrape comments when you ask for them. - Works for any group you have joined, including private and paid communities. ### What data you get per post ```json { "groupUrl": "https://www.skool.com/example-community", "groupName": "example-community", "postId": "00000000000000000000000000000000", "postUrl": "https://www.skool.com/example-community/welcome-start-here", "title": "Welcome - start here", "content": "Hey everyone! Here's how to get the most from this community...", "createdAt": "2026-05-17T16:21:28Z", "upvotes": 32, "commentCount": 12, "pinned": true, "author": { "handle": "jane-doe-1234", "firstName": "Jane", "social": { "instagram": "https://www.instagram.com/example", "linkedin": "https://www.linkedin.com/in/example", "youtube": "https://www.youtube.com/@example" } }, "comments": [ { "content": "Loved it!", "upvotes": 3, "author": { "handle": "alex-smith-5678", "firstName": "Alex" }, "replies": [ { "content": "Same here", "author": { "handle": "sam-roe-9012", "firstName": "Sam" } } ] } ] } ```` ### How to use the Skool Post Scraper 1. **Join the target Skool communities** with the account you'll use for scraping (membership is mandatory — Skool hides feeds from non-members, even on "public" groups). 2. **Export your Skool cookies** with the free Cookie-Editor browser extension (JSON export, all skool.com cookies). 3. Open the actor on Apify Store, click **Try for free**. 4. Paste the cookies into the `cookies` input field. 5. Pick targets in **Group URLs or Names** — paste full URLs (`https://www.skool.com/groupname`) or just the names (`groupname`). **Leave it empty to scrape every community your account has joined.** 6. Set `maxPostsPerGroup`, toggle **Get Comments** if you want comment threads, optionally set `commentsPerPost`, `includeReplies`, and `postsDateFrom`/`postsDateTo` filters. 7. Click **Save & start**. Download in JSON / CSV / Excel / XML / HTML. ### Top use cases - **Content audits** — export everything posted in your own communities for analysis. - **Community research** — what topics drive the most engagement in your competitors' Skool groups. - **Lead extraction** — pull active community members from comment threads with their social links. - **AI training data** — clean Q\&A and discussion threads for model fine-tuning. - **Sentiment analysis** — analyse community feedback at scale across multiple groups. - **Archive backup** — snapshot posts before content is edited or deleted. ### Pricing Pay-per-event. You only pay for comments when you enable comment scraping. | Event | Price | |---|---| | Post scraped (primary) | $0.008 | | Comment scraped | $0.0015 | Apify's $5 platform free credit applies on first use — that's ~600 free posts or roughly 3,000 comments. ### FAQ #### Why are cookies required? Skool blocks the post feed for non-members on every group, even "public" ones — an unauthenticated request is 307-redirected to the marketing/about page with zero posts visible. The cookies prove the account has joined the group. #### Are public Skool group posts accessible without joining? **No.** Confirmed via live testing: Skool returns the post feed only to authenticated members. You must join each group with the account whose cookies you use. #### Can I scrape posts from multiple groups in one run? Yes — pass multiple group URLs or names in the input, or leave `groupUrls` empty to automatically scrape every community your account has joined. #### Does it scrape private and paid Skool communities? Yes, as long as the account you're using has joined them. The scraper respects the same access as the user. #### How fast is it? \~5-8 seconds per post including residential proxy rotation. A full 17-community sweep (12 posts each, 5 comments per post) runs in about 8 minutes. #### What if Skool rate-limits me? Built-in: exponential backoff, fresh proxy session per retry, adaptive concurrency. The actor survives 403/429 transient errors automatically. #### Can I filter by date? Yes — set `postsDateFrom` and/or `postsDateTo` (ISO `YYYY-MM-DD`). ### Related Apify actors - 🏘️ [Skool Scraper Goat](https://apify.com/goat255/skool-scraper-goat) — discover Skool communities by keyword, extract pricing, MRR, members. - 👤 [Instagram Profile Scraper](https://apify.com/goat255/instagram-profile-scraper) — Instagram profiles with emails and contact info. ### Support Issues, missing fields, or feature requests? Open an issue on the actor page. Reviews are read and replied to. # Actor input Schema ## `listCommunitiesOnly` (type: `boolean`): When enabled, the actor only lists the communities your account has joined (name, URL, members, posts) and stops. Use this first to pick which communities to scrape, then paste their names or URLs into Group URLs. Requires cookies. ## `groupUrls` (type: `array`): Communities to scrape posts from. Accepts either full Skool URLs (https://www.skool.com/groupname) or just the community name/slug (groupname). Replace the placeholder with your own. Leave this EMPTY to scrape every community your account has joined. You must be a member of each group and supply cookies from the same account; Skool blocks the post feed for non-members even on public groups. ## `maxPostsPerGroup` (type: `integer`): Maximum number of posts to collect per group. The feed is ordered by most recent comment activity. ## `scrapeComments` (type: `boolean`): Also scrape the comments on each post. When off, only the posts themselves are returned (faster, cheaper). ## `commentsPerPost` (type: `integer`): Maximum comments to collect per post (only applies when Get Comments is on). ## `includeReplies` (type: `boolean`): Nest replies under their parent comment. When off, only top-level comments are returned. ## `postsDateFrom` (type: `string`): Only include posts created on or after this date (YYYY-MM-DD). Leave empty for no lower bound. ## `postsDateTo` (type: `string`): Only include posts created on or before this date (YYYY-MM-DD). Leave empty for no upper bound. ## `batchSize` (type: `integer`): Number of posts processed per batch before saving to the dataset. Recommended 30-75. ## `maxConcurrency` (type: `integer`): Parallel requests. Default 10 is reliable. Values above 15 may trigger rate limits on Skool. Max 30. ## `maxRetries` (type: `integer`): Retry attempts per failed request. Each retry uses a new proxy session with exponential backoff. ## `cookies` (type: `array`): Cookies from Skool.com for an account that has joined the target groups. Export with the Cookie-Editor browser extension (export all skool.com cookies as JSON). Required - the post feed is gated behind authentication. ## `proxyConfiguration` (type: `object`): Proxy settings. Residential proxies are required - Skool blocks datacenter IPs. ## Actor input object example ```json { "listCommunitiesOnly": false, "groupUrls": [ "https://www.skool.com/your-skool-group-here" ], "maxPostsPerGroup": 100, "scrapeComments": false, "commentsPerPost": 50, "includeReplies": true, "batchSize": 50, "maxConcurrency": 10, "maxRetries": 4, "cookies": [], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "groupUrls": [ "https://www.skool.com/your-skool-group-here" ], "batchSize": 50 }; // Run the Actor and wait for it to finish const run = await client.actor("goat255/skool-post-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "groupUrls": ["https://www.skool.com/your-skool-group-here"], "batchSize": 50, } # Run the Actor and wait for it to finish run = client.actor("goat255/skool-post-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "groupUrls": [ "https://www.skool.com/your-skool-group-here" ], "batchSize": 50 }' | apify call goat255/skool-post-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=goat255/skool-post-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Skool Post & Comment Scraper", "description": "Bulk export posts and full comment threads (with nested replies) from any Skool.com community you've joined. Author profiles, engagement, date filters, multi-group runs. Residential proxies built in.", "version": "1.0", "x-build-id": "S6npnv34sAZEOWZMw" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/goat255~skool-post-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-goat255-skool-post-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/goat255~skool-post-scraper/runs": { "post": { "operationId": "runs-sync-goat255-skool-post-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/goat255~skool-post-scraper/run-sync": { "post": { "operationId": "run-sync-goat255-skool-post-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "groupUrls", "cookies" ], "properties": { "listCommunitiesOnly": { "title": "List My Communities Only", "type": "boolean", "description": "When enabled, the actor only lists the communities your account has joined (name, URL, members, posts) and stops. Use this first to pick which communities to scrape, then paste their names or URLs into Group URLs. Requires cookies.", "default": false }, "groupUrls": { "title": "Group URLs or Names", "uniqueItems": true, "type": "array", "description": "Communities to scrape posts from. Accepts either full Skool URLs (https://www.skool.com/groupname) or just the community name/slug (groupname). Replace the placeholder with your own. Leave this EMPTY to scrape every community your account has joined. You must be a member of each group and supply cookies from the same account; Skool blocks the post feed for non-members even on public groups.", "items": { "type": "string" } }, "maxPostsPerGroup": { "title": "Max Posts Per Group", "minimum": 1, "maximum": 100000, "type": "integer", "description": "Maximum number of posts to collect per group. The feed is ordered by most recent comment activity.", "default": 100 }, "scrapeComments": { "title": "Get Comments", "type": "boolean", "description": "Also scrape the comments on each post. When off, only the posts themselves are returned (faster, cheaper).", "default": false }, "commentsPerPost": { "title": "Comments Per Post", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum comments to collect per post (only applies when Get Comments is on).", "default": 50 }, "includeReplies": { "title": "Include Replies", "type": "boolean", "description": "Nest replies under their parent comment. When off, only top-level comments are returned.", "default": true }, "postsDateFrom": { "title": "Posts Created From", "type": "string", "description": "Only include posts created on or after this date (YYYY-MM-DD). Leave empty for no lower bound." }, "postsDateTo": { "title": "Posts Created To", "type": "string", "description": "Only include posts created on or before this date (YYYY-MM-DD). Leave empty for no upper bound." }, "batchSize": { "title": "Batch Size", "minimum": 10, "maximum": 100, "type": "integer", "description": "Number of posts processed per batch before saving to the dataset. Recommended 30-75." }, "maxConcurrency": { "title": "Max Concurrent Requests", "minimum": 3, "maximum": 30, "type": "integer", "description": "Parallel requests. Default 10 is reliable. Values above 15 may trigger rate limits on Skool. Max 30.", "default": 10 }, "maxRetries": { "title": "Max Retries", "minimum": 1, "maximum": 10, "type": "integer", "description": "Retry attempts per failed request. Each retry uses a new proxy session with exponential backoff.", "default": 4 }, "cookies": { "title": "Skool Cookies", "type": "array", "description": "Cookies from Skool.com for an account that has joined the target groups. Export with the Cookie-Editor browser extension (export all skool.com cookies as JSON). Required - the post feed is gated behind authentication.", "default": [] }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Proxy settings. Residential proxies are required - Skool blocks datacenter IPs.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```