Skool Scraper

Extract complete data from any Skool community — posts with comments, member profiles with social links, classroom courses, calendar events, and leaderboard rankings.

✨ Why use this scraper?

• 🔓 No login required: Scrape public Skool communities without any account or credentials
• 📝 Complete post data: Get full post content, upvotes, labels, images, videos, and author profiles
• 💬 Deep comment threads: Extract all comments and nested replies with full author information
• 👥 Rich member profiles: Author bios, social links (Facebook, Instagram, LinkedIn, Twitter, YouTube, Website), points, and levels
• 🏫 Full community coverage: About page, classroom courses, calendar events, and leaderboard — all in one run

🎯 Use cases

Industry	Application
Community research	Analyze engagement patterns, top contributors, and content themes across Skool communities
Competitive analysis	Monitor competitor communities — track growth, course offerings, and event schedules
Lead generation	Build targeted outreach lists from active community members with social profiles
Content strategy	Identify top-performing posts and discussion topics to inform your own content
Market intelligence	Track community size, activity levels, and member interests across niches
Course benchmarking	Compare classroom offerings, module counts, and course structures

📥 Input parameters

URL Scraping

Parameter	Type	Description
startUrls	array	Skool community URL(s) to scrape. Supports community pages, individual post URLs, about, classroom, and calendar pages.

Options

Parameter	Type	Default	Description
scrapeComments	boolean	true	Visit each post's detail page to extract all comments and replies. Disable for faster scraping of post listings only.
scrapeAbout	boolean	true	Extract community info: description, owner, member count, leaderboard, and links.
scrapeClassroom	boolean	true	Extract all courses with titles, descriptions, and module counts.
scrapeCalendar	boolean	true	Extract upcoming events with dates, descriptions, and locations.

Limits

Parameter	Type	Default	Description
maxItems	integer	50	Maximum total number of posts to scrape across all communities (1–50,000).
maxPages	integer	5	Maximum number of post pages to scrape per community (~30 posts per page).

📊 Output data

The scraper outputs four data types: posts, community info, courses, and events.

Post example

{
  "id": "2cc9de07cf3940668d09b01cffe91919",
  "url": "https://www.skool.com/ai-automation-society/new-video-claude-code-scheduled-tasks-somehow-got-even-better",
  "title": "New Video: This New Claude Code Feature is a Game Changer",
  "content": "Claude Code can now run recurring tasks, set reminders, and loop skills on intervals for up to 3 days straight without any input from you.",
  "authorName": "Nate Herk",
  "authorId": "fcb8f1ac74644b298f8268197d647ad4",
  "authorBio": "Founder & CEO @ Uppit AI. Sharing my knowledge of AI Automations through YouTube.",
  "authorPicture": "https://assets.skool.com/f/.../photo.jpg",
  "authorLevel": 9,
  "authorPoints": 76928,
  "authorSocials": {
    "instagram": "https://www.instagram.com/nateherk/",
    "linkedin": "https://www.linkedin.com/in/nateherkelman/",
    "website": "https://nateherk.com/",
    "youtube": "https://www.youtube.com/@nateherk"
  },
  "upvotes": 42,
  "commentsCount": 15,
  "pinned": false,
  "postType": "text",
  "label": "video",
  "createdAt": "2026-03-09T12:44:40.270133Z",
  "comments": [
    {
      "id": "24d0c7f00fef48d3b0fecf986d54d09f",
      "content": "Great breakdown of the new feature!",
      "authorName": "Dani Szwarc",
      "authorBio": "Always ready to learn something new.",
      "authorLevel": 5,
      "authorPoints": 211,
      "authorSocials": {
        "linkedin": "https://www.linkedin.com/in/daniszwarc/",
        "twitter": "https://x.com/danitoszwarc",
        "website": "https://ibmi.thiez.com/"
      },
      "upvotes": 3,
      "createdAt": "2026-03-09T15:42:08.030608Z",
      "replies": []
    }
  ],
  "scrapedAt": "2026-03-09T15:49:39Z",
  "dataType": "post"
}

Community info example

{
  "id": "b51c57150c70495899bf4bc8aaee8166",
  "url": "https://www.skool.com/ai-automation-society",
  "name": "AI Automation Society",
  "description": "A community built to master no-code AI automations.",
  "totalMembers": 282778,
  "totalOnlineMembers": 1738,
  "totalPosts": 14095,
  "ownerName": "Nate Herk",
  "ownerSocials": {
    "instagram": "https://www.instagram.com/nateherk/",
    "linkedin": "https://www.linkedin.com/in/nateherkelman/",
    "youtube": "https://www.youtube.com/@nateherk"
  },
  "leaderboard": [
    {
      "name": "Muskan Ahlawat",
      "points": 27226,
      "level": 8,
      "socials": {
        "instagram": "https://www.instagram.com/muskanahl2623",
        "youtube": "https://youtube.com/@muskancreates-g4l"
      }
    }
  ],
  "dataType": "community"
}

Course example

{
  "id": "993c60aa26514df388cc82561fe33e42",
  "url": "https://www.skool.com/ai-automation-society/classroom/3d31807e",
  "title": "Start Here",
  "description": "Welcome to AI Automation Society! Please start here to understand how this community works.",
  "coverImage": "https://assets.skool.com/f/.../cover.jpg",
  "numModules": 3,
  "public": true,
  "groupSlug": "ai-automation-society",
  "dataType": "course"
}

Event example

{
  "id": "4a7505f691e44a2ba50ae4919488b96d",
  "url": "https://www.skool.com/ai-automation-society/calendar",
  "title": "Q&A w/ Nate",
  "description": "Become a plus member to unlock weekly calls with Nate!",
  "startTime": "2026-02-23T17:00:00-06:00",
  "endTime": "2026-02-23T17:30:00-06:00",
  "timezone": "America/Chicago",
  "location": "https://www.skool.com/ai-automation-society-plus/about",
  "dataType": "event"
}

🗂️ Data fields

Category	Fields
Post basics	id, url, title, content, postType, label, pinned, createdAt, updatedAt
Post engagement	upvotes, commentsCount
Post media	imageUrl, videoIds, videoLinks
Author profile	authorName, authorId, authorBio, authorPicture, authorLevel, authorPoints
Author socials	facebook, instagram, linkedin, twitter, website, youtube
Comments	id, content, authorName, authorBio, authorLevel, authorPoints, authorSocials, upvotes, createdAt, replies (nested)
Community info	name, slug, description, landingPageDescription, privacy, totalMembers, totalOnlineMembers, totalPosts, totalAdmins
Community owner	ownerName, ownerId, ownerBio, ownerSocials
Community extras	coverUrl, logoUrl, faviconUrl, links, leaderboard, createdAt
Leaderboard users	userId, name, picture, bio, points, level, socials
Courses	id, url, title, description, coverImage, numModules, public, groupSlug
Events	id, url, title, description, coverImage, startTime, endTime, timezone, location

🚀 Examples

Scrape a community with all data

{
  "startUrls": [
    { "url": "https://www.skool.com/ai-automation-society" }
  ],
  "scrapeComments": true,
  "scrapeAbout": true,
  "scrapeClassroom": true,
  "scrapeCalendar": true,
  "maxItems": 100,
  "maxPages": 5
}

Fast scrape — posts only, no comments

{
  "startUrls": [
    { "url": "https://www.skool.com/ai-automation-society" }
  ],
  "scrapeComments": false,
  "scrapeAbout": false,
  "scrapeClassroom": false,
  "scrapeCalendar": false,
  "maxItems": 200,
  "maxPages": 10
}

Scrape multiple communities

{
  "startUrls": [
    { "url": "https://www.skool.com/ai-automation-society" },
    { "url": "https://www.skool.com/the-ai-marketing-society" }
  ],
  "scrapeComments": true,
  "scrapeAbout": true,
  "scrapeClassroom": true,
  "scrapeCalendar": true,
  "maxItems": 50,
  "maxPages": 3
}

Scrape a single post

{
  "startUrls": [
    { "url": "https://www.skool.com/ai-automation-society/new-video-claude-code-scheduled-tasks-somehow-got-even-better" }
  ],
  "scrapeComments": true
}

💻 Integrations

Python

from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")

run_input = {
    "startUrls": [
        {"url": "https://www.skool.com/ai-automation-society"}
    ],
    "scrapeComments": True,
    "scrapeAbout": True,
    "scrapeClassroom": True,
    "scrapeCalendar": True,
    "maxItems": 100,
    "maxPages": 5,
}

run = client.actor("YOUR_USERNAME/skool-scraper").call(run_input=run_input)

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

JavaScript

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });

const input = {
    startUrls: [
        { url: 'https://www.skool.com/ai-automation-society' },
    ],
    scrapeComments: true,
    scrapeAbout: true,
    scrapeClassroom: true,
    scrapeCalendar: true,
    maxItems: 100,
    maxPages: 5,
};

const run = await client.actor('YOUR_USERNAME/skool-scraper').call(input);

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

📈 Performance & limits

Metric	Value
Posts per page	~30
Comments	All comments and nested replies per post
Courses	All public courses in classroom
Events	All upcoming calendar events
Max posts	Up to 50,000 per run
Memory	256 MB default (scales automatically)

💡 Tips for best results

1. Start small: Use maxItems: 50 and maxPages: 5 for your first run to preview the data
2. Disable comments for speed: Set scrapeComments: false to skip detail page visits — much faster for large communities
3. Focus on what you need: Disable scrapeAbout, scrapeClassroom, or scrapeCalendar if you only need posts
4. Scrape single posts: Pass individual post URLs in startUrls to get full content and all comments for specific posts
5. Scale gradually: Increase maxPages to cover more of a community's post history — each page has ~30 posts

❓ FAQ

Q: Can I scrape private Skool communities? A: No, the scraper only works with public Skool communities. Private communities require login which is not supported.

Q: How do I get all posts from a large community? A: Increase maxItems and maxPages to cover more pages. Each page contains approximately 30 posts.

Q: What social networks are extracted? A: Facebook, Instagram, LinkedIn, Twitter/X, YouTube, and personal websites — for post authors, comment authors, community owners, and leaderboard members.

Q: Can I scrape just the about page or classroom without posts? A: Yes, set maxItems: 1 and enable only the sections you need (scrapeAbout, scrapeClassroom, scrapeCalendar).

Q: What happens if the site blocks a request? A: The scraper automatically retries with a fresh session. If all attempts fail, try again later.

Q: Are nested replies included in comments? A: Yes, all reply levels are fully extracted with the same author data (bio, social links, points, level).

📬 Support

We're building this scraper for you, your feedback makes it better for everyone!

• 💡 Need a feature? Tell us what's missing and we'll prioritize it
• ⚙️ Custom solutions: Contact us for enterprise integrations or high-volume needs

We respond to every message, usually within 24 hours. Don't hesitate, even small suggestions help!

Check out our other scrapers: dfrancisco on Apify