Skool Post Scraper

Extract posts from Skool communities with full content, author information, and engagement metrics. Perfect for content analysis, market research, and community insights.

Features

• 🔐 Authentication: Login with your Skool credentials
• 📄 Multi-page scraping: Automatically scrape multiple pages of posts per group
• 👥 Multiple groups: Scrape posts from multiple groups in one run
• 📊 Rich data extraction: Get titles, content, authors, timestamps, engagement metrics
• 📝 Complete content: Option to fetch full content for truncated posts
• ☁️ Reliable scraping: Works on protected pages
• 🔄 Retry mechanism: Automatic retries for failed requests
• 📈 Summary statistics: Get overview of scraped data

Input

The actor accepts the following input parameters:

Field	Type	Required	Description
email	String	Yes	Your Skool account email
password	String	Yes	Your Skool account password
groupUrls	Array	Yes	List of Skool group URLs to scrape
maxPages	Integer	No	Maximum pages to scrape per group (default: 5, max: 100+)
fetchCompleteContent	Boolean	No	Fetch complete content for truncated posts (default: false)
outputFormat	String	No	Output format: "json" or "csv" (default: "json")
proxyConfiguration	Object	No	Proxy settings for the actor
debugMode	Boolean	No	Enable debug logging (default: false)
requestDelay	Number	No	Delay between requests in seconds (default: 1.0, range: 0.5-10)
retryAttempts	Integer	No	Number of retry attempts for failed requests (default: 3, max: 10)

Example Input

{
  "email": "your-email@example.com",
  "password": "your-password",
  "groupUrls": [
    "https://www.skool.com/makemoneywithmake",
    "https://www.skool.com/another-group"
  ],
  "maxPages": 10,
  "fetchCompleteContent": true,
  "requestDelay": 2.0
}

Output

The actor outputs an array of post objects with the following structure:

{
  "post_id": "unique_post_id",
  "post_name": "url-slug",
  "post_url": "https://www.skool.com/group/post-url",
  "title": "Post Title",
  "author": "Author Name",
  "author_id": "author_user_id",
  "author_profile_url": "https://www.skool.com/users/author-profile",
  "created_at": "2024-05-21T17:10:38.91691Z",
  "updated_at": "2024-05-21T17:10:38.91691Z",
  "upvotes": 147,
  "comments_count": 891,
  "image_preview_url": "https://...",
  "video_url": "https://...",
  "raw_content": "Original Skool format content",
  "normalized_html_content": "Converted HTML content",
  "content_truncated": false,
  "category": "category_id",
  "pinned": false,
  "locked": false,
  "group_url": "https://www.skool.com/group-name",
  "group_name": "group-name",
  "scraped_at": "2024-01-01T00:00:00.000Z"
}

Summary Output

The actor also saves a summary in the key-value store under the key SUMMARY:

{
  "total_posts": 150,
  "groups_scraped": 2,
  "posts_per_group": {
    "makemoneywithmake": 75,
    "another-group": 75
  },
  "unique_authors": 45,
  "authors": ["Ryan Montoya", "Nick Saraev", "..."],
  "date_range": {
    "earliest": "2024-05-21T17:10:38.91691Z",
    "latest": "2025-08-02T22:08:03.195502Z"
  },
  "scraping_completed_at": "2025-08-03T17:28:15.602310"
}

Usage

On Apify Platform

1. Go to the actor page on Apify Store
2. Click "Try for free" or "Run"
3. Enter your Skool credentials and group URLs
4. Configure optional settings as needed
5. Click "Start" to begin scraping

Using API

const { ApifyClient } = require('apify-client');

const client = new ApifyClient({
    token: 'YOUR_APIFY_TOKEN',
});

const input = {
    email: 'your-email@example.com',
    password: 'your-password',
    groupUrls: ['https://www.skool.com/your-group'],
    maxPages: 5,
    fetchCompleteContent: true
};

const run = await client.actor('futurizerush/skool-post-scraper').call(input);
console.log('Results:', run.output.body);

Using Apify CLI

apify call futurizerush/skool-post-scraper -i '{
    "email": "your-email@example.com",
    "password": "your-password",
    "groupUrls": ["https://www.skool.com/your-group"]
}'

Notes

• Rate Limiting: The actor includes built-in delays to avoid rate limiting. Adjust requestDelay if needed.
• Complete Content: Enable fetchCompleteContent to get full text for longer posts.
• Authentication: The actor will fail if login credentials are incorrect or if the account is restricted.
• Proxy: Consider using Apify proxy configuration for large-scale scraping to avoid IP restrictions.

Limitations

• Requires valid Skool account credentials
• Cannot access private groups you're not a member of
• Subject to Skool's rate limiting and anti-scraping measures
• Content formatting uses custom Skool markup that is converted to HTML

Support

For issues, questions, or feature requests, please create an issue on the Apify Actor page or contact Rush through Apify support.

License

This actor is provided as-is for educational and research purposes. Users are responsible for complying with Skool's Terms of Service and applicable laws.