Skool Discovery Scraper

Extract community data from Skool Discovery in a structured, analysis-ready format. Collect ranked communities with profile details, member counts, pricing signals, and branding assets for market research, lead generation, and competitive monitoring.

---

Features

• Discovery extraction - Collect communities directly from Skool Discovery pages.
• Structured output - Get clean, normalized fields for analytics and automation.
• Pricing insights - Capture monthly and annual pricing data when available.
• Community signals - Track member counts, rank, category context, and profile metadata.
• Clean dataset records - Null and empty values are removed before data is stored.

---

Use Cases

Market Intelligence

Track fast-growing communities, benchmark positioning, and identify high-demand niches.

Competitive Research

Monitor how competitors present offers, pricing, and brand identity across discovery listings.

Creator Prospecting

Find relevant communities by category and evaluate size and monetization potential quickly.

Data Enrichment

Build a clean community dataset for dashboards, CRM enrichment, and internal scoring workflows.

---

Input Parameters

Parameter	Type	Required	Default	Description
startUrl	String	No	"https://www.skool.com/discovery"	Discovery URL to start from.
search	String	No	""	Optional search phrase for discovery filtering.
categoryId	String	No	-	Optional category ID for discovery filtering.
results_wanted	Integer	No	20	Maximum number of communities to collect.
max_pages	Integer	No	1	Safety cap for page attempts when more results are available.
proxyConfiguration	Object	No	{"useApifyProxy": false}	Optional proxy settings.

---

Output Data

Each dataset item may include the following fields:

Field	Type	Description
id	String	Community ID.
slug	String	Community slug used in the URL.
url	String	Community URL.
displayName	String	Community display name.
description	String	Community description text.
totalMembers	Integer	Member count.
totalAdmins	Integer	Number of admins.
totalOnlineMembers	Integer	Number of currently online members.
totalPosts	Integer	Total posts in the community.
totalRules	Integer	Number of community rules.
numCourses	Integer	Number of available courses.
numModules	Integer	Number of available modules.
privacy	Integer	Privacy mode indicator.
minPostLevel	Integer	Minimum level required for posting.
rank	Integer	Discovery rank.
tags	Array	Community tags when available.
categoryId	String	Category ID context from discovery filters.
coverImageUrl	String	Cover image URL.
logoUrl	String	Logo image URL.
logoBigUrl	String	High-resolution logo URL.
faviconUrl	String	Community favicon URL.
initials	String	Community initials.
brandColor	String	Brand color value.
links	String	Serialized community links payload.
tabs	String	Serialized tab visibility payload.
annualPrice	Number	Annual plan price when available.
annualPriceCurrency	String	Currency for annual plan price.
monthlyPrice	Number	Monthly plan price when available.
monthlyPriceCurrency	String	Currency for monthly plan price.
createdAt	String	Community creation timestamp.
updatedAt	String	Community update timestamp.
sourceUrl	String	Discovery source URL used for extraction.

---

Usage Examples

Basic Extraction

{
	"startUrl": "https://www.skool.com/discovery",
	"results_wanted": 20
}

Category-Based Collection

{
	"startUrl": "https://www.skool.com/discovery",
	"categoryId": "2830789533b448d8812e7d5d661d776c",
	"results_wanted": 30
}

Proxy-First Production Run

{
	"startUrl": "https://www.skool.com/discovery",
	"results_wanted": 50,
	"max_pages": 2,
	"proxyConfiguration": {
		"useApifyProxy": false
	}
}

---

Sample Output

{
	"id": "37a997125c1a4a7aa2ecbf73c79e8468",
	"slug": "calligraphy",
	"url": "https://www.skool.com/calligraphy",
	"displayName": "Calligraphy Skool",
	"description": "Learn modern calligraphy the fun, easy way.",
	"totalMembers": 1412,
	"totalAdmins": 4,
	"totalOnlineMembers": 27,
	"totalPosts": 912,
	"numCourses": 6,
	"numModules": 44,
	"privacy": 0,
	"rank": 1,
	"categoryId": "",
	"coverImageUrl": "https://assets.skool.com/.../cover-md.jpg",
	"logoUrl": "https://assets.skool.com/.../logo",
	"logoBigUrl": "https://assets.skool.com/.../logo-big.jpg",
	"faviconUrl": "https://assets.skool.com/.../favicon.jpg",
	"links": "{\"links\":[...]}",
	"tabs": "{\"calendar\":{\"visible\":true}}",
	"createdAt": "2024-08-15T01:33:13.866416Z",
	"updatedAt": "2025-08-25T20:26:24.360076Z",
	"sourceUrl": "https://www.skool.com/discovery"
}

---

Tips for Best Results

Start With Small Runs

Use results_wanted: 20 first to verify your filters and output fields before scaling up.

Use Proxy Only If Needed

Default direct requests work for this actor. Enable proxy only if your environment starts seeing blocking.

Filter for Focused Research

Use categoryId and search to narrow down communities for specific niches.

---

Integrations

Connect extracted data to:

• Google Sheets - Share community datasets with non-technical teams.
• Airtable - Build searchable discovery databases.
• Looker Studio / BI tools - Visualize growth and pricing patterns.
• Webhooks - Trigger downstream automation in real time.
• Make and Zapier - Power no-code workflows.

Export formats include JSON, CSV, Excel, and XML.

---

Frequently Asked Questions

How many communities can I collect?

You can set any practical limit with results_wanted. Start low, then scale once validated.

Why are some fields missing in specific records?

Some communities do not expose every field. Empty values are removed from output by design.

Can I filter by category?

Yes. Provide a categoryId to focus extraction on one discovery category.

Does this work for recurring monitoring?

Yes. Schedule runs and compare output snapshots over time.

Can I use this for analytics pipelines?

Yes. The output is structured for easy ingestion into ETL, BI, and reporting workflows.

---

Support

Use Apify Console to report issues or request improvements.

Helpful resources:

• Apify Documentation
• Apify API Reference
• Apify Scheduling

---

Legal Notice

This actor is intended for legitimate data collection and analysis. Users are responsible for compliance with all applicable terms, regulations, and laws in their jurisdiction.