# Circle.so Community Scraper (`goat255/circle-community-scraper`) Actor

Scrape Circle.so's public discovery directory at scale. Returns clean ordered rows: name, community, creator, pricing, tags, outcomes, target audience, category.

- **URL**: https://apify.com/goat255/circle-community-scraper.md
- **Developed by:** [Goutam Soni](https://apify.com/goat255) (community)
- **Categories:** Lead generation, Automation, Developer tools
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.00 / 1,000 listings

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Circle.so Community Scraper - Discover Communities, Courses & Memberships with Pricing

Scrape Circle.so's public discovery directory at scale. For every Circle community or course listed at discover.circle.so, get a clean row: community name, creator, full description, pricing (monthly / yearly / trial days), tags, outcomes, target audience, and category. No Circle API key required, runs on the public discovery endpoint.

### What this Circle scraper does

Circle.so's discovery directory groups public communities and courses into 20 **goals** (categories like "Be more productive", "Start and scale my business", "Learn a new skill"). The scraper:

1. **Walks every goal** and paginates the listings inside (100 per page, deduped across goals).
2. **Optionally runs keyword search** through Circle's internal search API for listings hidden from the goal pages.
3. **Normalises every listing** into a clean ordered row (identity → audience signals → pricing → marketing copy → metadata). No raw API leakage, no internal fields cluttering your spreadsheet.

Perfect for **community-business research, competitive analysis, MRR research, lead generation, agency prospecting** in the Circle ecosystem.

### Why use this Circle scraper

- **No Circle API key** - runs on the public discovery API at `discover.circle.so/backend/public_api`.
- **All 20 goals + keyword search** in one run, fully de-duplicated.
- **Clean output schema** - 25+ semantic fields, no `internal_notes` / `cropped_thumbnail_params` / `paywall_group_id` junk dumped in your data.
- **Pricing normalised** - both raw `priceUsd` and computed `monthlyPriceUsd` (year-priced listings divided into monthly equivalents for apples-to-apples comparison).
- **Marketing-copy extracted** - outcomes, target purposes, "what's included" features, and tags for content analysis.
- **Built-in batching + rate-limit retry** - safe to run against the full catalogue.

### What data you get per listing

```json
{
  "name": "Example Productivity Course",
  "slug": "example-course",
  "url": "https://discover.circle.so/listing/example-course",
  "communityName": "Example Community",
  "creatorName": "Jane Doe",
  "creatorBio": "...",
  "coverImageUrl": "https://...",
  "thumbnailUrl": "https://...",
  "video": null,
  "shortDescription": "Short pitch...",
  "longDescription": "Full pitch...",
  "isFree": false,
  "isPaid": true,
  "priceUsd": 49,
  "monthlyPriceUsd": 49,
  "humanReadablePrice": "$49 / month",
  "billingInterval": "month",
  "trialDays": 7,
  "externalUrl": null,
  "tags": ["Course"],
  "outcomes": ["Learn X", "Master Y"],
  "purposes": ["Designed for Z"],
  "whatsIncluded": [
    { "title": "5 modules", "body": "...", "icon": "video" }
  ],
  "listingHighlights": [],
  "categoryName": "Productivity",
  "goalSlug": "be-more-productive",
  "goalName": "Be more productive",
  "createdAt": "2026-04-03T...",
  "lastPublishedAt": "2026-04-17T...",
  "updatedAt": "2026-04-17T...",
  "listingId": 2880,
  "communityHandle": "example"
}
````

### How to use the Circle.so Scraper

1. Click **Try for free** on the actor page.
2. Pick **goals**: leave empty to scrape all 20, or pass specific slugs like `be-more-productive`, `start-and-scale-my-business`.
3. Optionally add **search keywords** to surface listings outside the goal pages.
4. Click **Save & Start**. Download in JSON, CSV, Excel, XML, or HTML.

### Top use cases

- **Lead generation** - find Circle community owners in your niche with creator name + bio + community link in every row.
- **Market research** - average pricing by category, free-trial penetration, billing model distribution (monthly vs yearly).
- **Agency prospecting** - identify paid communities above a price threshold for partnership conversations.
- **Competitor analysis** - what competing creators are charging, what their tier structure looks like, what outcomes they promise.
- **Investment / acquisition research** - tag and price-filter the directory to surface high-priced communities for M\&A.
- **Course / community design research** - study what "outcomes" and "purposes" copy converts in your niche.
- **Newsletter / podcast targeting** - find creators by goal or keyword to pitch collaborations.

### Integrations

#### Apify API

```bash
curl "https://api.apify.com/v2/datasets/{DATASET_ID}/items?format=json"
```

#### Python

```python
from apify_client import ApifyClient
client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("goat255/circle-community-scraper").call(run_input={
    "goals": ["be-more-productive", "start-and-scale-my-business"],
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(f"{item['name']:40}  {item['humanReadablePrice']:>20}  {item['communityName']}")
```

#### JavaScript / Node.js

```javascript
import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });
const run = await client.actor('goat255/circle-community-scraper').call({
    goals: ['be-more-productive'],
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach(i => console.log(`${i.name}: ${i.humanReadablePrice}`));
```

#### No-code

Send results to Google Sheets, Slack, Zapier, Make, Amazon S3, HubSpot, or any webhook via [Apify Integrations](https://docs.apify.com/platform/integrations).

### FAQ

#### Do I need a Circle account or API key?

No. The scraper uses Circle's public discovery API at `discover.circle.so`. No login, no API key.

#### Why are some prices null?

Listings can be free, gated behind a payment, or use an external URL for purchase. The actor still returns the listing — `isFree` and `priceUsd` tell you which.

#### What's the difference between `priceUsd` and `monthlyPriceUsd`?

`priceUsd` is the raw price as charged. `monthlyPriceUsd` normalises year-billed listings (e.g. $588/year) to a monthly equivalent ($49/mo) so you can compare apples-to-apples across the directory.

#### Can I scrape private Circle communities?

No - this scraper covers only publicly listed Circle communities in the discovery directory. Private communities aren't exposed by the discovery API.

#### How fast is it?

One goal (~300 listings) with no enrichment: ~30 seconds. All 20 goals (typically 4-6k listings): 5-10 minutes.

#### What if I want a specific community I can't find?

Use the **searchKeywords** input to run Circle's internal search API. That endpoint surfaces some listings that aren't on the goal pages.

#### Can I export to CSV / Google Sheets / Excel?

Yes - JSON / CSV / Excel / XML / HTML all supported, plus native integrations.

### Related Apify actors

- 🎓 [Skool Scraper](https://apify.com/goat255/skool-scraper-goat) - the same idea, for Skool.com communities.
- 📝 [Skool Post Scraper](https://apify.com/goat255/skool-post-scraper) - Skool posts + comments.
- 💰 [Patreon Creator Scraper](https://apify.com/goat255/patreon-creator-scraper) - Patreon creators with MRR estimates.
- 👤 [Instagram Profile Scraper](https://apify.com/goat255/instagram-profile-scraper) - Instagram profiles with emails.

### Support

Open an issue on the actor page if a field's missing or a goal stops working. Reviews are read and replied to.

# Actor input Schema

## `goals` (type: `array`):

Circle.so goal slugs (categories) to scrape. Replace the placeholder below with real slugs like "be-more-productive" or "start-and-scale-my-business". Leave empty to scrape all 20 goals.

## `searchKeywords` (type: `array`):

Optional keywords to run through Circle's internal search API. Surfaces listings hidden from goal pages.

## `proxyConfiguration` (type: `object`):

Proxy settings. Circle's discovery API is public so proxies are optional, but residential helps reliability on long runs.

## Actor input object example

```json
{
  "goals": [
    "__apify_health_check__"
  ],
  "searchKeywords": [],
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": []
  }
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "goals": [
        "__apify_health_check__"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("goat255/circle-community-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "goals": ["__apify_health_check__"] }

# Run the Actor and wait for it to finish
run = client.actor("goat255/circle-community-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "goals": [
    "__apify_health_check__"
  ]
}' |
apify call goat255/circle-community-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=goat255/circle-community-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Circle.so Community Scraper",
        "description": "Scrape Circle.so's public discovery directory at scale. Returns clean ordered rows: name, community, creator, pricing, tags, outcomes, target audience, category.",
        "version": "0.0",
        "x-build-id": "I9QeJ5TPq6nPFNC3n"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/goat255~circle-community-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-goat255-circle-community-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/goat255~circle-community-scraper/runs": {
            "post": {
                "operationId": "runs-sync-goat255-circle-community-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/goat255~circle-community-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-goat255-circle-community-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "properties": {
                    "goals": {
                        "title": "Goal Slugs",
                        "uniqueItems": true,
                        "type": "array",
                        "description": "Circle.so goal slugs (categories) to scrape. Replace the placeholder below with real slugs like \"be-more-productive\" or \"start-and-scale-my-business\". Leave empty to scrape all 20 goals.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "searchKeywords": {
                        "title": "Search Keywords",
                        "uniqueItems": true,
                        "type": "array",
                        "description": "Optional keywords to run through Circle's internal search API. Surfaces listings hidden from goal pages.",
                        "default": [],
                        "items": {
                            "type": "string"
                        }
                    },
                    "proxyConfiguration": {
                        "title": "Proxy Configuration",
                        "type": "object",
                        "description": "Proxy settings. Circle's discovery API is public so proxies are optional, but residential helps reliability on long runs.",
                        "default": {
                            "useApifyProxy": true,
                            "apifyProxyGroups": []
                        }
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```