# Bluesky Scraper – Posts, Profiles, Search & Monitoring (`bitofacoder/bluesky-scraper`) Actor Scrape Bluesky posts, profiles, search results, author feeds, followers/follows, and full threads via the open AT Protocol API. Includes an incremental monitor mode for tracking keywords and accounts over time. - **URL**: https://apify.com/bitofacoder/bluesky-scraper.md - **Developed by:** [Bobby](https://apify.com/bitofacoder) (community) - **Categories:** Social media, Automation, News - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Bluesky Scraper – Posts, Profiles, Search & Monitoring Scrape **Bluesky** (the AT Protocol social network) without writing code. Extract **posts, profiles, search results, author feeds, followers/following, and full threads** as clean structured JSON, CSV, or Excel — and **monitor** keywords or accounts so each run returns only what's new. Built directly on the open AT Protocol API. **No authentication required** for most data; add a Bluesky **app password** to unlock deep search pagination. ### What can this Bluesky Scraper do? | Mode | What you get | Key input | | --- | --- | --- | | **Search posts** ¹ | Full-text post search by keyword, phrase, or `#hashtag` | `searchQueries` | | **Profiles** | Full profile details (bio, counts, avatar, banner, labels) | `handles` | | **Author feed** | Every post (and optionally replies/reposts) by an account | `handles` | | **Followers / Following** | The social graph of any account | `handles` + `socialEdge` | | **Thread** | A post plus its complete, depth-limited reply tree | `postUrls` | | **Monitor** ⭐ | Incremental tracking — only items newer than the last run | `searchQueries` or `handles` | ⭐ **Monitor mode** is what makes this scraper different: schedule it (e.g. hourly) to track brand mentions, competitors, or accounts and get only the new posts each time — perfect for alerts, dashboards, and reputation tracking. ¹ Post search requires authentication (see below). All other modes work with no credentials. ### Rich, analysis-ready output Every post is flattened with engagement counts, media URLs, external link cards, hashtags, mentions, language, quoted-post references, moderation labels, and reply/repost context: ```json { "type": "post", "url": "https://bsky.app/profile/alice.bsky.social/post/3lk...", "text": "Trying out the new Bluesky scraper!", "createdAt": "2026-06-17T10:00:00.000Z", "lang": "en", "author": { "handle": "alice.bsky.social", "displayName": "Alice", "did": "did:plc:..." }, "likeCount": 42, "repostCount": 7, "replyCount": 3, "quoteCount": 1, "tags": ["bluesky"], "media": [{ "type": "image", "url": "https://...", "alt": "screenshot" }], "externalLink": null, "quotedPost": null, "labels": [] } ```` ### Quick start 1. Choose a **Mode**. 2. Fill in the fields that mode uses (e.g. `searchQueries` for Search). 3. Click **Start**. Results stream into the dataset. Run with the defaults to instantly scrape recent posts from **@bsky.app** — no credentials needed. ### Authentication Profiles, author feeds, followers/following, and threads all work **without credentials**. However, Bluesky **blocks post search for unauthenticated clients**, so the **Search** and **Monitor (source = search)** modes require an app password: 1. On bsky.app, go to **Settings → Privacy and Security → App Passwords** and create one. 2. Set `blueskyIdentifier` (your handle or email) and `blueskyAppPassword`. Never use your main account password — always an app password. Authentication also raises your rate budget for the no-auth modes. ### Proxy & rate limits The public API allows ~3000 requests / 5 min per IP, and the Actor automatically retries with backoff on HTTP 429/5xx. Proxy is **off by default** — small runs don't need it. For large runs, enable **Apify Proxy** in the input to rotate IPs and spread the per-IP rate limit. ### Notes - Only public data is collected. Respect Bluesky's terms and applicable laws. - This Actor is independent and not affiliated with Bluesky or the AT Protocol team. # Actor input Schema ## `mode` (type: `string`): What to scrape. Each mode uses a different set of fields below. ## `searchQueries` (type: `array`): Used by the 'search' and 'monitor' modes. Keywords, phrases, or #hashtags. One run scrapes each query. ## `searchSort` (type: `string`): Sort search results by newest ('latest') or by engagement ('top'). ## `lang` (type: `string`): Optional BCP-47 language code to restrict results, e.g. 'en', 'fr', 'ja'. ## `since` (type: `string`): Optional lower time bound for search, e.g. 2026-01-01T00:00:00Z. ## `until` (type: `string`): Optional upper time bound for search, e.g. 2026-06-01T00:00:00Z. ## `handles` (type: `array`): Used by 'profile', 'authorFeed', 'social', and 'monitor' (source = authorFeed). e.g. \['bsky.app', 'jay.bsky.team']. ## `authorFeedFilter` (type: `string`): Which posts to include from an account's feed ('authorFeed' mode). ## `socialEdge` (type: `string`): For 'social' mode: scrape an account's followers or who it follows. ## `postUrls` (type: `array`): Used by 'thread' mode. bsky.app post URLs or at:// URIs. e.g. \['https://bsky.app/profile/bsky.app/post/3l...']. ## `threadDepth` (type: `integer`): How many levels of replies to traverse for 'thread' mode. ## `monitorSource` (type: `string`): For 'monitor' mode: track new posts matching 'searchQueries', or new posts from 'handles'. ## `monitorAuthorFeedFilter` (type: `string`): For 'monitor' mode with source = Author feeds: which posts to watch. ## `monitorStoreName` (type: `string`): Named key-value store that holds per-target watermarks across runs. Use a DISTINCT name per monitor — two runs sharing the same store name will overwrite each other's watermarks. Don't run two monitors with the same name concurrently. ## `maxItems` (type: `integer`): Upper limit of items per query/handle/thread. Note: without authentication, search returns only the first page (up to 100). ## `maxTotalItems` (type: `integer`): Hard ceiling on the total number of results — and pay-per-result charges — across ALL targets in one run. Leave empty for no overall cap. 'Max items per target' above still applies to each query/handle/thread. ## `blueskyIdentifier` (type: `string`): Provide with an app password to authenticate. Unlocks deep search pagination and a per-account rate budget. Use an APP PASSWORD, never your main password. ## `blueskyAppPassword` (type: `string`): Create one at Settings → App Passwords on bsky.app. Stored encrypted. ## `proxyConfiguration` (type: `object`): Off by default — the public AppView is an open API and small runs don't need a proxy. Enable Apify Proxy to rotate IPs and spread the per-IP rate limit on large runs. ## Actor input object example ```json { "mode": "authorFeed", "searchQueries": [ "bluesky" ], "searchSort": "latest", "handles": [ "bsky.app" ], "authorFeedFilter": "posts_with_replies", "socialEdge": "followers", "threadDepth": 6, "monitorSource": "search", "monitorAuthorFeedFilter": "posts_no_replies", "monitorStoreName": "bluesky-monitor-state", "maxItems": 100, "proxyConfiguration": { "useApifyProxy": false } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchQueries": [ "bluesky" ], "handles": [ "bsky.app" ] }; // Run the Actor and wait for it to finish const run = await client.actor("bitofacoder/bluesky-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchQueries": ["bluesky"], "handles": ["bsky.app"], } # Run the Actor and wait for it to finish run = client.actor("bitofacoder/bluesky-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchQueries": [ "bluesky" ], "handles": [ "bsky.app" ] }' | apify call bitofacoder/bluesky-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=bitofacoder/bluesky-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Bluesky Scraper – Posts, Profiles, Search & Monitoring", "description": "Scrape Bluesky posts, profiles, search results, author feeds, followers/follows, and full threads via the open AT Protocol API. Includes an incremental monitor mode for tracking keywords and accounts over time.", "version": "0.1", "x-build-id": "W4Ea4ABPqYoHetbLA" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/bitofacoder~bluesky-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-bitofacoder-bluesky-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/bitofacoder~bluesky-scraper/runs": { "post": { "operationId": "runs-sync-bitofacoder-bluesky-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/bitofacoder~bluesky-scraper/run-sync": { "post": { "operationId": "run-sync-bitofacoder-bluesky-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "search", "profile", "authorFeed", "social", "thread", "monitor" ], "type": "string", "description": "What to scrape. Each mode uses a different set of fields below.", "default": "authorFeed" }, "searchQueries": { "title": "Search queries", "type": "array", "description": "Used by the 'search' and 'monitor' modes. Keywords, phrases, or #hashtags. One run scrapes each query.", "default": [ "bluesky" ], "items": { "type": "string" } }, "searchSort": { "title": "Sort order", "enum": [ "latest", "top" ], "type": "string", "description": "Sort search results by newest ('latest') or by engagement ('top').", "default": "latest" }, "lang": { "title": "Language filter", "type": "string", "description": "Optional BCP-47 language code to restrict results, e.g. 'en', 'fr', 'ja'." }, "since": { "title": "Since (ISO 8601)", "type": "string", "description": "Optional lower time bound for search, e.g. 2026-01-01T00:00:00Z." }, "until": { "title": "Until (ISO 8601)", "type": "string", "description": "Optional upper time bound for search, e.g. 2026-06-01T00:00:00Z." }, "handles": { "title": "Handles or DIDs", "type": "array", "description": "Used by 'profile', 'authorFeed', 'social', and 'monitor' (source = authorFeed). e.g. ['bsky.app', 'jay.bsky.team'].", "default": [ "bsky.app" ], "items": { "type": "string" } }, "authorFeedFilter": { "title": "Author feed filter", "enum": [ "posts_with_replies", "posts_no_replies", "posts_with_media", "posts_and_author_threads" ], "type": "string", "description": "Which posts to include from an account's feed ('authorFeed' mode).", "default": "posts_with_replies" }, "socialEdge": { "title": "Social edge", "enum": [ "followers", "follows" ], "type": "string", "description": "For 'social' mode: scrape an account's followers or who it follows.", "default": "followers" }, "postUrls": { "title": "Post URLs", "type": "array", "description": "Used by 'thread' mode. bsky.app post URLs or at:// URIs. e.g. ['https://bsky.app/profile/bsky.app/post/3l...'].", "items": { "type": "string" } }, "threadDepth": { "title": "Thread reply depth", "minimum": 0, "maximum": 100, "type": "integer", "description": "How many levels of replies to traverse for 'thread' mode.", "default": 6 }, "monitorSource": { "title": "Monitor source", "enum": [ "search", "authorFeed" ], "type": "string", "description": "For 'monitor' mode: track new posts matching 'searchQueries', or new posts from 'handles'.", "default": "search" }, "monitorAuthorFeedFilter": { "title": "Monitor author-feed filter", "enum": [ "posts_with_replies", "posts_no_replies", "posts_with_media", "posts_and_author_threads" ], "type": "string", "description": "For 'monitor' mode with source = Author feeds: which posts to watch.", "default": "posts_no_replies" }, "monitorStoreName": { "title": "Monitor state store name", "type": "string", "description": "Named key-value store that holds per-target watermarks across runs. Use a DISTINCT name per monitor — two runs sharing the same store name will overwrite each other's watermarks. Don't run two monitors with the same name concurrently.", "default": "bluesky-monitor-state" }, "maxItems": { "title": "Max items per target", "minimum": 1, "type": "integer", "description": "Upper limit of items per query/handle/thread. Note: without authentication, search returns only the first page (up to 100).", "default": 100 }, "maxTotalItems": { "title": "Max items total (whole run)", "minimum": 1, "type": "integer", "description": "Hard ceiling on the total number of results — and pay-per-result charges — across ALL targets in one run. Leave empty for no overall cap. 'Max items per target' above still applies to each query/handle/thread." }, "blueskyIdentifier": { "title": "Bluesky handle or email (optional)", "type": "string", "description": "Provide with an app password to authenticate. Unlocks deep search pagination and a per-account rate budget. Use an APP PASSWORD, never your main password." }, "blueskyAppPassword": { "title": "Bluesky app password (optional)", "type": "string", "description": "Create one at Settings → App Passwords on bsky.app. Stored encrypted." }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Off by default — the public AppView is an open API and small runs don't need a proxy. Enable Apify Proxy to rotate IPs and spread the per-IP rate limit on large runs.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```