# Bluesky Scraper — Posts & Profiles (`lone_cipher/bluesky-scraper`) Actor Scrape Bluesky profiles, posts, and search results via the public AT Protocol API. No login required — just a handle or search term. - **URL**: https://apify.com/lone\_cipher/bluesky-scraper.md - **Developed by:** [Ian Bartholomew](https://apify.com/lone_cipher) (community) - **Categories:** Social media - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Bluesky Scraper — Posts & Profiles ### What does Bluesky Scraper do? Bluesky Scraper enables you to extract data from [Bluesky](https://bsky.app/) using the public AT Protocol API without requiring login credentials. Bluesky Scraper can scrape: - User profiles (bio, follower count, avatar, display name) - Individual posts and threads - Search results (posts and profiles) - Post metadata (likes, reposts, replies, timestamps) - User feed data ### Why scrape Bluesky? Bluesky is a rapidly growing decentralized social network with thousands of active users sharing content daily. It's an excellent source of data for social listening, trend analysis, and content research. Here are just some of the ways you could use Bluesky data: - Monitor conversations and trends in your industry - Analyze user sentiment and engagement patterns - Research competitor activity and audience - Build datasets for natural language processing and AI training - Track hashtag trends and viral content - Gather contact information from professional profiles If you would like more inspiration on how scraping Bluesky could help your business or organization, check out our [industry pages](https://apify.com/industries). ### How to scrape Bluesky It's easy to scrape Bluesky with Bluesky Scraper. Just follow these few steps and you'll get your data in minutes. 1. Click on **Try for free**. 2. Enter a Bluesky handle (e.g., `username.bsky.social`), search term, or post URL. 3. Configure additional options like maximum posts to scrape or search filters. 4. Click on **Run**. 5. When Bluesky Scraper has finished, preview or download your data from the Dataset tab. ### How much will it cost to scrape Bluesky? Apify gives you $5 free usage credits every month on the [Apify Free plan](https://apify.com/pricing). Depending on your scraping needs, you can gather substantial amounts of data completely free. But if you need to scrape Bluesky regularly or at scale, we recommend our [$49/month Starter plan](https://apify.com/pricing) for consistent access to fresh data. For large-scale scraping operations, the [Scale plan](https://apify.com/pricing) offers even more value with higher monthly allowances. ### Results The actor returns data in JSON format: ```json { "handle": "username.bsky.social", "displayName": "Example User", "description": "Bio text here", "followersCount": 1234, "followsCount": 567, "postsCount": 890, "avatar": "https://...", "posts": [ { "uri": "at://...", "text": "Post content", "createdAt": "2024-01-15T10:30:00Z", "likeCount": 42, "replyCount": 5, "repostCount": 8, "author": { "handle": "username.bsky.social", "displayName": "Example User", "avatar": "https://..." } } ] } ```` ### Tips for scraping Bluesky - No login required — the public AT Protocol API is freely accessible - Respect rate limits to avoid temporary blocks - Use specific handles or search terms to get more relevant results - Posts and profiles are easier to scrape than real-time feeds due to API availability - Combine multiple searches to build comprehensive datasets on specific topics ### Is it legal to scrape Bluesky? Note that personal data is protected by GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. We also recommend that you read our blog post: [is web scraping legal?](https://blog.apify.com/is-web-scraping-legal/). # Actor input Schema ## `handles` (type: `array`): One or more Bluesky handles to scrape (e.g. @atprotocol.dev or @nytimes.bsky.social). You can omit the .bsky.social suffix. ## `searchQuery` (type: `string`): Optional: search posts by keyword. When provided alongside handles, results are combined. ## `maxPosts` (type: `integer`): Maximum number of posts to collect per handle or search (capped at 1000). ## Actor input object example ```json { "handles": [ "@atprotocol.dev" ], "maxPosts": 50 } ``` # Actor output Schema ## `results` (type: `string`): Bluesky profiles and posts scraped from the provided handles and/or search query. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "handles": [ "@atprotocol.dev" ], "searchQuery": "", "maxPosts": 50 }; // Run the Actor and wait for it to finish const run = await client.actor("lone_cipher/bluesky-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "handles": ["@atprotocol.dev"], "searchQuery": "", "maxPosts": 50, } # Run the Actor and wait for it to finish run = client.actor("lone_cipher/bluesky-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "handles": [ "@atprotocol.dev" ], "searchQuery": "", "maxPosts": 50 }' | apify call lone_cipher/bluesky-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=lone_cipher/bluesky-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Bluesky Scraper — Posts & Profiles", "description": "Scrape Bluesky profiles, posts, and search results via the public AT Protocol API. No login required — just a handle or search term.", "version": "0.1", "x-build-id": "fAWqSMwENbj6VN6Xr" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/lone_cipher~bluesky-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-lone_cipher-bluesky-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/lone_cipher~bluesky-scraper/runs": { "post": { "operationId": "runs-sync-lone_cipher-bluesky-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/lone_cipher~bluesky-scraper/run-sync": { "post": { "operationId": "run-sync-lone_cipher-bluesky-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "handles": { "title": "Bluesky Handles", "type": "array", "description": "One or more Bluesky handles to scrape (e.g. @atprotocol.dev or @nytimes.bsky.social). You can omit the .bsky.social suffix.", "items": { "type": "string" } }, "searchQuery": { "title": "Search Query", "type": "string", "description": "Optional: search posts by keyword. When provided alongside handles, results are combined." }, "maxPosts": { "title": "Max Posts per Source", "type": "integer", "description": "Maximum number of posts to collect per handle or search (capped at 1000).", "default": 50 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```