Bluesky Post & Profile Scraper (AT Protocol API)

Extract public posts, keyword search results, and user profile timelines from Bluesky using the official AT Protocol API.

Designed for AI engineers, researchers, and data teams building social sentiment feeds or RAG datasets. Unlike traditional social media scrapers, this Actor queries the open AT Protocol directly—requiring no login accounts, no session cookies, and no residential proxy markups.

---

Features

• Keyword & Hashtag Search: Query public posts across the entire Bluesky network by keyword, phrase, or topic.
• User Profile Timelines: Extract full post histories and replies directly from user handles (e.g. bsky.app or username.bsky.social).
• Normalized Social Metrics: Captures like counts, repost counts, reply counts, quote counts, and media flags alongside author metadata (handle, display name, DID).
• RAG-Ready Output: Clean text and ISO timestamps ready for direct ingestion into vector stores, LLM evaluation pipelines, or CSV exports.
• Lightweight & Fast: Runs on sub-128 MB RAM containers using asynchronous HTTP requests without browser emulation overhead.

---

Input Parameters

Parameter	Type	Default	Description
mode	String	"search"	Scrape mode: search (keyword search) or profile (user timeline).
query	String	"artificial intelligence"	Keywords or hashtags to search across posts (used in search mode).
handle	String	null	Target user handle (e.g. bsky.app or full profile URL, used in profile mode).
maxItems	Integer	100	Maximum number of posts to return.

Example Input (Keyword Search)

{
  "mode": "search",
  "query": "artificial intelligence",
  "maxItems": 100
}

Example Input (Profile Feed)

{
  "mode": "profile",
  "handle": "bsky.app",
  "maxItems": 50
}

---

Sample Output

{
  "uri": "at://did:plc:z72i7hdynmk6r22z27h6tvur/app.bsky.feed.post/3la2j3s3hnc2m",
  "cid": "bafyreih3h5i2...",
  "url": "https://bsky.app/profile/bsky.app/post/3la2j3s3hnc2m",
  "text": "Introducing custom feeds on Bluesky...",
  "created_at": "2024-05-20T18:42:00.000Z",
  "author_handle": "bsky.app",
  "author_name": "Bluesky",
  "author_did": "did:plc:z72i7hdynmk6r22z27h6tvur",
  "reply_count": 42,
  "repost_count": 128,
  "like_count": 512,
  "quote_count": 19,
  "lang": "en",
  "has_media": false
}

---

Use Cases

• Collecting real-time discussion data for LLM fine-tuning, RAG pipelines, or AI agent context.
• Monitoring brand mentions, product feedback, or developer sentiment.
• Analyzing social engagement metrics across creator or company profiles.

---

Performance

This Actor performs direct asynchronous requests to the AT Protocol AppView endpoint (api.bsky.app/xrpc). Requests complete in milliseconds without headless browsers or proxy networks.