Bluesky Scraper — Posts, Profiles, Followers & Search
Pricing
from $0.60 / 1,000 posts
Scrape Bluesky posts by keyword or hashtag, user profiles, author feeds, followers, follows and full reply threads. No login, no browser — fast, cheap, clean JSON.
All notable changes to this Actor are documented here. The format follows Keep a Changelog .
search, profile, authorFeed, followers, follows, thread.actor-start, post-scraped, profile-scraped (see .actor/pay_per_event.json).STATS record with categorized error counters (blocked / rateLimited / proxy / network / parse / notFound / other), per-input status and charges, logged every 30 s.@atproto/api or a browser. Only 8 read-only GET endpoints are needed, so a ~300-line client keeps the image small and gives exact control over retries, rate limits and host fallback. There's no browser: everything is available as JSON.HttpCrawler. Each page depends on the previous page's cursor, so a request queue adds nothing. A loop enforces maxItems, the budget and ratelimit-reset precisely. got-scraping and Apify Proxy session rotation are still used.api.bsky.app, everything else to public.api.bsky.app. The public AppView answers searchPosts with a CDN 403. Any other method that gets a 403 on the primary host automatically switches to the fallback host.searchPosts calls that use a cursor (403 "forbidden by administrative rules") or since/until (400). We don't work around this. Date filters are applied locally, and deep search needs the user's own login (owner decision, 2026-09-26).https:// host (SSRF guard).!no-unauthenticated self-label are skipped (posts, profiles, followers, threads, quoted posts), matching Bluesky's logged-out web app. They're counted in STATS.optOutSkipped (owner decision, 2026-09-26).maxItems is per input (per search term, handle or thread), matching the product brief's field name, instead of the template's maxResults. In Profile mode it caps the number of handles.getProfiles (1 extra request per 25 profiles), so follower counts are never missing. If enrichment fails, the basic profile is saved with null counts rather than dropped.pushData succeeds. The chargeable count is checked first, so the platform's overcharge-by-one safeguard is never triggered. Dedupe keys are persisted on persistState, so a migrated run never re-pushes or re-charges.since / until and the login fields have no default or prefill. A default would silently filter or authenticate every run. Every other input field has a default and a prefill, and the default input returns results.npm audit reports moderate advisories in vitest / @vitest/mocker (dev-only; the fix needs Node 22) and in stream-json via @crawlee/core (a transitive dependency of apify; the vulnerable JSON filter functions aren't used by this Actor). CI fails on high or critical production advisories.