# Nostr Scraper - Profiles, Notes, Followers & Leads (`mangudai/nostr-scraper`) Actor Scrape public Nostr data from open relays with no login or API key. Turn any account's following or followers into a lead list with Lightning addresses, NIP-05 IDs and websites. Search notes by keyword, or pull profiles and posts by npub or NIP-05. - **URL**: https://apify.com/mangudai/nostr-scraper.md - **Developed by:** [MangudΓ€i](https://apify.com/mangudai) (community) - **Categories:** Lead generation, Developer tools, Open source - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.01 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Nostr scraper: profiles, notes, followers and following Scrape public Nostr data straight from open relays. Give it an account or a keyword and get back clean, structured rows: display name, bio, NIP-05 identifier, Lightning address, website, and recent notes. No login, no API key, no captcha, no proxy required. Nostr profiles carry contact-grade fields that most social networks hide. The Lightning address (lud16) and NIP-05 identifier are public by design, so a single run can turn one account's social graph into a usable lead list for Bitcoin, Lightning and web3 outreach. ### What it does Five modes, one actor: - **Following**: give an account, get every account it follows, resolved to full profiles. This is the fast way to build a lead list from a well-connected hub. - **Followers**: give an account, get the accounts that follow it, resolved to full profiles. - **Profiles**: look up one or many accounts and get their full metadata. - **Posts**: pull recent notes for the accounts you list. - **Search**: find notes matching a keyword across search relays, with the author's profile attached. You can point it at an `npub`, an `nprofile`, a raw hex public key, or a NIP-05 address like `odell@primal.net`. Mixed lists are fine. ### Example input Build a lead list from an account's follow graph: ```json { "mode": "following", "identifiers": ["npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx"], "maxItems": 100 } ```` Search notes by keyword: ```json { "mode": "search", "searchQuery": "bitcoin lightning", "maxItems": 50 } ``` Look up specific profiles: ```json { "mode": "profile", "identifiers": ["odell@primal.net", "npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx"] } ``` ### Output Profile rows include the npub, hex public key, name, display name, NIP-05, Lightning address, website, bio, avatar and banner, plus a `profileUrl` you can open in any browser. Note rows include the note text, note id, author, hashtags, timestamp and a `noteUrl`. Every row has a `type` (`profile` or `note`) and the `mode` that produced it. Sample profile row: ```json { "type": "profile", "mode": "following", "npub": "npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx", "name": "ODELL", "nip05": "odell@primal.net", "lightningAddress": "odell@primal.net", "website": "https://odell.xyz", "about": "partner - ten31 ...", "profileUrl": "https://njump.me/odell@primal.net" } ``` Export to JSON, CSV, or Excel, or pull it through the Apify API. ### Who uses it - Bitcoin and Lightning teams building outreach lists with public Lightning addresses. - Web3 CRM and airdrop research that needs npubs, NIP-05 identifiers and linked sites. - Analysts tracking how a topic or account grows across the network. - Client and bot builders who want bulk profile and note data without running their own relay. ### How it works The actor speaks the Nostr protocol (NIP-01) directly to a pool of open relays, queries several at once, and dedupes events by id so you get the most complete result. Keyword search uses NIP-50 search relays. NIP-05 addresses resolve over HTTPS from each domain's `/.well-known/nostr.json`. All of this is public data that relays serve without authentication. ### Notes Nostr data is spread across relays, so coverage depends on which relays hold a given account's events. The defaults cover the busy public relays; you can override them with the `relays` field. Search depends on relays that support NIP-50, which come and go, so results there vary more than profile and follow lookups. # Actor input Schema ## `mode` (type: `string`): What to scrape. 'following' and 'followers' turn one account's social graph into a list of lead profiles. 'search' finds notes by keyword. 'profile' and 'posts' work on the accounts you list. ## `identifiers` (type: `array`): npub, nprofile, hex pubkey, or NIP-05 address (name@domain). Used by the following, followers, profile and posts modes. ## `searchQuery` (type: `string`): Keyword(s) to search for in notes. Used by the search mode. ## `maxItems` (type: `integer`): Maximum number of rows to return. ## `postsPerAuthor` (type: `integer`): Posts mode only: how many recent notes to fetch per account. ## `relays` (type: `array`): Optional. Override the default general-purpose relays (wss:// URLs). ## Actor input object example ```json { "mode": "following", "identifiers": [ "npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx" ], "searchQuery": "bitcoin", "maxItems": 100, "postsPerAuthor": 20, "relays": [] } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "identifiers": [ "npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx" ], "searchQuery": "bitcoin", "relays": [] }; // Run the Actor and wait for it to finish const run = await client.actor("mangudai/nostr-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "identifiers": ["npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx"], "searchQuery": "bitcoin", "relays": [], } # Run the Actor and wait for it to finish run = client.actor("mangudai/nostr-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "identifiers": [ "npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx" ], "searchQuery": "bitcoin", "relays": [] }' | apify call mangudai/nostr-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=mangudai/nostr-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Nostr Scraper - Profiles, Notes, Followers & Leads", "description": "Scrape public Nostr data from open relays with no login or API key. Turn any account's following or followers into a lead list with Lightning addresses, NIP-05 IDs and websites. Search notes by keyword, or pull profiles and posts by npub or NIP-05.", "version": "0.0", "x-build-id": "nQ30Fl60gFUDMxJ4Z" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/mangudai~nostr-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-mangudai-nostr-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/mangudai~nostr-scraper/runs": { "post": { "operationId": "runs-sync-mangudai-nostr-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/mangudai~nostr-scraper/run-sync": { "post": { "operationId": "run-sync-mangudai-nostr-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "mode": { "title": "Mode", "enum": [ "following", "followers", "profile", "posts", "search" ], "type": "string", "description": "What to scrape. 'following' and 'followers' turn one account's social graph into a list of lead profiles. 'search' finds notes by keyword. 'profile' and 'posts' work on the accounts you list.", "default": "following" }, "identifiers": { "title": "Nostr identifiers", "type": "array", "description": "npub, nprofile, hex pubkey, or NIP-05 address (name@domain). Used by the following, followers, profile and posts modes.", "default": [ "npub1qny3tkh0acurzla8x3zy4nhrjz5zd8l9sy9jys09umwng00manysew95gx" ], "items": { "type": "string" } }, "searchQuery": { "title": "Search query", "type": "string", "description": "Keyword(s) to search for in notes. Used by the search mode." }, "maxItems": { "title": "Max items", "minimum": 1, "maximum": 5000, "type": "integer", "description": "Maximum number of rows to return.", "default": 100 }, "postsPerAuthor": { "title": "Posts per author", "minimum": 1, "maximum": 200, "type": "integer", "description": "Posts mode only: how many recent notes to fetch per account.", "default": 20 }, "relays": { "title": "Relays (advanced)", "type": "array", "description": "Optional. Override the default general-purpose relays (wss:// URLs).", "default": [], "items": { "type": "string" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```