# X (Twitter) Community Post Search - All Communities (`seemuapps/x-community-post-search-scraper`) Actor Search posts across all X (Twitter) Communities by keyword - full text, author, and engagement metrics. Find niche discussions no regular search surfaces. - **URL**: https://apify.com/seemuapps/x-community-post-search-scraper.md - **Developed by:** [Andrew](https://apify.com/seemuapps) (community) - **Categories:** Lead generation, Social media - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 community post scrapeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## X (Twitter) Community Post Search - All Communities Search posts across **all** X (Twitter) Communities by keyword — full text, author, and engagement metrics in one run. Regular X search doesn't surface Community-only posts; this does. No login, no cookies. ### What you get For every matching Community post: - **Tweet fields** — tweet ID, URL, full text, creation date, and language - **Engagement metrics** — retweets, replies, likes, quotes, views, and bookmarks - **Author info** — username, user ID, display name, blue-verified status, follower count, and profile picture URL - **Sort control** — newest first or highest engagement first - Paginated output: each run returns a cursor so you can keep fetching across multiple runs - Export to JSON, CSV, Excel, or Google Sheets directly from the Apify console ### Use cases - **Niche audience research** — Communities are where topic-focused conversations happen; search them all at once - **Lead generation** — find engaged accounts discussing your product category inside private-feeling Communities - **Brand monitoring** — catch mentions of your brand that never appear in the public timeline search - **Content ideas** — see which Community posts on a topic get the most engagement - **Trend detection** — spot emerging discussions before they hit the main timeline ### How to use 1. Enter a **Search Query** — any keyword or phrase (e.g. `indie hackers`, `keto recipes`, your brand name) 2. Pick a **Sort Order** — *Latest* (chronological) or *Top* (most engagement) 3. Set **Max Posts** (default 100; set 0 for unlimited) 4. Run the actor — results appear in the **Dataset** tab #### Fetching more (pagination) After a run finishes, open the **Key-value store** tab → copy the `NEXT_PAGE_ID` value → paste it into **Page ID** on your next run. If `NEXT_PAGE_ID` is `null`, you've fetched everything. ### Output format Each dataset record: ```json { "searchQuery": "indie hackers", "tweetId": "1866332309399781537", "url": "https://x.com/user/status/1866332309399781537", "text": "Just shipped my first SaaS…", "createdAt": "Tue Dec 10 03:14:59 +0000 2024", "lang": "en", "retweetCount": 12, "replyCount": 34, "likeCount": 256, "quoteCount": 3, "viewCount": 10422, "bookmarkCount": 41, "isReply": false, "conversationId": "1866332309399781537", "authorUsername": "example", "authorUserId": "44196397", "authorName": "Example User", "authorIsBlueVerified": true, "authorFollowersCount": 15230, "authorProfilePicture": "https://pbs.twimg.com/profile_images/…" } ```` ### FAQ **Do I need X login credentials?** No. Enter a keyword and run. **Which Communities are searched?** All public X Communities — the search runs across every Community at once. **Can I search a single specific Community instead?** Use our *X Community Tweets Scraper* to pull the full feed of one Community by its ID. # Actor input Schema ## `query` (type: `string`): Keyword or phrase to search for across all public X Communities. ## `queryType` (type: `string`): Latest returns most recent Community posts first. Top returns highest-engagement posts first. ## `maxItems` (type: `integer`): Maximum Community posts to return. Set 0 for unlimited (auto-paginates). ## `pageId` (type: `string`): Optional. Paste NEXT\_PAGE\_ID from a previous run's Key-value store to fetch the next page. ## Actor input object example ```json { "query": "indie hackers", "queryType": "Latest", "maxItems": 100 } ``` # Actor output Schema ## `results` (type: `string`): One row per post: searchQuery, tweetId, url, text, createdAt, lang, engagement counts, and author info. ## `nextPageId` (type: `string`): NEXT\_PAGE\_ID record in the default key-value store. Paste into Page ID on the next run to resume; null when results are exhausted. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "query": "indie hackers" }; // Run the Actor and wait for it to finish const run = await client.actor("seemuapps/x-community-post-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "query": "indie hackers" } # Run the Actor and wait for it to finish run = client.actor("seemuapps/x-community-post-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "query": "indie hackers" }' | apify call seemuapps/x-community-post-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=seemuapps/x-community-post-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "X (Twitter) Community Post Search - All Communities", "description": "Search posts across all X (Twitter) Communities by keyword - full text, author, and engagement metrics. Find niche discussions no regular search surfaces.", "version": "1.0", "x-build-id": "9fouV7hE9wMZtZ1GQ" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/seemuapps~x-community-post-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-seemuapps-x-community-post-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/seemuapps~x-community-post-search-scraper/runs": { "post": { "operationId": "runs-sync-seemuapps-x-community-post-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/seemuapps~x-community-post-search-scraper/run-sync": { "post": { "operationId": "run-sync-seemuapps-x-community-post-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "query" ], "properties": { "query": { "title": "Search Query", "type": "string", "description": "Keyword or phrase to search for across all public X Communities." }, "queryType": { "title": "Sort Order", "enum": [ "Latest", "Top" ], "type": "string", "description": "Latest returns most recent Community posts first. Top returns highest-engagement posts first.", "default": "Latest" }, "maxItems": { "title": "Max Posts", "minimum": 0, "type": "integer", "description": "Maximum Community posts to return. Set 0 for unlimited (auto-paginates).", "default": 100 }, "pageId": { "title": "Page ID (pagination)", "type": "string", "description": "Optional. Paste NEXT_PAGE_ID from a previous run's Key-value store to fetch the next page." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```