# Twitter Post Scraper (`nifty.codes/twitter-posts-scraper`) Actor Extract Twitter posts including engagement metrics, author details, and media URLs from feeds, profiles, and hashtag pages. Powered by Twitter Scraper. - **URL**: https://apify.com/nifty.codes/twitter-posts-scraper.md - **Developed by:** [Nifty](https://apify.com/nifty.codes) (community) - **Categories:** Social media - **Stats:** 2 total users, 1 monthly users, 50.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $2.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Introduction This actor extracts Posts in a List from Twitter. It captures full post content, engagement metrics like likes and views, and detailed author metadata from any feed, profile, or hashtag page. The scraper provides structured data for social media analysis and sentiment tracking. ## Data Fields | Field Name | Description | Example | | :--- | :--- | :--- | | Post Text | The content of the tweet | "Hello world! #tech" | | Post Date | Timestamp of publication | "2023-10-27T10:00:00.000Z" | | Post URL | Direct link to the tweet | "https://x.com/user/status/123" | | Post Language | BCP 47 language code | "en" | | Post Views | Number of views | 1500 | | Post Likes | Number of likes | 45 | | Post Replies | Number of replies | 12 | | Post Reposts | Number of reposts | 8 | | Post Quotes | Number of quote tweets | 3 | | Post Bookmarks | Number of bookmarks | 5 | | Is Retweet | Boolean status for retweets | false | | Author Name | Display name of the user | "John Doe" | | Author Username | Handle of the user | "johndoe" | | Author URL | Link to user profile | "https://x.com/johndoe" | | Author Description | User bio text | "Software developer and blogger." | | Author Location | User-defined location | "San Francisco, CA" | | Author Followers | Count of followers | 1200 | | Author Following | Count of following | 300 | | Author Posts Count | Total posts by user | 5000 | | Author Join Date | Account creation date | "2012-05-15" | | Author Is Verified | Verification status | true | | Author Profile Image | URL to profile picture | "https://pbs.twimg.com/profile_images/123.jpg" | | Author Profile Banner | URL to banner image | "https://pbs.twimg.com/profile_banners/123.jpg" | | Author Media Count | Total media items posted | 450 | | All Media URLs | Array of media links | ["https://pbs.twimg.com/media/xyz.jpg"] | | Media Types | Types of media attached | ["photo"] | | Has Media | Boolean for media presence | true | | Media Count | Number of media items | 1 | | Is Reply | Boolean for reply status | false | | Reply To User | Username of parent author | null | | Is Quote Tweet | Boolean for quote status | false | | Is Translatable | If translation is available | true | | Is Editable | If the post can be edited | true | | Edits Remaining | Number of edits left | 5 | ## Input - `urls`: Array of Twitter URLs. Supports profile pages, hashtag pages, and home feeds. - `maxItems`: Maximum number of posts to extract per URL. Default is 100. ## Example Input ```json { "urls": ["https://x.com/search?q=technology"], "maxItems": 50 } ```` ## Example Output ```json [ { "postText": "Exploring the future of AI.", "postDate": "2023-10-27T14:20:00.000Z", "postUrl": "https://x.com/tech_insider/status/987654321", "postLanguage": "en", "postViews": 12500, "postLikes": 340, "postReplies": 22, "postReposts": 55, "postQuotes": 10, "postBookmarks": 15, "isRetweet": false, "authorName": "Tech Insider", "authorUsername": "tech_insider", "authorUrl": "https://x.com/tech_insider", "authorDescription": "Daily tech news.", "authorLocation": "New York", "authorFollowers": 50000, "authorFollowing": 200, "authorPostsCount": 12000, "authorJoinDate": "2015-01-01", "authorIsVerified": true, "authorProfileImage": "https://pbs.twimg.com/profile_images/1.jpg", "authorProfileBanner": "https://pbs.twimg.com/profile_banners/1.jpg", "authorMediaCount": 2000, "allMediaUrls": ["https://pbs.twimg.com/media/img1.jpg"], "mediaTypes": ["photo"], "hasMedia": true, "mediaCount": 1, "isReply": false, "replyToUser": null, "isQuoteTweet": false, "isTranslatable": true, "isEditable": true, "editsRemaining": 5 }, { "postText": "Check out this sunset!", "postDate": "2023-10-27T18:05:00.000Z", "postUrl": "https://x.com/traveler/status/1122334455", "postLanguage": "en", "postViews": 500, "postLikes": 80, "postReplies": 5, "postReposts": 2, "postQuotes": 1, "postBookmarks": 2, "isRetweet": false, "authorName": "Traveler", "authorUsername": "traveler_99", "authorUrl": "https://x.com/traveler_99", "authorDescription": "Exploring the world.", "authorLocation": "London", "authorFollowers": 1500, "authorFollowing": 400, "authorPostsCount": 800, "authorJoinDate": "2018-06-10", "authorIsVerified": false, "authorProfileImage": "https://pbs.twimg.com/profile_images/2.jpg", "authorProfileBanner": "https://pbs.twimg.com/profile_banners/2.jpg", "authorMediaCount": 300, "allMediaUrls": ["https://pbs.twimg.com/media/img2.jpg"], "mediaTypes": ["photo"], "hasMedia": true, "mediaCount": 1, "isReply": false, "replyToUser": null, "isQuoteTweet": false, "isTranslatable": true, "isEditable": true, "editsRemaining": 5 } ] ``` #### Want more from Twitter? This actor only covers **Posts in a List**. The full **Twitter Scraper** browser extension also includes **User Details, Users in a List, Trending Topics** with unlimited personal use, real-time scraping with your logged-in sessions, CSV/Excel/JSON export, field customization, and scheduled monitoring. **[Get the Twitter Scraper extension](https://nifty.codes/e/twitter-scraper)** Disclaimer: This tool extracts publicly available data. Users are responsible for compliance with applicable terms of service. # Actor input Schema ## `urls` (type: `array`): URLs to scrape. Must match: x.com ## `maxItems` (type: `integer`): Maximum number of items to extract per URL ## `enablePagination` (type: `boolean`): Load more results beyond the first page. Note: pagination may be unstable for this actor. ## `maxPages` (type: `integer`): Maximum number of pagination actions (pages, scrolls, or loads) ## Actor input object example ```json { "urls": [ "https://x.com/elonmusk" ], "maxItems": 100, "enablePagination": false, "maxPages": 1 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("nifty.codes/twitter-posts-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("nifty.codes/twitter-posts-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call nifty.codes/twitter-posts-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=nifty.codes/twitter-posts-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Twitter Post Scraper", "description": "Extract Twitter posts including engagement metrics, author details, and media URLs from feeds, profiles, and hashtag pages. Powered by Twitter Scraper.", "version": "3.2", "x-build-id": "aeq2d4dJjtUbYt0gd" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/nifty.codes~twitter-posts-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-nifty.codes-twitter-posts-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/nifty.codes~twitter-posts-scraper/runs": { "post": { "operationId": "runs-sync-nifty.codes-twitter-posts-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/nifty.codes~twitter-posts-scraper/run-sync": { "post": { "operationId": "run-sync-nifty.codes-twitter-posts-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "urls" ], "properties": { "urls": { "title": "URLs", "type": "array", "description": "URLs to scrape. Must match: x.com", "items": { "type": "string" }, "default": [ "https://x.com/elonmusk" ] }, "maxItems": { "title": "Max items", "minimum": 1, "type": "integer", "description": "Maximum number of items to extract per URL", "default": 100 }, "enablePagination": { "title": "Paginate", "type": "boolean", "description": "Load more results beyond the first page. Note: pagination may be unstable for this actor.", "default": false }, "maxPages": { "title": "Max pagination steps", "minimum": 1, "type": "integer", "description": "Maximum number of pagination actions (pages, scrolls, or loads)", "default": 1 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```