# Twitter X Profile Scraper (`api402/twitter-x-profile-scraper`) Actor
Twitter/X Profile & Tweet Scraper without search functionality. Extract complete profile information, tweets, replies, and media from public accounts with advanced filtering by date range, engagement metrics, and content type. UserName Thats All You Need!
- **URL**: https://apify.com/api402/twitter-x-profile-scraper.md
- **Developed by:** [Synapz (Api402)](https://apify.com/api402) (community)
- **Categories:** Automation, Social media, Lead generation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks
- **User rating**: No ratings yet
## Pricing
from $12.00 / 1,000 results
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## Twitter X Profile Scraper
### What does Twitter X Profile Scraper do?
Twitter X Profile Scraper will enable you to get more data from [X (Twitter)](https://x.com) than the official X API — without any API key, authentication, or rate limit restrictions.
Built by [MikoLabs](https://mikolabs.xyz), this Actor auto-detects what to collect — profiles, tweets, replies, or media — and delivers clean, structured data instantly. Simply provide usernames or profile URLs, and the scraper handles the rest.
Twitter X Profile Scraper can scrape:
- **Complete profile information** — bio, followers, following, location, website, join date, avatar, and banner
- **Tweets and posts** — full text, timestamps, hashtags, mentions, URLs, and engagement metrics
- **Replies and conversations** — threaded reply tweets with full context
- **Media content** — tweets containing images, videos, and GIFs
- **Retweets and quote tweets** — including original author metadata
### Why scrape X (Twitter)?
X (Twitter) has over **500 million monthly active users** and is one of the richest real-time data sources on the internet. It is a vital platform for market research, sentiment analysis, competitive intelligence, and trend tracking.
Here are just some of the ways you could use that data:
- **Brand monitoring** — Track mentions, sentiment, and customer feedback in real-time
- **Competitive intelligence** — Analyze competitor tweets, engagement strategies, and audience growth
- **Influencer research** — Discover influencers by engagement rate, follower count, and content niche
- **Lead generation** — Identify potential customers and prospects based on their public activity
- **Academic research** — Build datasets for social media studies, NLP training, and public opinion analysis
- **Content strategy** — Analyze what types of tweets drive the most engagement in your industry
- **News and trend tracking** — Monitor breaking news, emerging trends, and viral content
- **Market sentiment** — Track crypto projects, stock discussions, and financial market chatter
If you would like more inspiration on how scraping X could help your business or organization, check out our [industry pages](https://apify.com/industries).
### How to scrape X (Twitter)
It's easy to scrape [X (Twitter)](https://x.com) with Twitter X Profile Scraper. Just follow these few steps and you'll get your data in a few minutes.
1. Click on **Try for free**.
2. Enter the Twitter handles you want to scrape (e.g. `elonmusk`, `apify`), or paste profile URLs.
3. Configure your scraping options — choose whether to include replies or filter by media only.
4. Set maximum number of tweets to collect (optional).
5. Click on **Run**.
6. When Twitter X Profile Scraper has finished, preview or download your data from the **Dataset** tab.
The Actor extracts profiles and tweets without any additional configuration needed.
### Input
You can configure the scraper through the Apify Console input form or provide JSON input directly. Here are the key input fields:
| Field | Type | Description |
|---|---|---|
| `twitterHandles` | `string[]` | Twitter usernames to scrape (with or without `@`) |
| `twitterUrls` | `string[]` | Direct profile URLs (e.g. `https://x.com/elonmusk`) |
| `includeReplies` | `boolean` | Include reply tweets in results |
| `mediaOnly` | `boolean` | Scrape only tweets with images or videos |
| `maxItems` | `integer` | Max tweets to collect (Maximium: 999 per user) |
| `proxyConfiguration` | `object` | Proxy settings (residential recommended) |
| `maxRetries` | `integer` | Max retry attempts for failed requests (1-10, default: 5) |
#### Example Input
```json
{
"twitterHandles": ["elonmusk", "apify"],
"includeReplies": false,
"mediaOnly": false,
"maxItems": 999
}
````
### Output
The scraper outputs clean, structured JSON data for each item. You can download the dataset in various formats such as **JSON, CSV, Excel, XML, RSS, or HTML Table**.
#### Profile Output
```json
{
"type": "profile",
"username": "apify",
"fullname": "Apify",
"bio": "Web scraping and automation platform for data extraction",
"followers": 12500,
"following": 567,
"tweets": 1234,
"likes": 890,
"avatar": "https://pbs.twimg.com/profile_images/...",
"banner": "https://pbs.twimg.com/profile_banners/...",
"website": "https://apify.com",
"location": "San Francisco, CA",
"joined": "January 2024",
"scrape_date": "2024-10-24T12:00:00.000Z"
}
```
#### Tweet Output
```json
{
"type": "tweet",
"username": "@apify",
"fullname": "Apify",
"text": "Excited to announce our new scraping features!",
"tweet_url": "https://x.com/apify/status/123456",
"tweet_id": "123456",
"date": "Oct 24, 2024 · 12:00 PM UTC",
"hashtags": ["#webscraping", "#automation"],
"mentions": ["@user1", "@user2"],
"urls": ["https://example.com"],
"stats": {
"comments": 12,
"retweets": 34,
"quotes": 5,
"likes": 156
},
"media": [
{
"type": "image",
"url": "https://pbs.twimg.com/media/...",
"thumbnail": "https://pbs.twimg.com/media/..."
}
],
"is_retweet": false,
"is_reply": false,
"is_quoted": false,
"author": {
"username": "@apify",
"fullname": "Apify",
"avatar": "https://pbs.twimg.com/...",
"verified": true
},
"scrape_date": "2024-10-24T12:00:00.000Z"
}
```
### Data fields
#### Profile data
| Field | Type | Description |
|---|---|---|
| `type` | `string` | Always `"profile"` |
| `username` | `string` | Twitter handle |
| `fullname` | `string` | Display name |
| `bio` | `string` | Profile biography |
| `followers` | `integer` | Follower count |
| `following` | `integer` | Following count |
| `tweets` | `integer` | Total tweet count |
| `likes` | `integer` | Total likes given |
| `avatar` | `string` | Profile image URL |
| `banner` | `string` | Banner image URL |
| `website` | `string` | Profile website link |
| `location` | `string` | Profile location |
| `joined` | `string` | Account join date |
| `scrape_date` | `string` | ISO timestamp of when data was scraped |
#### Tweet data
| Field | Type | Description |
|---|---|---|
| `type` | `string` | `"tweet"`, `"profile_search_tweet"`, etc. |
| `username` | `string` | Tweet author handle |
| `text` | `string` | Full tweet text |
| `tweet_url` | `string` | Direct link to tweet |
| `date` | `string` | Publication date |
| `hashtags` | `string[]` | Hashtags used |
| `mentions` | `string[]` | Users mentioned |
| `stats.likes` | `integer` | Like count |
| `stats.retweets` | `integer` | Retweet count |
| `stats.comments` | `integer` | Reply count |
| `stats.quotes` | `integer` | Quote tweet count |
| `media` | `object[]` | Attached images/videos |
| `is_retweet` | `boolean` | Whether it's a retweet |
| `is_reply` | `boolean` | Whether it's a reply |
### How much will it cost to scrape X (Twitter)?
Apify gives you **$5 free usage credits** every month on the [Apify Free plan](https://apify.com/pricing). You can scrape hundreds of tweets and profiles for free each month — more than enough for testing and small-scale projects.
But if you need to get more data regularly from X (Twitter), you should grab an Apify subscription. We recommend our [$49/month Starter plan](https://apify.com/pricing) — perfect for regular monitoring, competitive research, and medium-scale data collection.
For enterprise-level needs with thousands of profiles and millions of tweets, the [Scale plan at $499/month](https://apify.com/pricing) delivers the power and throughput you need.
### Tips for scraping X (Twitter)
- **Start small** — Set `maxItems` to 50–100 on your first run to test the configuration before scaling up
- **Media filtering** — Use `mediaOnly` option to focus on tweets with images or videos
- **Include/Exclude replies** — Control whether to include reply tweets in your results
- **Residential proxy recommended** — Enable residential proxy in the proxy configuration for the most reliable results
- **Adjust retry attempts** — Increase `maxRetries` if you experience frequent request failures
- **Parallel scraping** — The Actor processes multiple handles in parallel for faster results
- **Retry logic built-in** — Failed requests are automatically retried with exponential backoff, so transient errors resolve themselves
### Frequently asked questions
#### Can I scrape private Twitter profiles?
No. Twitter X Profile Scraper only works with **public profiles**. Private or protected accounts cannot be scraped.
#### Do I need a Twitter API key or account?
No. This Actor does not require any Twitter API credentials, cookies, or authentication. It works independently of the official Twitter API.
#### What export formats are available?
You can export your scraped data as **JSON, CSV, Excel (XLSX), XML, RSS, or HTML Table** directly from the Apify Console Dataset tab.
#### How many tweets can I scrape?
Set `maxItems` to control the number of tweets collected. Default is 20. Set it higher for more data, but be mindful of compute costs for very large collections.
### Is it legal to scrape X (Twitter)?
Note that personal data is protected by GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers.
You should also review [X (Twitter)'s Terms of Service](https://twitter.com/en/tos) before scraping. Always scrape responsibly, respect rate limits, and avoid collecting sensitive personal information.
We also recommend that you read our blog post: [is web scraping legal?](https://blog.apify.com/is-web-scraping-legal/).
### Resources and integrations
- [Apify Documentation](https://docs.apify.com)
- [Python SDK Documentation](https://docs.apify.com/sdk/python/)
- [Apify API Reference](https://docs.apify.com/api)
- [Integration with Make, Zapier, and other apps](https://apify.com/integrations)
Twitter X Profile Scraper integrates seamlessly with tools like **Make (Integromat)**, **Zapier**, **Google Sheets**, **Slack**, and more through the Apify platform. Schedule recurring runs, set up webhooks, or access results via the REST API.
### Support and feedback
Having issues or have feedback? Report bugs or submit feature requests in the **Issues** tab on the Actor's page.
For custom scraping solutions or enterprise support, visit [MikoLabs](https://mikolabs.xyz).
# Actor input Schema
## `twitterHandles` (type: `array`):
Enter Twitter handles to scrape. With or without the @ symbol (e.g. elonmusk or @apify).
## `twitterUrls` (type: `array`):
Direct links to Twitter/X profiles (e.g. https://x.com/elonmusk). Use this instead of handles if you have full URLs.
## `includeReplies` (type: `boolean`):
Enable to include reply tweets in results. Disabled by default to keep results focused on original tweets.
## `mediaOnly` (type: `boolean`):
Enable to scrape only tweets containing images or videos.
## `maxItems` (type: `integer`):
Maximum number of tweets to collect. Set to 0 for unlimited. Keep this low on your first run to test quickly and avoid unexpected costs.
## `proxyConfiguration` (type: `object`):
Configure proxy settings. Residential proxy is recommended for reliable Twitter/X scraping.
## `maxRetries` (type: `integer`):
Maximum retry attempts for failed requests. Increase if you experience frequent failures.
## Actor input object example
```json
{
"twitterHandles": [
"elonmusk",
"apify"
],
"includeReplies": false,
"mediaOnly": false,
"maxItems": 20,
"proxyConfiguration": {
"useApifyProxy": true,
"apifyProxyGroups": [
"RESIDENTIAL"
]
},
"maxRetries": 5
}
```
# Actor output Schema
## `results` (type: `string`):
No description
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"twitterHandles": [
"elonmusk",
"apify"
],
"maxItems": 20,
"proxyConfiguration": {
"useApifyProxy": true,
"apifyProxyGroups": [
"RESIDENTIAL"
]
}
};
// Run the Actor and wait for it to finish
const run = await client.actor("api402/twitter-x-profile-scraper").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"twitterHandles": [
"elonmusk",
"apify",
],
"maxItems": 20,
"proxyConfiguration": {
"useApifyProxy": True,
"apifyProxyGroups": ["RESIDENTIAL"],
},
}
# Run the Actor and wait for it to finish
run = client.actor("api402/twitter-x-profile-scraper").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"twitterHandles": [
"elonmusk",
"apify"
],
"maxItems": 20,
"proxyConfiguration": {
"useApifyProxy": true,
"apifyProxyGroups": [
"RESIDENTIAL"
]
}
}' |
apify call api402/twitter-x-profile-scraper --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=api402/twitter-x-profile-scraper",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Twitter X Profile Scraper",
"description": "Twitter/X Profile & Tweet Scraper without search functionality. Extract complete profile information, tweets, replies, and media from public accounts with advanced filtering by date range, engagement metrics, and content type. UserName Thats All You Need!",
"version": "0.0",
"x-build-id": "z4lnCY40Cr9hwl2ml"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/api402~twitter-x-profile-scraper/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-api402-twitter-x-profile-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/api402~twitter-x-profile-scraper/runs": {
"post": {
"operationId": "runs-sync-api402-twitter-x-profile-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/api402~twitter-x-profile-scraper/run-sync": {
"post": {
"operationId": "run-sync-api402-twitter-x-profile-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"properties": {
"twitterHandles": {
"title": "🐦 Twitter Usernames / Handles",
"type": "array",
"description": "Enter Twitter handles to scrape. With or without the @ symbol (e.g. elonmusk or @apify).",
"items": {
"type": "string"
}
},
"twitterUrls": {
"title": "🔗 Twitter Profile URLs",
"type": "array",
"description": "Direct links to Twitter/X profiles (e.g. https://x.com/elonmusk). Use this instead of handles if you have full URLs.",
"items": {
"type": "string"
}
},
"includeReplies": {
"title": "Include Replies",
"type": "boolean",
"description": "Enable to include reply tweets in results. Disabled by default to keep results focused on original tweets.",
"default": false
},
"mediaOnly": {
"title": "Media Only",
"type": "boolean",
"description": "Enable to scrape only tweets containing images or videos.",
"default": false
},
"maxItems": {
"title": "📦 Max Tweets to Scrape",
"minimum": 0,
"maximum": 999,
"type": "integer",
"description": "Maximum number of tweets to collect. Set to 0 for unlimited. Keep this low on your first run to test quickly and avoid unexpected costs.",
"default": 20
},
"proxyConfiguration": {
"title": "Proxy Configuration",
"type": "object",
"description": "Configure proxy settings. Residential proxy is recommended for reliable Twitter/X scraping."
},
"maxRetries": {
"title": "Max Retries",
"minimum": 1,
"maximum": 10,
"type": "integer",
"description": "Maximum retry attempts for failed requests. Increase if you experience frequent failures.",
"default": 5
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```