Twitter / X Scraper — Tweets & Profiles

Twitter / X Scraper — Tweets & Profiles

Twitter / X Scraper extracts structured Twitter / X records, metadata, metrics, and direct links in real time. Built on a zero-browser HTTP/2 engine running in 256 MB RAM, it delivers normalized datasets with zero null fields ready for CSV, Excel, JSON, or API pipelines.

Looking for related scrapers? Check out Instagram Scraper, TikTok Scraper, YouTube Scraper, Reddit Scraper, or browse our full catalog of 118+ dedicated scrapers.

---

What does Twitter / X Scraper do?

Ultra-fast Twitter/X scraper. Extract tweets, user profiles, metrics, likes, retweets, replies, media and threads without official Twitte.... Compatible Make.com, Zapier, n8n, Sheets & Webhooks. 256MB RAM & sub-second speed.

Whether you need to monitor Twitter / X at scale, enrich B2B/B2C databases, or feed structured records into analytics and AI workflows, Twitter / X Scraper handles pagination, field normalization, and schema validation automatically:

• Bulk Data Extraction: Collect Twitter / X listings, items, and detailed attributes in batches using keywords, filters, or direct URLs.
• Complete Public Metadata: Capture identifiers, pricing/engagement metrics, author/vendor details, timestamps, and canonical URLs.
• Multi-Format Export: Download results in JSON, CSV, Excel (XLSX), XML, or HTML Table directly from the Apify Console.
• Ready for Automation & AI: Connect seamlessly to Apify Integrations (Make, Zapier, n8n, Google Sheets), REST API endpoints, or the Apify MCP Server.

Beyond the Official Twitter / X API

• No API Keys or Approval Delays: Start extracting public Twitter / X data immediately without registering developer apps or waiting for quota approvals.
• No Restrictive Rate Quotas: Bypass strict per-minute API limits and expensive enterprise tiers while capturing the complete public data points displayed on Twitter / X.
• 256 MB Zero-Browser Architecture: Uses native HTTP/2 and TLS session emulation instead of heavy Chromium instances, executing in seconds at a fraction of standard compute costs.

---

What data can you scrape from Twitter / X?

Twitter / X Scraper extracts the following data points from Twitter / X:

📝 Mode (mode)	📝 Handles (handles)	📝 Only Media (onlyMedia)
👍 Min Likes (minLikes)	🏷️ Item Type (itemType)	🆔 Tweet ID (tweetId)
👤 Author Name (authorName)	📝 Screen Name (screenName)	📝 Text (text)
📝 Favorite Count (favoriteCount)	📝 Retweet Count (retweetCount)	💬 Reply Count (replyCount)

Data Category	Extracted Fields & Data Points
Identity & Core Identifiers	itemType (Item Type), tweetId (Tweet ID), authorName (Author Name), screenName (Screen Name)
Metrics, Pricing & Engagement	minLikes (Min Likes), favoriteCount (Favorite Count), retweetCount (Retweet Count), replyCount (Reply Count), views (Views)
Details, Attributes & Context	mode (Mode), handles (Handles), onlyMedia (Only Media), text (Text), hasMedia (Has Media)
Direct Links, Media & Timestamps	engagementRatePercent (Engagement Rate Percent), createdAt (Created At), url (URL)

---

Why scrape Twitter / X? (Typical Use Cases & Guides)

You can use Twitter / X Scraper for a wide range of data and business workflows:

• Brand & Crisis Monitoring: Track sentiment, customer complaints, and public feedback in real-time.
• AI Community Intelligence: Monitor breaking announcements from AI founders, researchers, and tech leaders.
• Lead Generation: Find potential buyers asking for product recommendations on X.
• AI Agents, RAG & LLM Knowledge Pipelines: Stream clean, structured Twitter / X JSON records into vector databases, Claude, GPT-4, or LangChain workflows.
• Automated BI Dashboards & Scheduled Alerts: Schedule daily or hourly runs and push live Twitter / X updates directly to Google Sheets, Looker Studio, Slack, or webhooks.
• Market Research & Competitor Analysis: Benchmark Twitter / X offerings, pricing strategies, and market share across regions.
• Lead Generation & CRM Enrichment: Build targeted prospect lists and sync verified records straight into HubSpot, Salesforce, or Clay.
• AI Agents & RAG Pipelines via MCP: Connect live Twitter / X data directly to Claude Desktop, Cursor, or LangChain agents.

---

How to scrape Twitter / X data

Twitter / X Scraper is designed for a zero-configuration start, even if you have never scraped data before:

1. Create a free Apify account using your email (includes $5.00 in free monthly credits).
2. Open Twitter / X Scraper and click on the Input tab — all required fields are already pre-filled with a working example.
3. Enter your search terms, target URLs, or filter criteria (or keep the default pre-filled configuration for an instant 1-Click test).
4. Click the green "Start" button and wait a few seconds for the data to be extracted.
5. Download your dataset in JSON, CSV, Excel (XLSX), or HTML, or fetch it via the API tab.

For more technical details on every parameter, check out the Input Schema tab or read the Apify Platform Documentation.

🔗 How to scrape Twitter / X by Search Term or Direct URL

Scraping by Search Term / Filter 🔑	Enter keywords, categories, or filter parameters just as you would search on Twitter / X. Set the maximum number of items you want to extract and click Start.
Scraping by Direct URL 🔗	Paste one or more direct Twitter / X links (or import a list of URLs from a Google Sheet / CSV) to extract targeted item or profile details in bulk.

---

⬇️ Input Configuration & Examples

To start scraping Twitter / X, fill in the visual input form in the Apify Console or pass a JSON payload via the API. Full technical specifications are available on the Input Schema tab.

Input Parameters Reference

Parameter	Type	Default / Prefill	Description
mode	string	userTweets	Select whether to scrape timeline tweets or user profile metadata. Options: userTweets, userProfiles.
handles	array	["apify","sama"]	List of Twitter handles (e.g. elonmusk, apify) or full profile URLs.
searchTerms	array	—	Optional keywords or hashtags to filter tweets (e.g. ['AI', 'scraping', '#crypto']).
onlyMedia	boolean	false	Filter to only keep tweets containing photos or video attachments.
minLikes	integer	0	Only keep tweets with at least this number of likes (e.g. 50 or 500 for viral tweets).
minRetweets	integer	0	Only keep tweets with at least this number of retweets/reposts.
onlyVerified	boolean	false	Filter to only keep content from officially verified Twitter accounts.
includeReplies	boolean	false	Include user replies in timeline results (uncheck to extract only standalone tweets).
sessionCookie	string	—	Optional 'auth_token' cookie from your browser for zero rate limits.
maxTweetsPerUser	integer	30	Maximum number of tweets to collect per user timeline.
proxyConfiguration	object	—	Apify Proxy (Residential or Datacenter) to bypass Twitter/X rate limits.

Example 1: Standard Extraction (1-Click Default)

{
  "mode": "userTweets",
  "handles": [
    "apify",
    "sama"
  ],
  "onlyMedia": false,
  "minLikes": 0
}

Example 2: Filtered & Batch Extraction

{
  "mode": "userProfiles",
  "handles": [
    "apify",
    "sama"
  ],
  "onlyMedia": true,
  "minLikes": 0,
  "minRetweets": 0,
  "onlyVerified": true,
  "includeReplies": true,
  "maxTweetsPerUser": 60
}

---

⬆️ Output Example (Table View, JSON & Fields Reference)

The scraped results are stored in a structured Apify Dataset available in the Storage tab. Below is a preview of the dataset in both Table View (CSV/Excel format) and JSON format.

Table View (CSV / Excel Dataset Preview)

Mode	Handles	Only Media	Min Likes
userTweets	apify	false	0
userTweets	apify	false	1
userTweets	apify	false	1

JSON Output Example

{
  "mode": "userTweets",
  "handles": [
    "apify",
    "sama"
  ],
  "onlyMedia": false,
  "minLikes": 0
}

Output Fields Reference

Field Name	Type	Description
mode	string	Extracted mode value.
handles	array	Extracted handles value.
onlyMedia	boolean	Extracted only media value.
minLikes	number	Extracted min likes value.
itemType	string	Item classification (tweet or profile)
tweetId	string	Unique Twitter / X tweet snowflake ID
authorName	string	Display name of the author
screenName	string	Twitter handle without @
text	string	Full text content of the tweet
favoriteCount	integer / number	Like / Favorite count
retweetCount	integer / number	Retweet / Repost count
replyCount	integer / number	Direct replies count
views	integer / number	Total view impressions
engagementRatePercent	number	Computed engagement rate percentage
hasMedia	boolean	Whether the tweet contains photos or video
createdAt	string	Tweet publication timestamp
url	string	Permanent link to the tweet or profile

---

🔗 Scrape any data you need with dedicated scrapers

Combine Twitter / X Scraper with our other dedicated scrapers from @RBBscrap if you want to extract specialized data across platforms:

🔹 Instagram Scraper	🔹 TikTok Scraper	🔹 YouTube Scraper
🔹 Reddit Scraper	🔹 Threads Scraper	🔹 Pinterest Scraper

Scraper	Extracted Data & Primary Use Case
Instagram Scraper	Profiles, Posts & Reels
TikTok Scraper	Videos, Profiles & Stats
YouTube Scraper	Videos, Shorts & Channels
Reddit Scraper	Posts, Comments & Subreddits
Threads Scraper	Profiles, Posts & Bios
Pinterest Scraper	Pins, Boards, Search & Videos

---

⚠️ Error Items & Resilience Reference

Twitter / X Scraper is engineered to process multi-query and batch runs resiliently without crashing if a single query or URL fails:

Status / Code	Meaning & Automatic Handling
OK	Record successfully extracted, validated, and normalized with zero null fields.
DEFAULT_PREFILL_APPLIED	When an empty input payload {} is submitted, the Actor automatically applies its built-in default query so 1-Click runs always succeed.
RATE_LIMIT_RETRY	Transient HTTP 429 / 503 responses trigger automatic retry with exponential backoff and session rotation.
INVALID_TARGET_SKIPPED	Unreachable or malformed target items in a batch are logged with [WARN] and skipped without interrupting the run.

---

❓ Frequently Asked Questions (FAQ)

How much does scraping Twitter / X cost?

Twitter / X Scraper uses transparent Pay-Per-Event (PAY_PER_EVENT) pricing set 10x cheaper than the market leader ($\div 10$):

• Event Rate: $0.00035 per Scraped Twitter / X Scraper Record ($0.35 per 1,000 items).
• 🎁 1st Run 100% FREE: Your very first execution is 100% free ($0.00 event charges are applied on your initial run).
• Apify Free Plan ($5.00/month included): Every Apify account receives $5.00 in free monthly credits, which is enough to extract up to ~14,285 items per month for free.
• View full details on the Pricing tab and the Apify Pricing page.

Can I integrate Twitter / X Scraper with Make, Zapier, n8n, or Google Sheets?

Yes. Twitter / X Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform, including Make, Zapier, n8n, Slack, Airbyte, Google Sheets, Google Drive, and webhooks.

Can I use Twitter / X Scraper with the Apify API (Python & Node.js)?

Yes. The Apify API gives you programmatic access to run Twitter / X Scraper, schedule jobs, and fetch datasets. Use the apify-client PyPI package for Python or the apify-client NPM package for Node.js, or check the Apify API Reference:

Python (apify-client)

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_API_TOKEN")

run = client.actor("rbbscrap/twitter-scraper").call(run_input={
    "mode": "userTweets",
    "handles": ["apify","sama"],
    "onlyMedia": False,
    "minLikes": 0
})

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

Node.js (apify-client)

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_API_TOKEN' });

const run = await client.actor('rbbscrap/twitter-scraper').call({
    mode: "userTweets",
    handles: ["apify","sama"],
    onlyMedia: false,
    minLikes: 0
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

Can I use Twitter / X Scraper through an MCP Server (Claude Desktop, Cursor, AI Agents)?

Yes. With the Apify API, you can use Twitter / X Scraper in conjunction with an MCP server to connect directly to Claude Desktop, Cursor, Windsurf, or LibreChat. Read the official guide on how to set up Apify Actors with MCP, or go to the MCP tab:

1. Start a Server-Sent Events (SSE) session to receive a sessionId.
2. Send API messages using that sessionId to trigger Twitter / X Scraper with your input parameters.
3. Receive structured Twitter / X dataset records directly inside your AI agent conversation.

Do I need residential proxies or login cookies to scrape Twitter / X?

No. Twitter / X Scraper operates on a zero-browser HTTP/2 protocol engine (256 MB RAM) and works out-of-the-box without requiring login cookies or external proxies for standard workloads. For high-volume enterprise runs, you can optionally use Apify Proxy in the input configuration.

Is it legal to scrape data from Twitter / X?

Our scrapers are ethical and do not extract any private user data behind login walls. They only extract what is shared publicly on the web. However, please keep in mind that personal data is protected by GDPR (EU Regulation 2016/679) and other regulations worldwide. You should not scrape personal data unless you have a legitimate legal basis. Read more in Apify's guide on the legality of web scraping.

Your feedback & support

We are continuously improving the performance of our Actors. If you have any technical feedback for Twitter / X Scraper, need a custom feature, or found a bug, please create an issue on the Actor's Issues tab in the Apify Console.