Tweet Scraper - $0.15/1K Tweets - No Rate Limits - X Scraper

Fast Twitter (X) Scraper API: Extract Tweets, Profiles, Conversations & Advanced Search at Scale

The Twitter (X) Scraper is an Apify Actor that extracts tweets, user timelines, conversation threads, and advanced-search results from Twitter (X)—including full text, engagement metrics, media, and rich author profiles—without requiring the paid X API. This twitter scraper api collects structured data from search queries, handles, and tweet IDs.

Why a scraper instead of the X API? The official X API charges hundreds of dollars per month and imposes strict rate limits and tweet caps. This scraper delivers the same public data with event-based pricing from as little as $0.00015 per tweet—no developer account, no OAuth, no rate-limit headaches. It speaks the full Twitter advanced search syntax, so you get exactly what you'd see on X.

Use this twitter data extractor for market research, sentiment analysis, lead generation, or brand monitoring. Download tweet data to JSON, CSV, or Excel for analytics, dashboards, and AI/ML pipelines.

Pricing: from $0.00015/tweet (at the highest volume discount tier) · No X API key required

⚠️ Getting low results? Try queryType: Top instead of Latest. Twitter has recently returned fewer results for some queries—especially with until_time. For large date ranges, split your query into smaller time windows (e.g. daily) to maximize coverage.

---

📋 Table of Contents

1. What Does the Twitter Scraper Do?
2. Features and Capabilities
3. Pricing
4. Input Parameters
5. Output Format and Data Fields
6. AI Agent Integration via MCP
7. Related Tools
8. Demo Mode and Free Testing
9. Automated Scheduling and Monitoring
10. Quick Start Guide
11. Use Cases and Industries
12. Troubleshooting
13. Frequently Asked Questions
14. Contact

---

What Does the Twitter Scraper Do?

Twitter data extraction is the automated process of collecting tweets, engagement metrics, author profiles, and conversation data from Twitter (X). It powers market research, sentiment analysis, lead generation, and real-time brand monitoring.

The Agents Twitter (X) Scraper is a high-performance Actor that scrapes Twitter through three input modes, with automatic cursor-based pagination and full advanced-search support—no X API key, no OAuth, no rate limits.

What You Can Scrape

• Search results — any Twitter advanced search query, with Latest / Top ordering.
• User timelines — all tweets from one or more handles.
• Single tweets — specific tweets by ID.
• Conversation threads & replies — via the conversation_id: operator or the filter:replies field.
• Twitter Lists — every tweet from a public list.

What You Get From Every Tweet

• Tweet text, ID, URLs, language, and creation date
• Engagement metrics — retweets, replies, likes, quotes, bookmarks, views
• Reply/quote/retweet context and conversationId
• Media, cards, and place entities
• Full author profile — handle, name, verification, follower/following counts, and more

---

Features and Capabilities

Input Flexibility

Input Type	Example	Best For
Search query	"searchTerms": ["from:NASA min_faves:100"]	Keywords, advanced operators, date ranges
Twitter handle	"twitterHandles": ["NASA"]	Full user timelines
Tweet ID	"tweetIDs": ["1846987139428634858"]	Specific tweets (overrides everything else)

Core Features

• Full Advanced Search — every Twitter search operator works inside searchTerms / twitterContent.
• Automatic Pagination — cursor-based paging fetches large result sets, not just the first page.
• Dedicated Filter Fields — language, user, geo, engagement, media, and date/ID ranges as first-class inputs (applied to twitterContent).
• Human-Friendly Dates — since:/until: dates are auto-converted to since_time:/until_time: (UNIX), with timezone support.
• Sort Control — queryType supports Latest and Top.
• Rich Author Data — full user profiles attached to every tweet.
• Resilient — automatic retries, 5xx handling, and rate-limit backoff built in.
• Multiple Export Formats — JSON, CSV, Excel direct download.
• API & MCP Integration — REST API for any language, plus AI-agent access via the Apify MCP server.

---

Pricing

Event-Based Cost Structure

Pay only for what you scrape—no subscriptions, no hidden fees. This twitter scraper api uses transparent pay-per-event pricing that gets cheaper automatically as your usage grows, through Apify's volume discount tiers:

Event Type	No discount	Bronze	Silver	Gold	What's Included
Search (list-query)	$0.005/query	$0.004/query	$0.0036/query	$0.003/query	One search, profile, replies, or list request. Includes the first 20 tweets for free.
Tweet URL (get-tweet-query)	$0.015/query	$0.012/query	$0.0105/query	$0.009/query	Fetching an individual tweet by ID or URL.
Tweet (dataset-item)	$0.00025/tweet	$0.0002/tweet	$0.00018/tweet	$0.00015/tweet	Each tweet returned in the dataset, beyond the first 20 free tweets per search.

The first 20 tweets of every search are pre-paid as part of the Search event fee, so they don't add any extra Tweet cost. Only tweets beyond that first 20 are billed as dataset items.

Free users: Limited to 5 runs per month, each capped at 10 items.

Cost Examples

Using the default (no discount) rate:

Scenario	Approximate Cost
1 search query, ~20 tweets	$0.005 (covered by the free 20-tweet allowance) ≈ $0.005
1 search query, 200 tweets	$0.005 + (200 − 20) × $0.00025 ≈ $0.05
10 profiles, ~200 tweets each	10 × $0.005 + 10 × (200 − 20) × $0.00025 ≈ $0.50
1 tweet via URL	$0.015 + $0.00025 ≈ $0.015

Cost Optimization Tips

1. Use search queries instead of many individual handles/URLs when possible—each query has its own per-query fee.
2. Keep queries focused so you only pay for the tweets you actually need.
3. Use maxItems to cap total output and control spend.

---

Input Parameters

Field	Type	Description	Default
tweetIDs	array	Tweet IDs to scrape individually. When set, all other inputs are ignored.	[]
twitterContent	string	A single Twitter advanced search query. Dedicated filter fields below are appended to it.	""
searchTerms	array	Multiple search queries, each processed separately (passed verbatim). maxItems applies per term.	[]
twitterHandles	array	Handles whose timelines to scrape (no @ needed).	[]
maxItems	integer	Maximum items to return (per search term when searchTerms is set).	200
queryType	string	Result ordering: Latest or Top.	Latest
lang	string	Restrict to an ISO 639-1 language code (e.g. en).	null
from / to / @	string	Tweets from / replying to / mentioning a specific @username.	null
list	string	Tweets from members of a public list (list ID).	null
conversation_id	string	Tweets in a specific thread.	null
near / within / geocode	string	Geo filters: place, radius, or coordinate radius.	null
since_time / until_time	string	Date range as UNIX timestamps (seconds).	null
since_id / max_id	string	Date range by tweet ID.	null
min_retweets / min_faves / min_replies	integer	Minimum engagement thresholds.	0
filter:blue_verified	boolean	Only tweets from Blue-verified users.	false
filter:images / filter:videos / filter:media	boolean	Only tweets with images / videos / any media.	false
filter:quote / filter:replies	boolean	Only quote tweets / only replies.	false
url	string	Match tweets containing a URL/domain (the url: operator).	null

💡 The dedicated filter fields (lang, from, filter:*, min_*, date/ID ranges, etc.) are appended to twitterContent. For searchTerms, put operators directly inside each term — they're sent to Twitter as-is.

The Actor also exposes 20+ additional dedicated fields for the full Twitter advanced search syntax—media type (filter:videos, filter:images, filter:native_video, …), engagement (filter:has_engagement, -min_retweets, …), tweet type (filter:quote, include:nativeretweets, quoted_tweet_id, …), polls (card_name), and more. Open the Actor's Input tab in Apify Console to see every field with inline examples.

Input Examples

Advanced search:

{
    "searchTerms": ["from:NASA filter:images min_faves:100"],
    "queryType": "Top",
    "maxItems": 200
}

User timelines by handle:

{
    "twitterHandles": ["NASA", "elonmusk"],
    "maxItems": 100
}

Specific tweets by ID:

{
    "tweetIDs": ["1846987139428634858", "1858743654778892784"]
}

---

Output Format and Data Fields

Each tweet is a structured JSON object. Here is a sample:

{
  "type": "tweet",
  "id": "1728108619189874825",
  "url": "https://x.com/elonmusk/status/1728108619189874825",
  "twitterUrl": "https://twitter.com/elonmusk/status/1728108619189874825",
  "text": "More than 10 per human on average",
  "retweetCount": 11311,
  "replyCount": 6526,
  "likeCount": 104121,
  "quoteCount": 2915,
  "viewCount": 10913296,
  "bookmarkCount": 702,
  "createdAt": "Fri Nov 24 17:49:36 +0000 2023",
  "lang": "en",
  "isReply": false,
  "conversationId": "1728108619189874825",
  "isPinned": false,
  "isRetweet": false,
  "isQuote": true,
  "author": {
    "type": "user",
    "userName": "elonmusk",
    "url": "https://x.com/elonmusk",
    "id": "44196397",
    "name": "Elon Musk",
    "isVerified": true,
    "isBlueVerified": true,
    "followers": 172669889,
    "following": 538
  }
}

Key Fields

Field	Type	Description
id	string	Tweet ID
url / twitterUrl	string	Canonical tweet URLs
text	string	Tweet text
retweetCount / replyCount / likeCount / quoteCount / viewCount / bookmarkCount	number	Engagement metrics
createdAt	string	Tweet creation timestamp
lang	string	Detected language
isReply / isRetweet / isQuote / isPinned	boolean	Tweet type flags
conversationId	string	Thread ID the tweet belongs to
author	object	Full author profile (handle, name, verification, follower counts, …)

---

AI Agent Integration via MCP

Apify provides a hosted Model Context Protocol (MCP) server at mcp.apify.com that lets AI agents discover and run Apify Actors as tools—including this Twitter Scraper.

How to Connect

Add this to your MCP client config (Claude Desktop, Cursor, etc.):

{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=agents/twitter-scraper"
        }
    }
}

The hosted server signs you in with OAuth on first connect—no API token needed in the config. Clients without OAuth support can send an Authorization: Bearer <APIFY_API_TOKEN> header instead, using a token from API & Integrations in Apify Console.

Or run locally for development:

$npx @apify/actors-mcp-server --tools agents/twitter-scraper

Use Cases for AI Agent Integration

• Autonomous social research — an agent receives "find recent tweets from NASA about the Moon" and calls this scraper for structured data.
• Sentiment & trend pipelines — feed tweets into an LLM for summarization, sentiment scoring, or report generation.
• Multi-step workflows — combine with the Agents review scrapers to blend social and review signals in one pipeline.

For full setup, see the Apify MCP documentation.

---

Related Tools

Agents Data Intelligence Suite

All tools below are built and maintained by Agents—a team of ex-Big Tech engineers, former ad agency strategists, and data specialists delivering intelligence, precision, and impact at scale.

Tool	What It Extracts	Best For
Twitter (X) Scraper	Tweets, profiles, conversations, search	Social intelligence (You are here)
Google Maps Search Scraper	Business listings, contact, ratings	Lead generation, directories
Google Maps Business Scraper	Full business profiles and data	Business data, prospecting
Google Maps Reviews Scraper	Reviews, ratings, reviewer profiles	Sentiment, reputation monitoring
Yelp Business Scraper	Business profiles, ratings, contact	Lead generation
Yelp Reviews Scraper	Yelp reviews, ratings, reviewer profiles	Restaurant/hospitality
Trustpilot Reviews Scraper	Reviews, TrustScores, company replies	SaaS/B2B analysis
TripAdvisor Reviews Scraper	Hotel/restaurant reviews, ratings	Hospitality intelligence
Google Play Reviews Scraper	Android app reviews and ratings	App/product feedback
App Store Reviews Scraper	iOS app reviews and ratings	App/product feedback

---

Demo Mode and Free Testing

If you run on Apify's Free plan, you can still use this twitter scraper in Demo Mode. Free users can run the actor up to 5 times per month, with each run capped at a maximum of 10 items — just enough to test it out. Free users also cannot use the actor via API. For unrestricted usage and full API access at scale, subscribe to a paid Apify plan.

Free Plan Benefits:

• Test the API before committing to larger runs
• Validate output format and data quality
• No credit card required to start

Upgrade for Full Access:

• No item caps per run
• Full API access for integration with your systems
• Scheduled runs and webhooks for automated pipelines

For unrestricted usage, subscribe to a paid Apify plan.

---

Automated Scheduling and Monitoring

Conversations on X move fast. For brand monitoring, trend tracking, and sentiment analysis, set up automated recurring runs to keep your data current.

Why Schedule Extraction?

• Brand monitoring — catch new mentions early for rapid response
• Trend tracking — follow hashtags and topics as they evolve
• Competitive intelligence — track competitor activity and engagement
• Sentiment over time — build time-series datasets for analysis

How to Set Up Scheduled Runs

1. Open the Actor in Apify Console
2. Configure your input (search terms, handles, maxItems, etc.)
3. Click Schedule and set frequency (hourly, daily, weekly)
4. Optionally add a webhook to push new data to your pipeline (CRM, database, Slack, Zapier/Make)

---

Quick Start Guide

For Non-Technical Users (Apify Console)

1. Open the Twitter (X) Scraper on Apify
2. Click Try for free
3. Enter searchTerms, twitterHandles, or tweetIDs
4. Set maxItems
5. Click Start and export results (JSON/CSV/Excel) from the Storage tab

For Developers (Python API)

from apify_client import ApifyClient
client = ApifyClient("YOUR_TOKEN")
run = client.actor("agents/twitter-scraper").call(run_input={
    "searchTerms": ["from:NASA"],
    "queryType": "Latest",
    "maxItems": 200
})
items = client.dataset(run["defaultDatasetId"]).list_items().items

For Developers (JavaScript / Node.js API)

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_TOKEN' });

const run = await client.actor('agents/twitter-scraper').call({
    searchTerms: ['from:NASA'],
    queryType: 'Latest',
    maxItems: 200,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

For Developers (CLI / cURL)

curl --location 'https://api.apify.com/v2/acts/theagents~twitter-scraper/run-sync-get-dataset-items?token=YOUR_TOKEN' \
--header 'Content-Type: application/json' \
--data '{
    "searchTerms": ["from:NASA"],
    "queryType": "Latest",
    "maxItems": 200
}'

For Analysts (Multiple Queries)

{
    "searchTerms": ["from:NASA min_faves:100", "from:SpaceX filter:media"],
    "queryType": "Top",
    "maxItems": 500
}

---

Use Cases and Industries

Market Research and Trend Analysis

Track topics, hashtags, and audience sentiment across languages and regions to spot emerging trends before they go mainstream.

Key fields: text, lang, likeCount, retweetCount, createdAt

Brand Monitoring and Reputation Management

Monitor mentions of your brand and competitors in real time; respond quickly to negative sentiment.

Key fields: text, author, replyCount, conversationId

Lead Generation and Sales Intelligence

Find and qualify prospects engaging with specific topics, competitors, or hashtags.

Key fields: author.userName, author.followers, text

Academic and Data Science Research

Build large, structured datasets for NLP, sentiment analysis, and social-network studies.

Key fields: text, lang, engagement metrics, author

---

Troubleshooting

Issue	Cause	Solution
Fewer results than expected	queryType: Latest or restrictive query	Try queryType: Top; remove until_time; split large date ranges into smaller windows
No results	Overly restrictive or invalid query	Test the query on Twitter's search; loosen filters
Missing tweets	Shadow banning or Twitter filtering	Outside our control; try different date ranges
Outputs look incomplete	Viewing overview only	Open the Storage tab → "Download the results" or "Open in a New Tab"
Filters seem ignored	Dedicated filter fields only apply to twitterContent	Put operators directly inside each searchTerms entry

---

Frequently Asked Questions

Do I need a Twitter/X API key?

No. This scraper requires no X developer account, no API key, and no OAuth. Just provide search terms, handles, or tweet IDs.

How much does it cost?

Event-based, from as little as $0.00015 per tweet returned, at the highest volume discount tier. Use maxItems to cap spend. See Pricing for the full tier breakdown.

What can I scrape?

Search results, user timelines, single tweets, conversation threads/replies, and Twitter Lists—via search queries, handles, or tweet IDs.

Can I use full Twitter advanced search?

Yes. Every advanced search operator works when placed inside searchTerms or twitterContent.

Can I export to CSV?

Yes. Download results from Apify Console in JSON, CSV, or Excel format.

Can I use Python or Node.js?

Yes. Use the Apify Client for Python or JavaScript/TypeScript, or the REST API for any language.

Can AI agents use this scraper?

Yes—via Apify's MCP server. See AI Agent Integration via MCP.

Is this legal to use?

This tool extracts publicly available data. Always ensure your use case complies with Twitter/X's Terms of Service and applicable data protection regulations.

---

Contact

Built by Agents — Where others search, we uncover. Our team of ex-Big Tech engineers, growth hackers, and data specialists builds high-performance scraping tools engineered for speed, precision, and reliability.

For questions or further assistance:

• Email: Reach out at whoaretheagents@gmail.com
• Discord: Join our community to connect with our support team

---

Ready to start extracting Twitter data? With transparent event-based pricing from as little as $0.00015 per tweet and no X API key required, this Twitter (X) Scraper API by Agents is the definitive tool for market research, sentiment analysis, brand monitoring, and lead generation. Start scraping today. 🐦