Twitter / X Scraper — Tweets by Keyword or Handle (No API Key)

What is Twitter / X Scraper?

Twitter / X Scraper pulls public tweets from X (formerly Twitter) by keyword, hashtag, or username — and returns them as clean, structured data, without paying for the official X API.

Give it a search term or a handle, and get back structured JSON/CSV: tweet text, author, engagement counts, view counts, and media URLs. No expensive API tier, no developer app approval.

• 🔎 Search by keyword or hashtag — capture every public tweet matching a term.
• 👤 Scrape by handle — pull a user's recent timeline tweets.
• 📊 Measure engagement — likes, retweets, replies, and views on each tweet.
• 🤖 Feed AI agents — pipe live tweet data into Claude, ChatGPT, or any MCP workflow.
• ⬇️ Export anywhere — JSON, CSV, Excel, or the Apify API and webhooks.

Skip the paid X API

X's official API now starts at hundreds of dollars per month and rate-limits hard even on paid tiers. This scraper reads the same public tweets any logged-out visitor can see — no paid API key, no developer app, no per-request billing from X. It runs over residential proxies to stay under X's bot detection. Note: without login, X shows a limited number of tweets per source before its sign-in wall, so expect roughly 5–20 tweets per keyword or handle. You can optionally supply your own session cookies or auth_token to unlock more.

What data can I extract from a tweet?

Every field below is produced by the actor's real output.

Field	Field	Field
🆔 tweetId	🌐 tweetUrl	📝 text
🏷️ authorName	👤 authorHandle	🔗 authorUrl
✅ authorVerified	🕒 date	❤️ likes
🔁 retweets	💬 replies	👁️ views
🔂 isRetweet	↩️ isReply	🖼️ mediaUrls[]
#️⃣ hashtags[]	@ mentions[]	🎯 source (term/handle)
💳 charged	🕓 scraped_at

How to scrape Twitter / X in 5 steps

1. Open Twitter / X Scraper on Apify and click Try for free.
2. Add Search terms / keywords (e.g. #AI agents) and/or User handles (without @).
3. Set Max tweets per source and choose Top or Latest tweets.
4. (Optional) Paste session cookies or an auth_token to unlock login-gated content.
5. Click Save & Start, then download your data as JSON, CSV, or Excel.

Example input

{
  "searchTerms": ["#AI agents"],
  "handles": ["AnthropicAI"],
  "maxTweets": 20,
  "searchFilter": "top",
  "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }
}

Example output

{
  "tweetId": "1808123456789012345",
  "tweetUrl": "https://x.com/AnthropicAI/status/1808123456789012345",
  "authorName": "Anthropic",
  "authorHandle": "AnthropicAI",
  "authorUrl": "https://x.com/AnthropicAI",
  "authorVerified": true,
  "text": "New research on building reliable AI agents.",
  "date": "2026-07-09T17:30:00.000Z",
  "likes": 5820,
  "retweets": 941,
  "replies": 203,
  "views": 412903,
  "isRetweet": false,
  "isReply": false,
  "mediaUrls": ["https://pbs.twimg.com/media/abc123.jpg"],
  "hashtags": ["AI"],
  "mentions": [],
  "source": "AnthropicAI",
  "charged": true,
  "scraped_at": "2026-07-10T12:00:00.000Z"
}

Use cases

• Brand and topic monitoring — track a keyword or hashtag and capture every matching public tweet.
• Competitor and creator watch — pull a handle's recent tweets and engagement over time.
• Trend and virality analysis — rank tweets by likes, retweets, and views to spot what's spreading.
• Sentiment analysis — collect tweet text at scale to score tone around a topic.
• Campaign tracking — measure reach and reactions on a branded hashtag.
• AI training data — build structured tweet datasets for agents and analytics.

FAQ

Do I need the paid X API?

No. This scraper reads public tweets without X's official API, so you avoid its monthly cost and per-request limits. No developer app is required.

How many tweets can I get per keyword or handle?

Logged-out access typically returns roughly 5–20 tweets per source before X shows its sign-in wall. To go further, supply your own session cookies or auth_token in the input.

How am I charged?

Pay-per-tweet: you're billed only for tweets actually delivered. The charged field on each record shows whether it counted, and the first 25 results are free (lifetime) on your account.

Can I scrape both keywords and handles in one run?

Yes. Fill Search terms and User handles together; the source field tells you which term or handle each tweet came from.

Is it legal to scrape X / Twitter?

The actor collects only publicly visible tweets and never accesses private or protected accounts. Public data can include personal data under laws like the GDPR, so scrape only what you have a legitimate reason to use.

Use in Claude, ChatGPT & any MCP agent

This actor is available as a hosted MCP server, so AI agents can call it directly:

https://mcp.apify.com/?tools=themineworks/twitter-x-scraper

Or run it from Node.js with the Apify client:

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });

const run = await client.actor('themineworks/twitter-x-scraper').call({
  searchTerms: ['#AI agents'],
  handles: ['AnthropicAI'],
  maxTweets: 20,
  searchFilter: 'top',
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

More social scrapers from themineworks

• 👤 Instagram Profile Scraper — followers, bio, and stats for any public account.
• 🧵 Threads Scraper — posts, profiles, hashtags & search on Meta Threads.
• 👽 Reddit Scraper — posts, comments, and subreddit search with full comment trees.