Twitter / X Scraper — Date Filter, Profile & Keyword Search

Scrape tweets from any Twitter/X profile or keyword search with exact date filtering, language filter, tweet type, and engagement thresholds. Exports to JSON, CSV, or Excel. No Twitter API key required.

---

Why date filtering actually works here

The #1 complaint about Twitter scrapers: date filters that return wrong dates. Most scrapers read the profile timeline — which Twitter shows in a non-chronological order and can't be filtered server-side. You ask for tweets from 2023 and get random results from 2019 to today.

This scraper uses X's search engine instead of the timeline. Every request uses from:handle since:YYYY-MM-DD until:YYYY-MM-DD operators — the same approach X's own Advanced Search uses. Dates are enforced server-side before any results are returned.

The difference: from:elonmusk since:2024-01-01 until:2024-03-31 will only return tweets from that exact window, every single time.

---

Input parameters

Parameter	Type	Description
handles	array	Twitter/X handles to scrape (without @)
searchTerms	array	Free-text search queries (supports all X operators)
maxTweetsPerHandle	integer	Max tweets per handle or search term (default: 100)
since	string	Start date — YYYY-MM-DD format
until	string	End date — YYYY-MM-DD format
tweetTypes	array	Filter by type: original, reply, retweet, quote
lang	string	Language code: en, fr, es, de, etc.
minLikes	integer	Minimum like count
minRetweets	integer	Minimum retweet count
twitterAuthToken	string	Your X auth_token cookie (required for login-protected content)
twitterCt0	string	Your X ct0 CSRF cookie (required together with auth_token)
proxyConfiguration	object	Proxy settings (residential recommended)

Profile scraping example

{
  "handles": ["elonmusk", "sama"],
  "maxTweetsPerHandle": 200,
  "since": "2024-01-01",
  "until": "2024-06-30",
  "tweetTypes": ["original"],
  "lang": "en",
  "minLikes": 100
}

Keyword search example

{
  "searchTerms": [
    "ChatGPT site:techcrunch.com",
    "#bitcoin lang:en min_faves:500",
    "from:openai -filter:retweets"
  ],
  "maxTweetsPerHandle": 500,
  "since": "2024-03-01",
  "until": "2024-03-31"
}

---

Output fields

Each tweet is saved as one item in the dataset:

Field	Type	Description
tweetId	string	Unique tweet ID
url	string	Direct URL to the tweet on X.com
createdAt	string	ISO 8601 timestamp
fullText	string	Full tweet text (no truncation)
tweetType	string	original, reply, retweet, or quote
metrics.likes	integer	Like count
metrics.retweets	integer	Retweet count
metrics.replies	integer	Reply count
metrics.bookmarks	integer	Bookmark count
metrics.views	integer	View count
author.handle	string	Twitter handle
author.displayName	string	Display name
author.verified	boolean	Legacy verified badge
author.blueVerified	boolean	Blue checkmark (paid)
media	array	Photos/videos [{type, url, thumbnailUrl}]
hashtags	array	Hashtags without #
mentions	array	Mentioned handles without @
links	array	External URLs
replyToHandle	string|null	Handle being replied to
quotedTweet	object|null	Quoted tweet content
searchQuery	string	X search query used
scrapedAt	string	Scrape timestamp (ISO 8601)

Output example

{
  "tweetId": "1769432156789012345",
  "url": "https://x.com/elonmusk/status/1769432156789012345",
  "createdAt": "2024-03-17T18:42:00.000Z",
  "fullText": "The thing I find most surprising is how quickly people adapt to new technology.",
  "tweetType": "original",
  "metrics": {
    "likes": 54200,
    "retweets": 6100,
    "replies": 4300,
    "bookmarks": 15000,
    "views": 8400000
  },
  "author": {
    "handle": "elonmusk",
    "displayName": "Elon Musk",
    "profileUrl": "https://x.com/elonmusk",
    "avatarUrl": "https://pbs.twimg.com/profile_images/...",
    "verified": false,
    "blueVerified": true
  },
  "media": [],
  "hashtags": [],
  "mentions": [],
  "links": [],
  "replyToHandle": null,
  "quotedTweet": null,
  "searchQuery": "from:elonmusk since:2024-03-01 until:2024-04-01",
  "targetHandle": "elonmusk",
  "scrapedAt": "2024-06-01T12:00:00.000Z"
}

---

Use cases

Brand monitoring — Collect every mention of your brand, product, or competitor over a precise date window. Feed the results into a sentiment analysis pipeline or track share-of-voice over time.

Influencer research — Analyze a creator's posting frequency, engagement rate, and topic mix for any time period before signing a partnership.

Market research — Track how conversations around a product category or trend evolve week by week.

Academic & journalism research — Reproduce a dataset from a specific news event with exact date bounds. Results are deterministic — the same query always returns the same tweets.

AI training data — Export large volumes of tweets on a topic as training or fine-tuning data for LLMs.

Social media analytics — Build dashboards showing tweet volume, engagement trends, and top content for any account.

Competitor analysis — Monitor what a competitor's customers are saying, what complaints recur, and how the brand responds.

---

Authentication

X (Twitter) shows a login wall for most search results since 2023. To bypass it, provide your account cookies:

1. Open x.com in Chrome and log in
2. Open DevTools → Application → Cookies → x.com
3. Copy the value of auth_token and ct0
4. Paste them into the twitterAuthToken and twitterCt0 inputs

These cookies grant the scraper the same access as your logged-in session. Use a secondary account if preferred.

---

Limitations

• Login required for search results — provide twitterAuthToken + ct0 cookies
• Private accounts cannot be scraped
• Rate limits apply — very high volumes may require multiple runs
• Very old tweets (pre-2010) may not be indexed in X's search

---

Support

Found a bug or need help? Open a ticket in the Issues tab on the actor page. We respond to every issue and ship fixes quickly.