Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper is a fast, reliable Twitter scraper for X that extracts public posts from user profiles without API keys. It solves the “scrape tweets without API” problem by collecting tweet text, media, engagement, and author metadata directly from profile timelines. Built for marketers, developers, data analysts, and researchers, this X tweets scraper scales from quick spot checks to ongoing monitoring, helping you download tweets to CSV/JSON for dashboards, ETL, and analysis.

What data / output can you get?

Use the table below to see exactly which fields this Twitter data scraper returns. Values are pushed to the Apify dataset so you can export to JSON or CSV.

Data type	Description	Example value
id	Tweet REST ID	“1988877569597260072”
url	Canonical tweet URL	“https://x.com/elonmusk/status/1988877569597260072”
user_posted	Author handle (screen name)	“elonmusk”
name	Display name of the author	“Elon Musk”
description	Full tweet text	“Long press on any image to turn it into a video…”
date_posted	ISO timestamp (UTC)	“2025-11-13T07:52:18.000Z”
likes	Favorite/like count	1729
replies	Reply count	554
reposts	Retweet/repost count	368
quotes	Quote count	38
views	View/impression count	1399060
bookmarks	Bookmark count	213
is_verified	Author verification flag	true
followers	Author followers count	229031060
following	Author following count	1226
posts_count	Total posts by author	89153
profile_image_link	Profile image URL	“https://pbs.twimg.com/profile_images/.../oTT3nm5Z_normal.jpg”
biography	Author bio/description	“”
hashtags	Array of hashtag texts	["AI","Product"]
tagged_users	Array of mentioned users	["tetsuoai"]
photos	First photo URL (if present)	null
videos	Array of MP4 video URLs (if present)	["https://video.twimg.com/.../file.mp4"]
quoted_post	Object with quoted tweet metadata	{ "post_id": "12345", ... }
external_url	Website URL from author profile	null
input	Input context (tweet URL for record)	{ "url": "https://x.com/elonmusk/status/1988877569597260072/" }

Note: Some fields may be null when not available (e.g., photos, videos, hashtags, quoted_post, external_url). Data is exportable as JSON or CSV from the Apify dataset.

Key features

• 🔐 Dynamic authorization capture & guest fallback
  Automatically captures a web client “Bearer” token via Playwright; if unavailable, falls back to a known guest token so scraping continues without API keys.

• 🌍 Resilient proxy fallback (datacenter → residential)
  Built-in smart routing handles blocks: starts without a proxy, upgrades to Apify datacenter, and then to residential with retries to keep runs stable.

• 🧭 Profile timeline scraping with pagination
  Uses X’s GraphQL endpoints to fetch user timelines, following next-cursor pagination to collect the number of posts you need.

• 📦 Bulk input, per-profile limits
  Paste multiple usernames or profile URLs and control depth with maxTweets (1–1000) per profile for fast tests or deeper datasets.

• 🎥 Media- and entity-aware extraction
  Captures tweet text, photos, videos (sorted by bitrate), hashtags, tagged users, and a rich quoted_post object for conversation context.

• 🧾 Structured outputs, ready to analyze
  Writes results live to the dataset with consistent field names (id, url, description, likes, replies, etc.). Export JSON/CSV for BI tools and reporting.

• 🧪 Developer-friendly Python actor
  Built on the Apify Python SDK and Playwright, making it easy to integrate into pipelines as a Twitter API alternative for scraping.

• ⏱ Default recency ordering
  Results are ordered by most recent posts by default for quick monitoring and real-time tweet scraper workflows.

How to use Twitter X Tweets Scraper Scraper - step by step

1. Create or log in to your Apify account
   Access the actor from your Apify dashboard.

2. Open “Twitter X Tweets Scraper Scraper”
   You can find it in the Apify Store and run it from the web UI or via API.

3. Add profiles in startUrls
   Paste one profile per line. Accepted formats:

   • username (e.g., elonmusk)
   • @username (e.g., @elonmusk)
   • https://x.com/username or https://twitter.com/username
     Note: Tweet/status URLs are detected and skipped—use profile handles/links.

4. Set maxTweets
   Choose how many posts to collect per profile (1–1000). Lower = faster runs; higher = larger datasets.

5. (Optional) Configure proxyConfiguration
   Leave off for light use. If you turn it on, the actor can leverage Apify Proxy. On errors/blocks, it automatically escalates from no proxy → datacenter → residential.

6. Start the run
   The actor initializes a connection, resolves each profile to an internal user ID, and begins fetching timeline pages until your per-profile limit is met.

7. Download your data
   Open the run’s Dataset and export results as JSON or CSV. Perfect for BI dashboards, analytics notebooks, or “download tweets to CSV” workflows.

Pro Tip: Trigger runs via the Apify API, then feed the dataset into your “Python Twitter scraper” pipelines for enrichment or downstream analytics.

Use cases

Use case name	Description
Social listening & sentiment analysis	Track timelines of key accounts to quantify likes, replies, quotes, and views for sentiment and engagement modeling.
Competitor timeline monitoring	Monitor competitor profiles to analyze posting cadence, media mix, and content performance over time.
Executive/brand account tracking	Maintain a real-time tweet scraper feed for executives or brand handles to power alerting and PR dashboards.
Campaign performance analysis	Collect posts from brand profiles during campaigns to measure reach (views) and engagement metrics at scale.
Academic & journalism research	Build reproducible datasets from public timelines as a Twitter API alternative for scraping in studies and investigations.
Developer pipelines & ETL	Use Apify’s dataset exports to power tweet scraper for X ETL jobs into data warehouses and notebooks.

Why choose Twitter X Tweets Scraper Scraper?

A precision-built X scraper tool for public profile timelines, optimized for reliability and structured outputs.

• 🎯 Accurate, structured fields out-of-the-box (no cleanup required)
• 🛡️ Automatic proxy fallback that keeps scraping resilient under rate limits and blocks
• 🔓 No Twitter API keys or login required (guest-mode compatible)
• 📈 Scales from a few profiles to large monitoring lists with per-profile limits
• 💻 Developer-ready: Apify SDK, Playwright, and JSON/CSV exports for easy integration
• 🧩 Works cleanly in automation workflows (APIs, CI/CD, data pipelines)
• ✅ Safer than unstable browser extensions; designed for production runs on Apify infrastructure

In short, this Twitter user timeline scraper emphasizes stability and clean data so your team can analyze faster with fewer retries.

Is it legal / ethical to use Twitter X Tweets Scraper Scraper?

Yes—when used responsibly. This actor collects publicly available data from X (Twitter) profile timelines and does not access private accounts or authenticated content.

Guidelines for compliant use:

• Scrape only public profile content you’re permitted to access.
• Respect X/Twitter terms of service and applicable laws (e.g., GDPR/CCPA).
• Avoid excessive request rates or abusive behavior.
• Do not attempt to bypass authentication to access private data.
• Consult your legal team for edge cases or jurisdiction-specific requirements.

Input parameters & output format

Example input

{
  "startUrls": [
    "elonmusk",
    "@BarackObama",
    "https://x.com/tesla",
    "https://twitter.com/NASA"
  ],
  "maxTweets": 25,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

Field	Type	Required	Default	Description
startUrls	array (stringList)	Yes	—	One profile per line. Supports full links (https://x.com/username or https://twitter.com/username) and short handles (username or @username).
maxTweets	integer (1–1000)	No	10	How many posts to collect per profile. Lower = faster; higher = larger datasets.
proxyConfiguration	object	No	{ "useApifyProxy": false }	Optional proxies. Useful if X rate-limits/blocks. On failures, the actor can route via datacenter → residential automatically.

Example output

[
  {
    "biography": "Technoking of Tesla, Imperator of Mars",
    "bookmarks": 213,
    "date_posted": "2025-11-13T07:52:18.000Z",
    "description": "@tetsuoai Long press on any image to turn it into a video in less than 30 seconds https://t.co/Nsp7Ba0flp",
    "external_url": null,
    "followers": 229031060,
    "following": 1226,
    "hashtags": null,
    "id": "1988877569597260072",
    "input": {
      "url": "https://x.com/elonmusk/status/1988877569597260072/"
    },
    "is_verified": true,
    "likes": 1729,
    "name": "Elon Musk",
    "photos": null,
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/1983681414370619392/oTT3nm5Z_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 38,
    "replies": 554,
    "reposts": 368,
    "tagged_users": [
      "tetsuoai"
    ],
    "url": "https://x.com/elonmusk/status/1988877569597260072",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/1988877511368019968/vid/avc1/576x856/example.mp4?tag=23"
    ],
    "views": 1399060
  }
]

Notes:

• Optional fields may be null when absent (e.g., photos, videos, hashtags, quoted_post, external_url).
• Results are ordered by recency by default.
• Export your dataset to JSON or CSV directly from Apify.

FAQ

Do I need a Twitter API key or login to use this?

No. The actor captures a web client authorization header and can fall back to a guest token, enabling you to scrape tweets without API credentials or login.

What inputs are supported?

Provide X/Twitter profile usernames, @handles, or profile URLs (e.g., elonmusk, @NASA, https://x.com/tesla). Tweet/status URLs are detected and skipped; this tool focuses on user timelines.

How many tweets can I collect per profile?

You can set maxTweets from 1 to 1000 per profile. Lower values run faster; higher values produce bigger datasets.

What data types are included in the output?

You get tweet text, URLs, timestamps, likes, replies, reposts, quotes, views, bookmarks, as well as author fields like followers, following, posts_count, profile_image_link, biography, plus media (photos, videos), hashtags, tagged_users, a quoted_post object, and input context.

Can I download tweets to CSV?

Yes. All results are stored in the Apify dataset. You can export to JSON or CSV for analysis, reporting, or pipeline ingestion.

Does it support proxies?

Yes. You can enable proxyConfiguration, and the actor includes automatic fallback logic that escalates from no proxy to datacenter and then residential proxies when needed.

Is this a Twitter hashtag scraper or Twitter search scraper?

This actor targets user timelines (profiles). It doesn’t take hashtag or keyword queries as input; use profile usernames/links to collect their posts.

Is scraping X/Twitter legal?

Yes—when scraping publicly available data responsibly and in accordance with the platform’s terms and applicable laws. Avoid private data, excessive requests, or misuse, and consult your legal team for specific cases.

Closing thoughts

Twitter X Tweets Scraper Scraper is built to extract structured tweet data from public X/Twitter profiles reliably and at scale. With clean JSON/CSV outputs, resilient proxy fallback, and no need for API keys, it’s ideal for marketers, developers, analysts, and researchers. Use the Apify SDK or API to integrate this X scraper tool into your pipelines, and start extracting smarter, analysis-ready timelines today.