Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper is an Apify actor that extracts public tweets from Twitter/X user profiles at scale. It solves the pain of manual copy-paste by turning user timelines into clean, structured records you can analyze, enrich, and automate. This Twitter X tweets scraper works as a developer-ready Twitter tweet scraper tool and X Twitter data scraper for marketers, developers, data analysts, and researchers — enabling repeatable pipelines to download tweets from X and power data-driven decisions.

What data / output can you get?

Below are the exact fields this Twitter user tweets extractor returns in the dataset, with examples. You can export results to JSON, CSV, or Excel directly from Apify.

Data type	Description	Example value
id	Tweet ID (rest_id)	"1988877569597260072"
url	Canonical Tweet URL	"https://x.com/elonmusk/status/1988877569597260072"
user_posted	Username (screen_name)	"elonmusk"
name	Display name	"Elon Musk"
description	Full tweet text	"Long press on any image to turn it into a video..."
date_posted	ISO timestamp (UTC)	"2025-11-13T07:52:18.000Z"
likes	Favorite count	1729
replies	Reply count	554
reposts	Repost (retweet) count	368
quotes	Quote count	38
views	View count (impressions)	1399060
bookmarks	Bookmark count	213
is_verified	Blue verification flag	true
followers	Author followers	229031060
following	Author following	1226
posts_count	Author total posts	89153
profile_image_link	Author profile image	"https://pbs.twimg.com/profile_images/..."
biography	Author bio text	""
hashtags	Hashtags found in tweet text	["ai", "video"]
tagged_users	Mentioned usernames	["tetsuoai"]
photos	First photo URL (if any)	"https://pbs.twimg.com/media/abc123.jpg"
videos	MP4 variants sorted by quality	["https://video.twimg.com/.../576x856/...mp4"]
quoted_post	Quoted tweet metadata	{"data_posted": null, "description": null, ...}
external_url	Author profile external URL	null
input	Source URL reference for the record	{"url": "https://x.com/elonmusk/status/1988.../"}

Notes:

• photos is a single URL string when a photo is present; videos is an array of MP4 URLs (highest bitrate first).
• hashtags, tagged_users, photos, videos, quoted_post fields may be null when not present in the tweet.
• Results are returned recent-first by default to streamline analytics and reporting.

Key features

• 🔁 Proxy fallback resilience Automatically falls back from no proxy → datacenter → residential proxies (with up to 3 retries) to reduce blocking and keep your X posts scraper running reliably.

• 🧭 Cursor-based pagination Uses GraphQL pagination to traverse user timelines efficiently and collect the target number of tweets per profile.

• 🔐 Dynamic authorization capture Captures the required authorization header from the Twitter/X web experience using Playwright to enable rate-safe fetching without official API keys.

• 🎬 Media-aware extraction Extracts photos and MP4 video variants, plus hashtags, mentions, and quoted_post context for richer analytics in your Twitter data extraction tool.

• 📊 Structured analytics fields Collects likes, replies, reposts, quotes, views, bookmarks, and author metadata (followers, following, posts_count, verification, profile image) for downstream BI.

• 📦 Export-friendly results Download results from the Apify dataset in JSON, CSV, or Excel to plug into dashboards, notebooks, or warehouses.

• 🧑‍💻 Developer-ready by design Works seamlessly with the Apify API and platform SDKs so you can automate pipelines in Python and integrate this Twitter web scraping tool into your stack.

• 🧱 Production-grade reliability Built with robust error handling, logging, and proxy management to minimize run failures at scale.

How to use Twitter X Tweets Scraper Scraper - step by step

1. Sign in to Apify
   Create a free Apify account or log in.

2. Open the actor
   Search for “Twitter X Tweets Scraper Scraper” in the Apify Store and click Try.

3. Add input data
   Provide one or more Twitter/X profile identifiers to startUrls. Accepted formats include:

• username (e.g., elonmusk)
• @username (e.g., @BarackObama)
• full URL (e.g., https://x.com/SpaceX)

4. Configure limits and proxy

• maxTweets: Control how many tweets to collect per profile.
• proxyConfiguration: Optionally enable Apify Proxy; the actor includes built-in fallback logic if requests are rejected.

5. Start the run
   Click Start. The actor initializes a connection, resolves user IDs when needed, paginates through timelines, and saves items progressively to the dataset.

6. Monitor progress
   Watch the live logs for status like “Starting to process…”, page counts, and saved tweet totals.

7. Download results
   Open the run’s Dataset tab to export results as JSON, CSV, or Excel for analysis or automation.

Pro tip: Use the Apify API to schedule runs, stream datasets into your BI tools, or trigger enrichment workflows in your data pipeline.

Use cases

Use case name	Description
Social media analytics for brand insights	Track engagement metrics and verified status across competitor or influencer profiles to quantify performance.
Brand monitoring on X	Monitor official accounts and executives to capture changes in posting cadence, views, and audience reaction.
Journalism and research datasets	Export clean tweet timelines with timestamps and media for reproducible analysis and citations.
Market and trend analysis	Analyze hashtags and mentions found in user posts to uncover topic adoption and momentum.
Data warehouse ingestion (API pipeline)	Automate scheduled collections via the Apify platform and flatten outputs into your warehouse or lake.
Product and comms benchmarking	Compare reposts/replies/quotes across campaigns to improve messaging and timing strategies.
Creator/influencer tracking	Collect verified status, audience sizes, and media usage patterns for partnership selection.

Why choose Twitter X Tweets Scraper Scraper?

This is a precision-first Twitter tweet scraper tool built for automation and reliability.

• ✅ Accurate, structured output ready for analytics — no post-processing required.
• ⚙️ Scales across multiple profiles with pagination and progressive saving.
• 🧑‍💻 Developer access via the Apify platform — ideal for Python pipelines and APIs.
• 🔒 Ethical by design — targets publicly available profile timelines.
• 🌐 Robust proxy fallback — reduces blocking compared to unstable browser extensions.
• 💰 Cost-conscious operations — engineered to minimize retries and failed requests.
• 🔌 Integration-friendly — export datasets to CSV/JSON/Excel and wire into your stack.

In short: a production-grade X Twitter data scraper you can trust for repeatable, automated workloads.

Is it legal / ethical to use Twitter X Tweets Scraper Scraper?

Yes — when used responsibly. This actor is designed to extract publicly available information from Twitter/X user profiles.

Guidelines for compliant use:

• Scrape only public profile content and respect the platform’s terms.
• Do not attempt to access private accounts or bypass protections.
• Ensure your downstream usage complies with applicable laws (e.g., GDPR, CCPA).
• Validate edge-case uses with your legal team, especially for large-scale or commercial deployments.

The responsibility for lawful use rests with you; this tool focuses on publicly accessible data.

Input parameters & output format

Example input

{
  "startUrls": [
    "elonmusk",
    "@BarackObama",
    "https://x.com/SpaceX"
  ],
  "maxTweets": 10,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Input parameters

Field	Type	Required	Default	Description
startUrls	array (stringList)	Yes	—	List one or more Twitter profile URLs (e.g., https://x.com/username) or usernames (e.g., username or @username). One entry per line.
maxTweets	integer	No	10	Maximum number of tweets to fetch per user/profile (1-1000). UI maximum is 100.
proxyConfiguration	object	No	{"useApifyProxy": false}	Choose which proxies to use. By default, no proxy is used. If Twitter/X rejects the request, it will automatically fallback to datacenter proxy, then residential proxy with 3 retries.

Notes:

• The actor processes usernames and profile URLs; Tweet URLs are detected and skipped with a warning.
• Results are returned recent-first by default.

Example output

[
  {
    "biography": "",
    "bookmarks": 213,
    "date_posted": "2025-11-13T07:52:18.000Z",
    "description": "Long press on any image to turn it into a video...",
    "external_url": null,
    "followers": 229031060,
    "following": 1226,
    "hashtags": ["ai", "video"],
    "id": "1988877569597260072",
    "input": { "url": "https://x.com/elonmusk/status/1988877569597260072/" },
    "is_verified": true,
    "likes": 1729,
    "name": "Elon Musk",
    "photos": "https://pbs.twimg.com/media/abc123.jpg",
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/1983681414370619392/oTT3nm5Z_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 38,
    "replies": 554,
    "reposts": 368,
    "tagged_users": ["tetsuoai"],
    "url": "https://x.com/elonmusk/status/1988877569597260072",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/1988877511368019968/vid/avc1/576x856/34pcJSQSXqqM4JRQ.mp4?tag=23"
    ],
    "views": 1399060
  }
]

Field notes:

• hashtags, tagged_users, photos, videos, quoted_post, external_url can be null depending on the tweet.
• views is provided as a count when available.

FAQ

Does this scrape Twitter tweets without the official API?

Yes. It does not require official API keys. The actor captures an authorization header from the web experience and fetches public profile timelines like a Twitter web scraping tool.

What inputs are supported — usernames or URLs?

You can provide usernames (elonmusk), @usernames (@BarackObama), or full profile URLs (https://x.com/SpaceX) in startUrls. Tweet URLs are detected and skipped with a warning.

How many tweets per user can I download?

Control this with maxTweets. The default is 10, and the UI maximum is 100 per profile. The actor paginates user timelines until it reaches the limit.

Which data fields are included in the output?

You’ll get tweet-level fields (id, url, description, date_posted, likes, replies, reposts, quotes, views, bookmarks, hashtags, tagged_users, photos, videos, quoted_post) plus author metadata (user_posted, name, is_verified, followers, following, posts_count, profile_image_link, biography) and an input reference.

Does it scrape replies or threads?

It returns replies, reposts, quotes, and views as counts and includes quoted_post metadata when present. It does not extract full reply threads. For thread or replies scraping, use a dedicated Twitter replies scraper or thread-specific workflow.

Do I need to be logged in to X to run this?

The actor dynamically captures an authorization header from x.com. If it cannot capture it, the run will stop with an initialization error stating “Failed to capture authorization header.” Ensure your environment allows loading x.com to proceed.

Can I integrate this with Python or my data pipeline?

Yes. Run the actor via the Apify API, then export the dataset to JSON/CSV/Excel or pull it programmatically. It’s a solid fit for building a Twitter user tweets extractor into automated pipelines.

Is it legal to use this Twitter data extraction tool?

Yes — for public data and when used responsibly. Scrape only publicly accessible content, respect platform terms, and ensure compliance with applicable laws like GDPR/CCPA.

Closing CTA / Final thoughts

Twitter X Tweets Scraper Scraper is built to turn public Twitter/X profile timelines into analysis-ready data at scale. With pagination, proxy fallback, media-aware extraction, and clean JSON/CSV/Excel exports, it’s a practical solution for marketers, developers, data analysts, and researchers. Use the Apify API to automate collection, pipe outputs into your warehouse or notebooks, and keep your insights fresh — start extracting smarter with a reliable Twitter user tweets extractor today.