Twitter X Tweets Scraper

Twitter X Tweets Scraper

Twitter X Tweets Scraper is a fast, reliable Twitter/X tweets scraper tool that extracts public posts from profiles — complete with text, engagement metrics, media, and author metadata. It solves the pain of manual copy-paste and unstable tools by letting you scrape Twitter tweets without API keys directly from usernames or profile URLs. Built for marketers, developers, data analysts, and researchers, this X tweets scraper scales from quick checks to large monitoring projects and powers social listening, trend analysis, and reporting at speed. 🚀

What data / output can you get?

Below are the primary dataset fields this Twitter tweets scraper returns from public profile timelines.

Data field	Description	Example value
id	Unique tweet ID (rest_id)	"1988877569597260072"
url	Canonical tweet URL	"https://x.com/elonmusk/status/1988877569597260072"
user_posted	Handle of the author (screen_name)	"elonmusk"
name	Display name of the author	"Elon Musk"
description	Full tweet text	"@tetsuoai Long press on any image to turn it into a video..."
date_posted	ISO timestamp (UTC)	"2025-11-13T07:52:18.000Z"
likes	Favorite count	1729
replies	Reply count	554
reposts	Retweet/repost count	368
quotes	Quote count	38
views	Impressions/view count	1399060
bookmarks	Bookmark count	213

Bonus outputs include: is_verified, followers, following, posts_count, profile_image_link, biography, hashtags, tagged_users (tweet mentions), photos, videos (highest-bitrate-first), quoted_post (nested object with metadata), external_url (profile URL if present), and input.url (source tweet URL).

You can export results to JSON, CSV, or Excel directly from the Apify dataset for use in BI tools, analytics pipelines, and “tweet scraper to CSV” workflows.

Key features

• 🔁 Robust proxy fallback Automatically escalates from no-proxy to datacenter and then to residential proxies (with retries) when needed, keeping runs stable even when X rate-limits or blocks IPs.

• 🧠 Clean, structured tweet + author data Captures tweet text, engagement (likes, replies, reposts, quotes, bookmarks, views), media (photos, videos), and author metadata (handle, name, verification, followers/following, profile image, biography).

• 🖼️ Media-aware extraction Extracts the first photo (if present) and all available MP4 video variants, sorted by bitrate from highest to lowest.

• ⏱️ Recent-first ordering Results are ordered by recency by default, giving you a real-time view of profile activity.

• 🧩 Works without API keys or login Fetches public data via web requests and a guest token flow — ideal when you need an X tweet extractor that doesn’t depend on official API credentials.

• 📦 Flexible exports Download datasets as JSON, CSV, or Excel for downstream use in dashboards, notebooks, or automation.

• 👩‍💻 Developer-friendly on Apify Integrate with Apify’s API and SDK from your Twitter scraper Python scripts or orchestration tools. Perfect for automation pipelines and data ops.

• 🛡️ Production-ready reliability Built with Playwright + HTTP clients, dynamic authorization capture, and resilient error handling for consistent runs at scale.

How to use Twitter X Tweets Scraper - step by step

1. Create or log in to your Apify account
   Access the actor from the Apify platform.

2. Open the actor and prepare your inputs
   Paste Twitter/X profile inputs into startUrls. Accepted formats:

   • Username: elonmusk or @elonmusk
   • Profile URLs: https://x.com/elonmusk or https://twitter.com/elonmusk

3. Set how many posts you want
   Use maxTweets (1–1000) to control depth per profile. Lower values run faster; higher values collect more data.

4. Configure proxies if needed (optional)
   Use proxyConfiguration to enable Apify Proxy. This helps when X is picky about your IP; the scraper can fall back from datacenter to residential automatically.

5. Start the run
   Click Start. The actor resolves usernames → user IDs, paginates the timeline, and extracts tweets with engagement, media, and metadata.

6. Monitor progress
   Check the run logs for per-profile progress and pagination status. The scraper skips tweet URLs — use usernames or profile URLs only.

7. Export your data
   Open the Dataset tab and export to JSON, CSV, or Excel. Feed the results into your analytics stack or automation systems.

Pro Tip: Trigger the actor via the Apify API from your own “Twitter scraper Python” workflows and send results to your warehouse or dashboards automatically.

Use cases

Use case	Description
Social media analytics for brands	Track post frequency, engagement (likes, replies, reposts, quotes, views), and verified status to benchmark performance.
Marketing campaign monitoring	Measure impact of creator or brand profiles by exporting tweets to CSV/JSON for campaign dashboards.
Competitor content intelligence	Analyze messaging, cadence, and media usage across competitor profiles for strategy insights.
Investor and news research	Capture public executive/company posts with timestamps and media for timelines and reports.
Academic & NLP datasets	Build labeled corpora with tweet text, hashtags, and mentions (tagged_users) for sentiment and topic modeling.
Data engineering pipelines	Run on schedules, export to JSON/CSV, and pipe structured results into BI tools or warehouses.
Brand monitoring & CX	Track replies and quotes on key profiles to surface customer feedback patterns quickly.

Why choose Twitter X Tweets Scraper?

A precision-built, production-ready Twitter data scraper that prioritizes reliability and clean structured output over fragile browser extensions.

• 🎯 Accurate, structured fields
  Consistent JSON with tweet content, engagement, media, and author metadata — ready for analysis.

• 🔐 No login or API keys required
  Scrape Twitter tweets without API credentials using a web client authorization flow.

• 📈 Scales to larger lists
  Handle multiple profiles and deeper timelines with robust pagination and proxy fallback.

• 👩‍💻 Built for developers
  Access via Apify’s API/SDK from your own pipelines and “Twitter scraper Python” scripts.

• 🛡️ Ethical by design
  Works with publicly available profile timelines and avoids private or authenticated data.

• 💸 Cost-effective operations
  Efficient scraping patterns help keep compute usage low while maintaining stability.

• 🔌 Integration-ready
  Export to JSON/CSV/Excel and plug the results into automation stacks, CRMs, and BI tools.

Compared to unstable point-and-click add-ons, this Twitter X scraper tool is engineered for consistent throughput, clean data, and dependable operations at scale.

Is it legal / ethical to use Twitter X Tweets Scraper?

Yes — when used responsibly. This actor targets publicly available profile timelines and does not access private or authenticated content.

Guidelines for compliant use:

• Scrape only public information from profile timelines.
• Respect X/Twitter terms and applicable regulations (e.g., GDPR, CCPA).
• Avoid excessive request rates and do not misuse personal data.
• Do not attempt to access private accounts or protected content.
• For edge cases, consult your legal team to ensure your specific use complies with local laws and platform policies.

Input parameters & output format

Example input

{
  "startUrls": [
    "elonmusk",
    "https://x.com/BarackObama",
    "@nasa"
  ],
  "maxTweets": 25,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Input parameters

• startUrls (array, required): Profiles to scrape (URLs or usernames). Accepts full profile links (https://x.com/username or https://twitter.com/username) and short handles (username or @username). Default: none (must provide at least one).
• maxTweets (integer, optional): How many posts per profile to collect. Range: 1–1000. Default: 10.
• proxyConfiguration (object, optional): Proxies (optional but powerful). Off by default; enables resilient scraping with automatic routing and retries when X rate-limits or blocks datacenter IPs. Default: {"useApifyProxy": false}.

Example output

[
  {
    "biography": "",
    "bookmarks": 213,
    "date_posted": "2025-11-13T07:52:18.000Z",
    "description": "@tetsuoai Long press on any image to turn it into a video in less than 30 seconds https://t.co/Nsp7Ba0flp",
    "external_url": null,
    "followers": 229031060,
    "following": 1226,
    "hashtags": null,
    "id": "1988877569597260072",
    "input": {
      "url": "https://x.com/elonmusk/status/1988877569597260072/"
    },
    "is_verified": true,
    "likes": 1729,
    "name": "Elon Musk",
    "photos": null,
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/1983681414370619392/oTT3nm5Z_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 38,
    "replies": 554,
    "reposts": 368,
    "tagged_users": ["tetsuoai"],
    "url": "https://x.com/elonmusk/status/1988877569597260072",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/1988877511368019968/vid/avc1/576x856/34pcJSQSXqqM4JRQ.mp4?tag=23"
    ],
    "views": 1399060
  }
]

Notes:

• tagged_users contains tweet mentions extracted from entities.
• photos returns the first photo URL when present; videos returns an array of MP4 variants sorted by quality.
• Some fields may be null when not present on a given tweet or profile (e.g., photos, videos, external_url, hashtags).

FAQ

Does this work without Twitter API keys?

Yes. This Twitter X scraper tool collects public data via web requests and a guest token flow, so you can scrape Twitter tweets without API credentials.

What inputs are supported?

Provide usernames (@handle or handle) or profile URLs (https://x.com/username or https://twitter.com/username). Tweet URLs are intentionally skipped — this actor focuses on profile timelines.

What data types are included in the output?

You’ll get tweet text, engagement (likes, replies, reposts, quotes, bookmarks, views), media (photos, videos), and author metadata (handle, name, verification, followers/following, profile image, biography), plus hashtags, mentions (tagged_users), and quoted_post details.

How many tweets can I collect per profile?

You can set maxTweets from 1 to 1000 per profile. Lower values run faster; higher values return more historical posts.

Can I export results to CSV?

Yes. After a run, open the Apify dataset and export to CSV, JSON, or Excel — perfect for “tweet scraper to CSV” workflows and BI tools.

Does it support proxies or handle blocks?

Yes. You can enable Apify Proxy, and the actor includes a fallback strategy: it can escalate from no proxy → datacenter → residential to improve reliability under rate limits.

Does it scrape hashtags or mentions?

It extracts hashtags and mentions from each tweet’s entities into hashtags and tagged_users. This actor does not perform hashtag or keyword searches; it focuses on user timelines.

Is scraping Twitter/X legal?

Scraping public data is generally allowed when done responsibly. Only collect publicly available content, respect terms and regulations, and avoid private or protected data.

Closing thoughts

Twitter X Tweets Scraper is built to extract structured, analysis-ready tweet data from public profiles at scale. It delivers clean JSON/CSV exports with engagement, media, and rich author metadata — ideal for marketers, researchers, analysts, and developers. Use it from the Apify UI or wire it into your pipelines via API for a dependable X tweet extractor that powers dashboards, models, and automation. Start extracting smarter Twitter insights today.