Twitter X Tweets Scraper

Twitter X Tweets Scraper

Twitter X Tweets Scraper is a fast, reliable X user timeline scraper that turns public posts from X/Twitter profiles into structured datasets — no logins or API keys required. This Twitter tweet scraper helps marketers, developers, data analysts, and researchers download tweets from X at scale, replacing manual copy/paste with an automated Twitter data scraping tool built for analytics and pipelines. Use it as a bulk tweet scraper to power dashboards, trend tracking, and reporting.

What data / output can you get?

Get clean, structured tweet records with engagement metrics, author details, media, and context. Below are real output fields this Twitter tweet history extractor saves to the dataset.

Data type	Description	Example value
id	Tweet ID	"1988877569597260072"
url	Tweet URL	"https://x.com/elonmusk/status/1988877569597260072"
user_posted	Username (handle without @)	"elonmusk"
name	Display name	"Elon Musk"
description	Full tweet text	"Launching soon. Stay tuned."
date_posted	ISO timestamp (UTC)	"2026-03-20T14:05:12.000Z"
likes	Like count	1729
replies	Reply count	554
reposts	Repost (retweet) count	368
quotes	Quote count	38
views	View/impression count (as returned by X)	1399060
bookmarks	Bookmark count	213

Bonus fields include profile and media metadata:

• followers, following, posts_count
• profile_image_link, biography
• hashtags, tagged_users
• photos (first image URL), videos (MP4 variants, highest bitrate first)
• quoted_post object (with data_posted, description, post_id, profile_id, profile_name, url, videos)
• external_url, input.url (the constructed tweet URL for traceability)

You can export results to JSON, CSV, or Excel directly from the Apify dataset to easily export tweets to CSV for BI tools or pipelines.

Key features

• 🛡️ Resilient proxy fallback
  Keeps runs going with smart routing: starts without a proxy and can escalate to Apify datacenter, then residential proxies (with retries) if requests fail — ideal for a real-time tweet scraper that avoids blocks.

• 🧭 Flexible inputs
  Accepts profile URLs and @handles (https://x.com/username, https://twitter.com/username, username, @username) and numeric user IDs. Tweet URLs are detected and skipped to focus on profile timelines.

• 🔁 Cursor-based pagination with limits
  Uses X’s GraphQL endpoints with cursor-based pagination and respects your maxTweets limit (1–1000 per profile) for predictable, controlled collection.

• 🎥 Media & entities extraction
  Captures photo URLs and MP4 video variants (sorted by bitrate), plus hashtags and tagged_users for richer analysis.

• 📈 Engagement + author context
  Collects likes, replies, reposts, quotes, views, bookmarks, and author metrics like followers, following, posts_count, profile_image_link, and biography.

• 🔐 No login required
  Captures a guest authorization token dynamically via Playwright, with a safe fallback guest token — a practical X tweets data extractor without authentication.

• 📤 Streamed dataset output
  Writes each tweet to the Apify dataset as it’s collected for easy exports (JSON, CSV, Excel) and automation in your Twitter data scraping toolchain.

• 🧑‍💻 Developer-friendly stack
  Built with Apify SDK (Python), Playwright, and httpx. Integrate via the Apify API with your Python workflows or automation platforms (Make, n8n).

How to use Twitter X Tweets Scraper - step by step

1. Sign in to Apify
   Create or log in to your Apify account.

2. Open Twitter X Tweets Scraper
   Launch the actor from the Apify Store.

3. Add profiles in startUrls
   Paste one profile per line. Accepted formats:

   • https://x.com/username or https://twitter.com/username
   • username or @username
     You can also use numeric user IDs.

4. Set the tweet limit
   Configure maxTweets (1–1000) to control how many posts to collect per profile.

5. (Optional) Configure proxies
   Use proxyConfiguration to improve reliability if X is sensitive to your IP. It’s off by default for light use.

6. Start the run
   Click Start. The scraper resolves user IDs, fetches timeline pages, and streams results to the dataset.

7. Monitor progress
   Follow logs showing per-page collection and totals. The scraper handles pagination automatically.

8. Export results
   Open the dataset and export to JSON, CSV, or Excel to download tweets from X into your analytics or ETL workflows.

Pro Tip: Automate recurring collections by triggering runs with the Apify API and routing dataset exports into your data warehouse or dashboards.

Use cases

Use case name	Description
Brand monitoring & social listening	Track posting cadence and benchmark engagement (likes, replies, reposts, quotes, views) across competitors or creators.
Trend and campaign reporting	Aggregate profile tweets to evaluate campaign impact, content themes, and activity over time.
Competitive intelligence	Monitor product announcements and audience reactions on target profiles to inform strategy.
Academic & journalism research	Collect structured, timestamped tweet data from public profiles for studies and reporting.
API/ETL pipelines	Feed exports into Python or ELT jobs using the Apify API for downstream analytics.
Dashboard data feeds	Export tweets to CSV/JSON for BI tools and build near-real-time timeline dashboards with this X user timeline scraper.

Why choose Twitter X Tweets Scraper?

Built for precision and resilience, this Twitter data scraping tool combines dynamic authorization, smart proxy fallback, and structured outputs analysts and developers can trust.

• ✅ Accurate, analytics-ready fields out of the box
• 🌐 Works without login — dynamic guest auth capture + fallback token
• 📈 Scales per profile — up to 1000 posts with cursor-based paging
• 🧑‍💻 Developer-ready — Apify SDK (Python), Playwright, httpx, API integration
• 🛡️ Robust networking — optional Apify proxies with datacenter → residential fallback
• 💸 Cost-conscious — efficient requests with incremental dataset writes
• 🧩 More reliable than browser extensions or brittle scripts

In short: a production-ready X tweet scraper that streamlines collection and delivers consistent, structured data.

Is it legal / ethical to use Twitter X Tweets Scraper?

Yes — when used responsibly. This actor targets publicly available X/Twitter profile posts and does not access private or authenticated data.

Guidelines for compliant use:

• Only collect public information; avoid private or protected accounts
• Review and respect X/Twitter’s Terms of Service
• Follow applicable data protection laws (e.g., GDPR, CCPA)
• Use results responsibly; do not spam or misuse personal data
• Consult your legal team for edge cases or jurisdiction-specific questions

Input parameters & output format

Example input JSON

{
  "startUrls": [
    "elonmusk",
    "@nasa",
    "https://x.com/BarackObama",
    "https://twitter.com/nytimes"
  ],
  "maxTweets": 25,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameter reference

Field	Type	Required	Default	Description
startUrls	array (stringList)	Yes	—	One profile per line — supports full links (https://x.com/username or https://twitter.com/username) and short handles (username or @username). Tip: paste a list of creators, brands, or news accounts you want to monitor.
maxTweets	integer (1–1000)	No	10	Choose 1–1000 posts for each profile in your list. Lower = faster runs; higher = bigger datasets.
proxyConfiguration	object	No	{"useApifyProxy": false}	Optional Apify proxy settings. If a request fails, the actor can route datacenter → residential (with retries) to keep your run going.

Notes:

• Tweet URLs are detected and skipped — provide usernames or numeric user IDs for best results.
• If X rate-limits your IP, enable proxies for higher reliability.

Example output JSON

[
  {
    "biography": "Technoking of Tesla, Imperator of Mars",
    "bookmarks": 213,
    "date_posted": "2026-03-20T14:05:12.000Z",
    "description": "Exciting update coming next week.",
    "external_url": null,
    "followers": 229031060,
    "following": 1226,
    "hashtags": ["Update", "NextWeek"],
    "id": "1988877569597260072",
    "input": {
      "url": "https://x.com/elonmusk/status/1988877569597260072/"
    },
    "is_verified": true,
    "likes": 1729,
    "name": "Elon Musk",
    "photos": "https://pbs.twimg.com/media/ExamplePhoto_normal.jpg",
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/1983681414370619392/oTT3nm5Z_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 38,
    "replies": 554,
    "reposts": 368,
    "tagged_users": ["tetsuoai"],
    "url": "https://x.com/elonmusk/status/1988877569597260072",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/1988877511368019968/vid/avc1/576x856/example.mp4"
    ],
    "views": 1399060
  }
]

Field behavior notes:

• Many fields may be null when not available on a given tweet (e.g., photos, videos, hashtags, tagged_users, external_url, quoted_post.*).
• views reflect what X returns and may be absent on some posts.
• input.url echoes the constructed tweet URL for traceability.

FAQ

Do I need to log in or use API keys to run this X tweet scraper?

No. The actor captures a guest authorization token dynamically and falls back to a known guest token, enabling scraping of public profile posts without login.

Can I scrape tweets without API access?

Yes. This Twitter data scraping tool collects public timeline data via web endpoints, working as an X tweets API alternative without official API keys.

What inputs are supported?

Provide usernames, @handles, profile URLs (x.com or twitter.com), or numeric user IDs in startUrls. Tweet URLs are detected and skipped to keep the focus on profile timelines.

How many tweets can I collect per profile?

You can set maxTweets from 1 to 1000 per profile. The scraper uses cursor-based pagination and stops once it hits your limit.

Does it extract images and videos?

Yes. It collects a photo URL (if present) and MP4 video variants (sorted by bitrate), along with hashtags and tagged_users for additional context.

Can I export tweets to CSV?

Yes. After the run, open the dataset in Apify and export to CSV, JSON, or Excel to download tweets from X for analysis.

How does it handle blocking and rate limits?

If X is strict about your IP, enable proxyConfiguration. The actor supports Apify proxies and can fall back from no proxy to datacenter and then residential proxies with retries.

Does this scrape by hashtag or keyword, or collect mentions/replies threads?

No. This actor targets profile timelines only. It does not search by hashtag or keyword, and it does not collect mention or replies feeds — though it does include engagement counts like replies, quotes, and reposts for each tweet.

Is it legal to use this Twitter tweet scraper?

Yes, when you collect public data and follow X/Twitter’s Terms of Service and applicable laws. Avoid private/protected accounts and use the data responsibly.

Closing CTA / Final thoughts

Twitter X Tweets Scraper is built to turn public X/Twitter profile timelines into clean, analytics-ready data without logins or API keys. With resilient proxy fallback, dynamic auth capture, and structured outputs, it helps marketers, developers, analysts, and researchers move from browsing to insights faster. Export to CSV/JSON/Excel, integrate via the Apify API for automation, and power your pipelines with a dependable X tweet scraper that scales with your analysis.