Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper is a production-ready Twitter/X tweets scraper that pulls public posts from X profiles and exports clean, structured data for analysis. It solves the “copy-paste and inconsistent formats” problem by transforming profile timelines into consistent records with text, media, timestamps, engagement, and author metadata — ideal for marketers, developers, data analysts, and researchers. As a Twitter data scraper and X tweet scraper tool, it helps teams download tweets from X and export Twitter tweets to CSV or JSON at scale.

What data / output can you get?

Below are key output fields the actor saves to the Apify dataset, with examples. Exports to JSON, CSV, and Excel are supported from the dataset.

Data type	Description	Example value
id	Tweet REST ID	1988877569597260072
url	Tweet permalink	https://x.com/elonmusk/status/1988877569597260072
user_posted	Username (screen name)	elonmusk
name	Display name of the author	Elon Musk
description	Full tweet text	Long press on any image to turn it into a video...
date_posted	ISO timestamp (UTC)	2026-03-31T12:45:10.000Z
likes	Favorite count	1729
replies	Reply count	554
reposts	Retweet (repost) count	368
quotes	Quote count	38
views	Impression count	1399060
bookmarks	Bookmark count	213

Bonus fields include is_verified, followers, following, posts_count, profile_image_link, biography, hashtags, tagged_users, photos (first photo URL), videos (MP4 variants), quoted_post (object with quoted post context), external_url, and input (the input URL that produced the record).

Key features

• 🔐 Dynamic authorization handling
  Automatically captures a Bearer token from live browser traffic via Playwright, with a safe default guest token fallback when needed — keeping requests flowing without manual login.

• 🧭 Profile timeline scraping at scale
  Add multiple profile links or @handles and collect up to 1–1000 posts per profile with robust pagination. Perfect for teams that need to download tweets from X in batches.

• 🧱 Clean, structured dataset (20+ fields)
  Captures tweet text, engagement (likes, replies, reposts, quotes, bookmarks, views), author metadata (followers, following, posts_count, is_verified), and media (photos, videos) in consistent JSON records.

• 🌐 Smart proxy fallback (resilient scraping)
  Optional proxies with automatic fallback: starts without a proxy and, on failure, upgrades to datacenter and then residential proxies — improving reliability when X is picky about your IP.

• ⚡ Recent-first ordering by default
  Results are sorted by the most recent posts out-of-the-box, so analytics pipelines and dashboards can ingest fresh items first.

• 💾 Flexible exports and integrations
  Export to JSON, CSV, or Excel from the Apify dataset and connect to your BI stack, dashboards, or ETL. Ideal for “Twitter tweet extractor” workflows and API-driven pipelines.

• 🚫 No login required
  Works without cookies or account authentication when scraping public profile timelines.

• 🧰 Developer friendly
  Built on the Apify platform with a straightforward input schema and consistent output, making it easy to automate pipelines for Twitter profile tweets scraping.

How to use Twitter X Tweets Scraper Scraper - step by step

1. Sign in to Apify
   Create or log in to your Apify account to run the actor.

2. Open the actor
   Find “Twitter X Tweets Scraper Scraper” in the Apify Store.

3. Add profiles in startUrls
   Paste one profile per line. Accepted formats:

• Full links: https://x.com/username or https://twitter.com/username
• Short handles: username or @username

4. Set maxTweets
   Choose how many posts to collect per profile (1–1000). Lower values run faster; higher values return larger datasets.

5. Configure proxyConfiguration (optional)
   Proxies are off by default (useApifyProxy: false). If you experience blocking or rate limits, enable Apify Proxy. The actor can automatically fall back from datacenter to residential when requests fail.

6. Start the run
   Click “Start” to begin. The actor resolves user IDs, paginates the profile timeline, transforms data, and saves items live to the dataset.

7. Download your results
   Go to the run’s Dataset and export to JSON, CSV, or Excel. You can also fetch the dataset programmatically for automation.

Pro tip: For larger monitoring jobs (e.g., Twitter profile tweets scraper use cases), paste multiple profiles and enable proxies to improve throughput and reliability.

Use cases

Use case name	Description
Social media analytics	Track engagement trends and content performance by exporting Twitter tweets to CSV for dashboards and BI tools.
Brand monitoring	Monitor public posts from executives or brand accounts to quantify sentiment signals across time.
Competitor analysis	Compare posting cadence and engagement benchmarks across competitor profiles with structured exports.
Campaign tracking	Evaluate campaign lift by aggregating likes, replies, reposts, quotes, and views from brand-owned profiles.
Academic research	Build reproducible datasets of public tweets for longitudinal studies and sentiment analysis.
Data engineering (ETL)	Feed cleaned tweet records into data warehouses as part of an automated Twitter data scraper pipeline.
Reporting & insights	Generate weekly or monthly reports directly from structured JSON/CSV outputs.

Why choose Twitter X Tweets Scraper Scraper?

A precise, automation-ready X posts scraper for profile timelines — built for reliability and clean data.

• 🎯 Accurate, structured outputs — Consistent JSON records with 20+ fields reduce prep and cleaning work.
• 🛡️ Resilient by design — Smart proxy fallback (no proxy → datacenter → residential) keeps runs moving when IPs are rate-limited.
• 🚀 Scales to your needs — Collect up to 1–1000 posts per profile, suitable for batch and recurring workflows.
• 💻 Developer access — Results live in Apify datasets for easy API access and downstream integration.
• 🔌 Export-friendly — Download tweets from X in JSON, CSV, or Excel without extra tooling.
• 🧭 No-login scraping — Works on public profiles without cookies or account credentials.
• 🆚 Better than extensions — More stable and repeatable than browser plugins or ad‑hoc scripts, ideal for production pipelines.

In short: a reliable Twitter X tweets scraper that prioritizes clean data, resilience, and integrations.

Is it legal / ethical to use Twitter X Tweets Scraper Scraper?

Yes — when used responsibly on public data. This actor targets publicly available profile timelines and does not access private or authenticated content.

Guidelines for compliant use:

• Only scrape publicly visible information.
• Respect X’s terms of service and applicable laws (e.g., GDPR/CCPA where relevant).
• Do not attempt to bypass access controls or scrape private accounts.
• Use proxies and request rates responsibly to avoid undue load.
• Consult your legal team for edge cases or jurisdiction-specific rules.

Input parameters & output format

Example input JSON

{
  "startUrls": [
    "elonmusk",
    "https://x.com/BarackObama",
    "@Twitter"
  ],
  "maxTweets": 25,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameter details:

• startUrls (array, required): One profile per line. Formats accepted:
  • https://x.com/username or https://twitter.com/username
  • username or @username
• maxTweets (integer, optional): How many posts per profile (min 1, max 1000). Default: 10.
• proxyConfiguration (object, optional): Proxies configuration (editor: proxy). Prefill: {"useApifyProxy": false}. Helpful if X is strict about your IP; the actor can attempt datacenter → residential fallback on failures.

Example output JSON

[
  {
    "biography": "Technoking of Tesla, Imperator of Mars",
    "bookmarks": 213,
    "date_posted": "2026-03-31T12:45:10.000Z",
    "description": "Long press on any image to turn it into a video in less than 30 seconds https://t.co/Nsp7Ba0flp",
    "external_url": null,
    "followers": 229031060,
    "following": 1226,
    "hashtags": ["video"],
    "id": "1988877569597260072",
    "input": {
      "url": "https://x.com/elonmusk/status/1988877569597260072/"
    },
    "is_verified": true,
    "likes": 1729,
    "name": "Elon Musk",
    "photos": null,
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/1983681414370619392/oTT3nm5Z_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 38,
    "replies": 554,
    "reposts": 368,
    "tagged_users": ["tetsuoai"],
    "url": "https://x.com/elonmusk/status/1988877569597260072",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/1988877511368019968/vid/avc1/576x856/34pcJSQSXqqM4JRQ.mp4?tag=23"
    ],
    "views": 1399060
  }
]

Notes:

• Results are saved live to the dataset during the run.
• Fields like photos and videos may be null when no media is present.
• quoted_post provides context if a tweet quotes another post; otherwise fields are null.

FAQ

Do I need to log in to scrape tweets?

No. The actor captures a web authorization token automatically via Playwright and falls back to a default guest token if needed, so you can scrape public profile timelines without logging in.

How many tweets can I collect per profile?

You control this with maxTweets. Choose between 1 and 1000 posts per profile. Lower values run faster; higher values yield bigger datasets.

What input formats are supported for profiles?

In startUrls, you can add profiles as full links (https://x.com/username or https://twitter.com/username) or short handles (username or @username). Provide one profile per line.

Can I export data to CSV or Excel?

Yes. After the run, open the Dataset and export to JSON, CSV, or Excel. This makes it easy to export Twitter tweets to CSV for dashboards and analysis.

Does it capture images and videos?

Yes. The output includes media via photos (first image URL when present) and videos (MP4 variants list), plus hashtags and tagged_users from tweet entities.

Are results ordered from newest to oldest?

Yes. By default, tweets are sorted with the most recent first, making it convenient for real-time monitoring pipelines.

What if X rate-limits or blocks my IP?

The actor supports proxies and includes a smart fallback: it starts without a proxy, then upgrades to datacenter and finally residential proxies on failures. Enabling proxyConfiguration is recommended for heavier workloads.

Can this scrape hashtags, keyword searches, or mentions timelines?

This actor targets public profile timelines only. It does not scrape hashtag feeds, keyword search results, or mentions timelines. For those needs, use a dedicated X hashtag scraper or keyword-specific tool.

Does it scrape replies or full threads?

It returns public tweets from the profile timeline along with engagement counts and quoted_post context. It does not fetch full reply threads; replies and quotes are provided as counts.

Closing thoughts

Twitter X Tweets Scraper Scraper is built to turn public X profile timelines into clean, analytics-ready datasets. With resilient proxy handling, structured outputs, and easy exports, it’s ideal for marketers, analysts, researchers, and developers who need reliable Twitter tweet extractor workflows. Use the Apify dataset exports or API to plug results into your BI stack or automation pipeline — and start extracting smarter, cleaner X post data today.