Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper extracts public posts from X (Twitter) profiles at scale and outputs clean, structured tweet data for analysis. It solves the pain of manual copy-paste by automating tweet collection with text, links, media, engagement metrics, and author metadata in one run — ideal for marketers, developers, data analysts, and researchers. With resilient proxy support and dynamic authorization, it enables reliable, repeatable collection at scale for dashboards, social listening, and trend monitoring.

What data / output can you get?

Below are real fields this actor saves to the Apify dataset, with examples for clarity.

Data type	Description	Example value
id	Tweet’s unique REST ID	"1765432109876543210"
url	Direct link to the tweet	"https://x.com/elonmusk/status/1765432109876543210"
user_posted	Author’s @handle (screen name)	"elonmusk"
name	Display name of the author	"Elon Musk"
description	Full tweet text	"Excited to share our latest update 🚀"
date_posted	ISO timestamp (UTC)	"2026-04-04T06:40:47.000Z"
likes	Number of likes	1423
replies	Number of replies	210
reposts	Number of reposts (retweets)	98
quotes	Number of quote tweets	17
views	View count (impressions)	250340
bookmarks	Number of bookmarks	33

Bonus fields included in each record: is_verified, followers, following, posts_count, profile_image_link, biography, hashtags, tagged_users, photos (single image URL), videos (array of MP4 URLs), quoted_post (object with quoted tweet info), external_url (profile link), and input (the constructed input URL reference). You can export the dataset in JSON, CSV, or Excel directly from Apify.

Key features

• 🔐 Dynamic auth handling
  Automatically captures or falls back to a guest authorization token to access Twitter/X GraphQL endpoints reliably without login.

• 🌐 Smart proxy fallback
  Built-in proxy logic tries no proxy → datacenter → residential (with retries) to keep runs going when blocks occur.

• 📥 Flexible profile inputs
  Accepts full profile URLs or @handles/usernames in startUrls, making it easy to paste mixed lists.

• 🎯 Precise per-profile limits
  Control depth with maxTweets (1–1000 per profile) to balance speed and dataset size.

• 🧵 Media & context extraction
  Captures photos, best-quality MP4 variants, hashtags, tagged users, and quoted post details for richer analytics.

• 📊 Clean, structured output
  Consistent field set including engagement metrics, author metadata, and ISO timestamps ready for BI tools.

• 🚀 Most-recent order by default
  Results are sorted by recency so your latest posts show up first out of the box.

• 🔄 Live dataset writes & easy export
  Streams results to the Apify dataset during the run. Download as JSON, CSV, or Excel, or consume via API.

• 🧰 Developer-friendly
  Works with the Apify API and SDK; integrate into pipelines for social listening, research, and reporting.

How to use Twitter X Tweets Scraper Scraper - step by step

1. Sign in to Apify
   Create a free Apify account or log in to access the actor.

2. Open Twitter X Tweets Scraper Scraper
   Find the actor in the Apify Store and click Try for free.

3. Add input profiles (startUrls)
   Paste one profile per line. Accepted formats:

• Full URLs: https://x.com/username or https://twitter.com/username
• Handles: username or @username

4. Set how many posts to collect
   Use maxTweets to choose 1–1000 posts per profile. Lower values finish faster; higher values build larger datasets.

5. (Optional) Configure proxies
   If you expect strict rate limits, enable proxyConfiguration. The actor can also escalate to datacenter or residential proxies when needed.

6. Start the run
   Click Start. The actor will resolve each profile, fetch tweets in pages, and write results as they’re collected.

7. Review and export results
   Open the Dataset tab to preview records and export to JSON, CSV, or Excel — or fetch via the Apify API.

Pro Tip: Chain this actor with your analytics or CRM pipeline using the Apify API to automate social listening dashboards or reporting.

Use cases

Use case name	Description
Social media analytics	Track engagement, verify posting cadence, and quantify content performance with likes, replies, reposts, quotes, and views.
Market research & trend tracking	Monitor creator or brand profiles for emerging topics and content themes with hashtags and tagged users.
Competitor content analysis	Compare content strategies using structured tweet text, media, and engagement across competitor profiles.
Brand monitoring	Collect replies/quotes and media-rich posts for customer feedback and sentiment workflows.
Reporting & BI pipelines	Export clean JSON/CSV/Excel and feed dashboards or data warehouses without additional transformation.
Academic & data science research	Build labeled datasets with timestamps, author metadata, and engagement metrics for reproducible studies.
Developer API workflows	Integrate the dataset endpoint into ETL jobs and automation for scheduled profile monitoring.

Why choose Twitter X Tweets Scraper Scraper?

Built for precision and resilience, this actor focuses on reliable tweet collection from public profiles without login.

• ✅ Accuracy-first extraction with ISO timestamps and consistent field names
• 🌍 Resilient networking via dynamic auth and proxy fallback (no → datacenter → residential)
• 📈 Scales per profile with maxTweets to match your depth and budget
• 🧑‍💻 Developer access through Apify API and SDK for pipeline integration
• 🛡️ Public data only — designed to avoid private or authenticated content
• 💸 Efficient runs and easy exports reduce total cost of ownership
• 🔧 More reliable than quick browser extensions or unstable scripts thanks to Apify infrastructure

In short, it’s a production-ready Twitter/X profile posts scraper that prioritizes clean output and dependable runs.

Is it legal / ethical to use Twitter X Tweets Scraper Scraper?

Yes — when used responsibly. This actor is designed to collect publicly available profile posts and does not access private or authenticated data.

Guidelines for compliant use:

• Scrape only public profiles and publicly visible posts.
• Respect platform terms and applicable laws (e.g., GDPR, CCPA).
• Avoid excessive request rates and do not attempt to bypass access controls.
• Do not misuse or resell personal data; verify your specific use case with your legal team.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "elonmusk",
    "https://x.com/BarackObama",
    "@NASA"
  ],
  "maxTweets": 25,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameter reference

• startUrls (array, required): One profile per line. Accepts full URLs (https://x.com/username or https://twitter.com/username) or handles (username or @username). Default: none.
• maxTweets (integer, optional): Number of posts per profile to collect. Range 1–1000. Default: 10.
• proxyConfiguration (object, optional): Apify proxy settings. Off by default (prefill: {"useApifyProxy": false}). The actor can escalate to datacenter and residential proxies internally when needed.

Example JSON output

[
  {
    "biography": "Technologist. Space, cars, AI.",
    "bookmarks": 42,
    "date_posted": "2026-04-04T06:40:47.000Z",
    "description": "Launching something new today 🚀",
    "external_url": "https://t.co/example",
    "followers": 229000000,
    "following": 1234,
    "hashtags": ["Launch", "Tech"],
    "id": "1765432109876543210",
    "input": {
      "url": "https://x.com/elonmusk/status/1765432109876543210/"
    },
    "is_verified": true,
    "likes": 15432,
    "name": "Elon Musk",
    "photos": "https://pbs.twimg.com/media/Example_photo.jpg",
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/example_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 310,
    "replies": 1250,
    "reposts": 780,
    "tagged_users": ["SpaceX"],
    "url": "https://x.com/elonmusk/status/1765432109876543210",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/example_1080.mp4"
    ],
    "views": 250340
  }
]

Notes:

• photos is a single image URL when present; videos is an array of MP4 URLs sorted by quality.
• quoted_post provides context when the tweet quotes another post; otherwise it contains nulls.
• Some fields (e.g., hashtags, tagged_users, photos, videos) may be null if not present in the tweet.

FAQ

Do I need to log in to scrape tweets?

No. The actor uses dynamic authorization and a guest token fallback to access public Twitter/X data without login.

What input formats are supported for profiles?

You can submit full profile URLs like https://x.com/username or https://twitter.com/username, as well as handles such as username or @username in startUrls.

How many posts can I collect per profile?

You can set maxTweets between 1 and 1000 per profile. The default is 10 for quick tests.

What data does the output include?

Each record includes tweet text, URL, timestamps, engagement metrics (likes, replies, reposts, quotes, views, bookmarks), media (photos, videos), hashtags, tagged users, author metadata, and quoted post details.

Can I export the results?

Yes. Open the run’s Dataset in Apify and export to JSON, CSV, or Excel, or access via the Apify API.

How does proxy handling work?

If requests fail due to rate limits or blocks, the actor can escalate from no proxy to datacenter and then residential proxies (with retries) to keep the run moving.

Does it work for tweet URLs?

This actor targets profile timelines. If you pass a tweet URL, it’s detected and skipped. Provide profile URLs or @handles instead.

In what order are tweets returned?

By default, results are sorted by most recent first to prioritize the latest posts.

Closing CTA / Final thoughts

Twitter X Tweets Scraper Scraper is built to collect structured, media-rich tweet data from public profiles reliably and at scale. With resilient networking, per-profile limits, and clean fields, it’s ideal for marketers, developers, analysts, and researchers who need ready-to-use datasets. Connect it to the Apify API to automate social listening dashboards or research pipelines, and start extracting smarter, structured Twitter/X insights today.