Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper

Twitter X Tweets Scraper Scraper is a fast, reliable Twitter X scraper that extracts public posts from X/Twitter user timelines at scale. It solves the pain of manual copy-paste and unreliable tools by automating tweet collection with clean, structured outputs — perfect for marketers, developers, data analysts, and researchers. As a Twitter tweets scraper and X posts scraper, it pulls post text, media, engagement, and author metadata in bulk, enabling social listening, sentiment analysis, brand monitoring, and analytics dashboards without the official API.

What data / output can you get?

This actor saves structured tweet records directly to the Apify dataset. Below are the key fields (exact names) you’ll get, plus example values.

Data type	Description	Example value
id	Tweet ID (rest_id)	"1988877569597260072"
url	Direct tweet URL	"https://x.com/elonmusk/status/1988877569597260072"
user_posted	Username (screen name)	"elonmusk"
name	Display name	"Elon Musk"
description	Full tweet text	"@tetsuoai Long press on any image to turn it into a video…"
date_posted	ISO timestamp (UTC)	"2025-11-13T07:52:18.000Z"
likes	Favorite count	1729
replies	Reply count	554
reposts	Repost/retweet count	368
quotes	Quote count	38
views	View count (impressions)	1399060
bookmarks	Bookmark count	213
is_verified	Blue check status	true
followers	Author follower count	229031060
following	Author following count	1226
posts_count	Author total posts	89153
profile_image_link	Profile image URL	"https://pbs.twimg.com/profile_images/.../oTT3nm5Z_normal.jpg"
biography	Author bio	"Technoking of Tesla, Imperator of Mars"
hashtags	Array of hashtags (texts)	["AI","SpaceX"]
tagged_users	Array of mentioned usernames	["tetsuoai"]
photos	First photo URL if present	"https://pbs.twimg.com/media/abcd1234.jpg"
videos	Array of mp4 video URLs (sorted by bitrate desc)	["https://video.twimg.com/.../file.mp4"]
quoted_post	Quoted post summary object	{"data_posted":"2025-11-12T18:02:00.000Z","description":"…","post_id":"19888…","profile_id":"44196397","profile_name":"Elon Musk","url":null,"videos":null}
external_url	Author external URL (profile)	"https://tesla.com"
input	Input trace with constructed tweet URL	{"url":"https://x.com/elonmusk/status/1988877569597260072/"}

Notes:

• Media fields include a single photo URL (photos) and an array of video URLs (videos).
• Data can be exported from the Apify dataset in CSV, JSON, or Excel for easy analysis and reporting (e.g., Export tweets to CSV, Download tweets in bulk).

Key features

• 🧠 Dynamic authorization capture Captures a valid Bearer token via headless browsing when available, and falls back to a default guest token to power a Twitter scraper without API credentials.

• 🌐 Smart proxy fallback Built-in resilience with automatic proxy routing: starts with your configuration (or none), then falls back datacenter → residential with retries to minimize rate limits and blocks.

• 📈 User timeline focus, at scale Acts as a Twitter user timeline scraper to collect recent posts from any public profile using usernames, @handles, or profile URLs — perfect for bulk monitoring.

• 🎬 Media-aware extraction Collects photos and high-bitrate video URLs, plus hashtags and tagged users, delivering a complete tweet metadata scraper for downstream analytics.

• 🧵 Quoted post context Includes a structured quoted_post object with IDs, author info, timestamps, and text when available, adding conversation context for sentiment or research.

• 📊 Clean, structured outputs Consistent field names (id, url, likes, replies, reposts, quotes, views, etc.) ready for pipelines. Export to JSON/CSV/Excel or access via the Apify API.

• 🚦 Sensible ordering by default Results are ordered by recency out of the box, so dashboards and analyses reflect the latest posts first.

• 🧩 Developer-friendly Works seamlessly with Apify’s SDK and API for integrations, real-time tweet scraping, and automation workflows in Make, n8n, Zapier, or Python.

• 🏗️ Production-ready reliability Pagination via GraphQL cursors, error handling, and incremental dataset saves provide robustness for continuous X data extraction.

How to use Twitter X Tweets Scraper Scraper - step by step

1. Create or log in to your Apify account You can run the actor from the Apify console or via API.

2. Add profiles to scrape Paste profile URLs or @handles into startUrls. It accepts:

   • Full links: https://x.com/username or https://twitter.com/username
   • Short handles: username or @username

3. Set how many posts to collect Adjust maxTweets (1–1000) to control depth per profile. Lower values run faster for quick tests.

4. (Optional) Configure proxies Toggle proxyConfiguration to improve resilience if X is strict with your IP. Off by default.

5. Start the run Click Start (or trigger via API). The actor resolves each username to a user ID, paginates the timeline, and saves each tweet to the dataset as it’s found.

6. Monitor progress Live logs show which profiles are being processed and how many tweets have been collected so far.

7. Export your results Open the run’s dataset and export to JSON, CSV, or Excel. Use the dataset API for pipelines and automation.

Pro Tip: Chain this X data extraction tool into your analytics stack (e.g., feed CSV to BI tools or pull JSON via API into a Python notebook for sentiment analysis).

Use cases

Use case name	Description
Social listening & brand monitoring	Track mentions and reactions on public user timelines to quantify engagement and spot issues early.
Competitor content analysis	Benchmark posting cadence and reactions by exporting structured metrics (likes, replies, reposts, views).
Campaign measurement	Monitor creator/brand profiles to evaluate performance across hashtags, tagged users, and media.
Market & trend research	Identify topics and media formats gaining traction based on public posts and engagement patterns.
Academic & NLP datasets	Build labeled corpora with tweet text and metadata for sentiment and topic modeling.
Executive dashboards	Feed CSV/JSON to BI tools for ongoing KPIs across specific public accounts.
Automation & ETL pipelines	Integrate the dataset API with Make/n8n/Zapier or Python for real-time tweet scraping and downstream processing.

Why choose Twitter X Tweets Scraper Scraper?

A precise, automation-ready Twitter X data scraper that focuses on reliability and clean outputs for production workflows.

• 🧪 High-accuracy extraction of text, media, and engagement metrics from public timelines.
• ⚡ Scales to many profiles and hundreds of posts per run with robust pagination and dataset streaming.
• 💻 Developer access via Apify API and SDK — ideal for pipelines, notebooks, and apps.
• 🔒 Safe-by-design: works with publicly available data and optional proxies for resilience.
• 💰 Cost-efficient compared to fragile browser extensions and unstable alternatives.
• 🧩 Integration-friendly outputs for CSV/JSON/Excel and automation tools.
• 🏁 Built for consistency: automatic proxy fallback and incremental saving reduce failed jobs.

In short: a production-grade Twitter posts scraper vs. brittle, extension-based tools.

Is it legal / ethical to use Twitter X Tweets Scraper Scraper?

Yes — when used responsibly. This actor collects publicly available tweet data from user timelines and does not access private or authenticated content.

Guidelines for compliant use:

• Only target public profiles and publicly visible posts.
• Respect X/Twitter’s terms and applicable laws (e.g., GDPR, CCPA).
• Avoid excessive request rates and do not attempt to bypass access controls.
• Do not misuse or republish data in ways that violate privacy or policy.
• For edge cases or regulated use, confirm with your legal team.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "elonmusk",
    "@BarackObama",
    "https://x.com/NASA",
    "https://twitter.com/Tesla"
  ],
  "maxTweets": 25,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

• startUrls

  • Type: array (string list)
  • Description: One profile per line — supports https://x.com/username, https://twitter.com/username, username, or @username.
  • Default: none
  • Required: Yes

• maxTweets

  • Type: integer
  • Description: How many posts to collect per profile (1–1000). Lower is faster; higher yields larger datasets.
  • Default: 10
  • Required: No

• proxyConfiguration

  • Type: object
  • Description: Optional proxies. Off by default; helps when X is picky about your IP. The actor can also use smarter routing with datacenter → residential fallback on failures.
  • Default: {"useApifyProxy": false}
  • Required: No

Example JSON output

[
  {
    "biography": "Technoking of Tesla, Imperator of Mars",
    "bookmarks": 213,
    "date_posted": "2025-11-13T07:52:18.000Z",
    "description": "@tetsuoai Long press on any image to turn it into a video in less than 30 seconds",
    "external_url": "https://tesla.com",
    "followers": 229031060,
    "following": 1226,
    "hashtags": ["AI", "Tech"],
    "id": "1988877569597260072",
    "input": {
      "url": "https://x.com/elonmusk/status/1988877569597260072/"
    },
    "is_verified": true,
    "likes": 1729,
    "name": "Elon Musk",
    "photos": "https://pbs.twimg.com/media/abcd1234.jpg",
    "posts_count": 89153,
    "profile_image_link": "https://pbs.twimg.com/profile_images/1983681414370619392/oTT3nm5Z_normal.jpg",
    "quoted_post": {
      "data_posted": null,
      "description": null,
      "post_id": null,
      "profile_id": null,
      "profile_name": null,
      "url": null,
      "videos": null
    },
    "quotes": 38,
    "replies": 554,
    "reposts": 368,
    "tagged_users": ["tetsuoai"],
    "url": "https://x.com/elonmusk/status/1988877569597260072",
    "user_posted": "elonmusk",
    "videos": [
      "https://video.twimg.com/amplify_video/1988877511368019968/vid/576x856/clip.mp4"
    ],
    "views": 1399060
  }
]

Notes:

• Fields can be null when not present on the tweet (e.g., photos, videos, quoted_post).
• Views may appear as a large integer depending on availability in the source.

FAQ

Do I need the official X/Twitter API to use this?

No. This is a Twitter scraper without API credentials. It collects public tweet data via the web, using dynamic authorization and GraphQL endpoints under the hood.

Can I export tweets to CSV or Excel?

Yes. After a run, open the dataset and export to CSV, JSON, or Excel. This makes it easy to Download tweets in bulk and feed them into dashboards or BI tools.

What inputs does it accept?

Provide usernames, @handles, or profile URLs in startUrls. You can also mix formats like "elonmusk", "@BarackObama", "https://x.com/NASA", or "https://twitter.com/Tesla".

How many tweets can I scrape per profile?

You can set maxTweets from 1 to 1000. Start small to test and increase for deeper timelines or larger datasets.

Does it capture media and hashtags?

Yes. It extracts photos, videos (as mp4 URLs), hashtags, and tagged_users, plus engagement metrics and author metadata, making it a complete tweet metadata scraper.

Is it suitable for automation and APIs?

Yes. You can trigger runs and fetch results via the Apify API, integrate with Make/n8n/Zapier, or use Python for real-time tweet scraping in your pipelines.

Will proxies help if I’m getting blocked?

Often. You can enable proxyConfiguration and the actor includes smart fallback routing to datacenter and residential proxies to reduce rate limits and blocks.

Is scraping public tweets legal?

Yes, when done responsibly. Only target public data, respect terms and laws, and avoid misuse of the information you collect.

Final thoughts

Twitter X Tweets Scraper Scraper is built to extract structured, analytics-ready tweet data from public user timelines at scale. With resilient proxy handling, dynamic authorization, and clean outputs, it’s ideal for marketers, developers, analysts, and researchers. Export to CSV/JSON/Excel, plug into the Apify API, or automate end-to-end workflows with your favorite tools. Start extracting smarter, faster insights from public X/Twitter posts today.