Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper is a cloud-based data extraction tool that collects rich tweet content and user profile metadata from X (Twitter) at scale. It helps you scrape Twitter X without API limits to build datasets for social listening, research, and lead generation — acting as a twitter x tweets scraper and twitter x profile scraper for marketers, developers, data analysts, and researchers. Use it to monitor timelines, run keyword/hashtag searches, and export Twitter X tweets to CSV or JSON for downstream analysis and automation. 🚀

What data / output can you get?

Below are the exact JSON fields this actor outputs to the Apify dataset. Example values illustrate the structure you can expect when using this twitter x tweet extractor and twitter x search results scraper.

Data type	Description	Example value
id	Tweet ID (string)	"1519480761749016577"
url	Canonical tweet URL	"https://x.com/elonmusk/status/1519480761749016577"
verified	Author’s verification flag	true
username	Author’s handle with @	"@elonmusk"
fullname	Author’s display name	"Elon Musk"
timestamp	Tweet creation time (UTC)	"Thu Apr 28 00:56:58 +0000 2022"
text	Full tweet text	"Next I'm buying Coca-Cola to put the cocaine back in"
links	Array of expanded links found in tweet/card/media	[]
isPinned	Whether tweet is pinned	false
isQuote	Whether tweet is a quote tweet	false
isRetweet	Whether tweet is a retweet	false
isReply	Whether tweet is a reply	false
likes	Favorite count	4289224
replies	Reply count	170050
retweets	Retweet count	594428
quotes	Quote count	167104
media[].type	Media type (photo/video)	"photo"
media[].url	Best media URL detected	"https://pbs.twimg.com/media/..."
tweetUserId	Author user ID from tweet legacy	"44196397"
user.avatar	Profile image URL	"https://pbs.twimg.com/profile_images/..."
user.username	Screen name (no @)	"elonmusk"
user.userFullName	Display name	"Elon Musk"
user.description	Bio	""
user.location	Location if available	null
user.website	Website (expanded)	null
user.joinDate	Account creation time	"Tue Jun 02 20:12:29 +0000 2009"
user.verified	Profile verification	true
user.totalLikes	Total likes	182734
user.totalTweets	Total tweets	89153
user.totalFollowing	Following count	1226
user.totalFollowers	Followers count	229037864
user.url	Website (display URL)	null
user.userId	User ID (rest_id)	"44196397"
user.totalMediaCount	Media count	4225

Notes:

• If includeUserInfo is set to false, the user object is omitted from each item.
• Media includes photos and the best available video URLs where present.
• You can export your dataset as CSV or JSON from Apify. 📤

Key features

• 🧭 Multi-mode targeting
  Provide profile URLs, @usernames, numeric user IDs, or plain-text keywords/hashtags to drive both timeline and search workflows — ideal for a twitter x username scraper and twitter x search results scraper.

• 🧹 Reply filtering
  Use withReplies to include or exclude replies, keeping your datasets focused on original posts when needed.

• 🧷 Rich media capture
  Extract images and best-available video URLs from tweets, quotes, and retweets for complete content analysis.

• 👤 Profile metadata with each tweet
  When includeUserInfo is true, each tweet includes user fields like avatar, bio, join date, and follower/following/tweet counts — making this a reliable twitter x bios scraper and twitter x user profile scraper.

• 🛡️ Smart proxy fallback
  Built-in proxyConfiguration with automatic fallback to residential proxies when blocked to keep large runs stable.

• 🧠 Scrape Twitter X without API
  Browser-powered session handling collects public data without API keys or login, suitable for real-time twitter x scraping tool use cases.

• 🎚️ Configurable limits
  Control maxTweets per input (1–100) to balance speed and depth for batch jobs.

• ☁️ Apify-native automation
  Run on a schedule, chain runs, and pull results programmatically via the Apify API for pipelines and dashboards.

How to use Twitter X Tweets Profiles Scraper - step by step

1. Sign in to Apify
   Create a free Apify account or log in to access the actor.

2. Open the actor page
   Find “Twitter X Tweets Profiles Scraper” and click Try for free.

3. Add your input data
   In startUrls, paste profile URLs (e.g., https://x.com/username), usernames (e.g., @handle or handle), or keywords/hashtags (e.g., "AI news", "#fintech").

4. Configure options

   • maxTweets: Set 1–100 per input
   • withReplies: Toggle to include/exclude replies
   • includeUserInfo: Include detailed user data with each tweet
   • sortOrder: Keep at "newest" (default)
   • proxyConfiguration: Enable Apify Proxy if needed

5. Start the run
   Click Start. The actor will collect tweets from timelines or search results and push items to the dataset as they’re found.

6. Monitor progress
   View logs in real time. Tweets are pushed incrementally to the default dataset.

7. Export results
   Open the dataset and export to CSV or JSON for analysis, BI tools, or ingestion.

Pro Tip: Schedule your run on Apify and use the Dataset API to automate “download tweets from X” workflows into your data warehouse or CRM.

Use cases

Use case name	Description
Social listening for brands	Track timelines and keyword streams to quantify engagement and sentiment, then export Twitter X tweets to CSV for dashboards.
Competitor monitoring	Monitor posting cadence and media types from target profiles to analyze content strategy and performance.
Campaign tracking	Collect tweets matching branded hashtags or phrases using the built-in keyword search for a twitter x hashtag scraper workflow.
Influencer research	Build structured datasets of influencer posts and user metadata to evaluate reach and verify authenticity.
Academic & NLP research	Assemble corpora of tweets with timestamps, links, and media for language modeling and time-series analysis.
API & ETL pipelines	Use the Apify Dataset API to feed an automated pipeline for enrichment, alerts, and analytics — a developer-friendly twitter x data scraper tool pattern.
Mention monitoring	Search for brand names and @handles via keywords to approximate a twitter x mentions scraper workflow without APIs.

Why choose Twitter X Tweets Profiles Scraper?

This actor delivers structured, reliable tweet and profile data with automation-ready output.

• ✅ Accurate, structured fields optimized for analytics and NLP
• ⚡ Scalable runs with per-input maxTweets control for batch processing
• 🧩 Developer-friendly: datasets are accessible via API for pipelines
• 🔒 No API keys or logins required; collects public data only
• 🛡️ Robust proxy fallback for uninterrupted scraping at scale
• 💸 Cost-effective cloud execution with simple setup and maintenance-free ops
• 🏗️ Production-ready reliability on Apify versus unstable browser extensions

In short, you get a consistent, automation-friendly twitter x data scraper tool designed for scale and stability.

Is it legal / ethical to use Twitter X Tweets Profiles Scraper?

Yes — when used responsibly. This actor collects publicly available information and does not access private accounts, protected content, or login-required pages.

Guidelines to follow:

• Review and respect Twitter/X Terms of Service
• Comply with data protection laws (e.g., GDPR, CCPA)
• Use data ethically and avoid spam or harassment
• Consult your legal team for edge cases and jurisdiction-specific policies

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://x.com/elonmusk",
    "@nasa",
    "AI research"
  ],
  "maxTweets": 10,
  "withReplies": true,
  "includeUserInfo": true,
  "sortOrder": "newest",
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

• startUrls (array, required): List of Twitter/X profile URLs (e.g., https://x.com/username), usernames (e.g., username or @username), or search keywords.
• sortOrder (string, optional, default: "newest", enum: "newest" | "oldest" | "popular"): How to sort the tweets.
• maxTweets (integer, optional, default: 10, min: 1, max: 100): Maximum number of tweets to scrape per profile/keyword.
• withReplies (boolean, optional, default: true): Include reply tweets in the results.
• includeUserInfo (boolean, optional, default: true): Include detailed user profile information with each tweet.
• proxyConfiguration (object, optional, default: { "useApifyProxy": false }): Proxy settings. Actor will automatically fallback to datacenter then residential proxy if requests are blocked.

Example JSON output

{
  "id": "1519480761749016577",
  "url": "https://x.com/elonmusk/status/1519480761749016577",
  "verified": true,
  "username": "@elonmusk",
  "fullname": "Elon Musk",
  "timestamp": "Thu Apr 28 00:56:58 +0000 2022",
  "text": "Next I'm buying Coca-Cola to put the cocaine back in",
  "links": [],
  "isPinned": false,
  "isQuote": false,
  "isRetweet": false,
  "isReply": false,
  "likes": 4289224,
  "replies": 170050,
  "retweets": 594428,
  "quotes": 167104,
  "user": {
    "avatar": "https://pbs.twimg.com/profile_images/...",
    "username": "elonmusk",
    "userFullName": "Elon Musk",
    "description": "",
    "location": null,
    "website": null,
    "joinDate": "Tue Jun 02 20:12:29 +0000 2009",
    "verified": true,
    "totalLikes": 182734,
    "totalTweets": 89153,
    "totalFollowing": 1226,
    "totalFollowers": 229037864,
    "url": null,
    "userId": "44196397",
    "totalMediaCount": 4225
  },
  "media": [
    {
      "type": "photo",
      "url": "https://pbs.twimg.com/media/..."
    }
  ],
  "tweetUserId": "44196397"
}

Notes:

• If includeUserInfo is false, the user field is omitted.
• Some profile fields (e.g., website, location) may be null if not present publicly.

FAQ

Is there a free tier to try it?

Yes. This actor offers 120 trial minutes on Apify, making it easy to test small workloads before upgrading.

Do I need API keys or login to scrape?

No. The actor uses a headless browser session to collect public data and scrape Twitter X without API authentication.

Can it scrape keywords, hashtags, or brand names?

Yes. Add plain-text queries (e.g., "AI research", "#fintech", "brand name") to startUrls to run a twitter x search results scraper workflow.

How many tweets can I extract per input?

Up to maxTweets per input item (1–100). The actor enforces a hard cap of 100 per input to optimize speed and stability.

Can I exclude replies?

Yes. Set withReplies to false to filter out replies from the results and focus on original posts.

Does it extract follower lists?

No. It does not scrape follower lists. However, when includeUserInfo is true, each tweet includes follower-related metrics (e.g., totalFollowers) if available.

Does it work on private or protected accounts?

No. The actor only collects data from publicly available profiles and tweets.

Can I export results to CSV or JSON?

Yes. After the run, open the dataset and export as CSV or JSON for downstream analysis or integration.

Final thoughts

Twitter X Tweets Profiles Scraper is built for scalable extraction of tweets and associated profile metadata from public X timelines and searches. It delivers structured fields, rich media, and flexible configuration (maxTweets, withReplies, includeUserInfo) while supporting stable runs via proxy fallback. Whether you’re a marketer, developer, analyst, or researcher, you can automate “download tweets from X” workflows and plug the dataset into your pipelines via the Apify API. Start extracting cleaner, richer Twitter X data — reliably and at scale.