Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper is a cloud-ready Twitter X data scraper that collects public tweets and profile metadata at scale — ideal for social listening, brand monitoring, market research, and lead generation. It tackles the challenge of extracting clean, structured tweet text, engagement, media, and user details from X (Twitter) without relying on the official API. Built for marketers, developers, data analysts, and researchers, this Twitter tweets and profiles scraper enables repeatable, automated pipelines for analysis and reporting.

What data / output can you get?

The actor saves structured records to the Apify Dataset. Below are key output fields (using real field names) with examples.

Data type (field)	Description	Example value
id	Tweet ID (string)	"1519480761749016577"
url	Tweet permalink	"https://x.com/elonmusk/status/1519480761749016577"
username	Author handle with @	"@elonmusk"
fullname	Author display name	"Elon Musk"
timestamp	Tweet creation time	"Thu Apr 28 00:56:58 +0000 2022"
text	Full tweet text	"Next I'm buying Coca-Cola to put the cocaine back in"
links	Expanded URLs found in the tweet	[]
likes	Like count	4289224
replies	Reply count	170050
retweets	Retweet count	594428
media	Array of media objects	[{"type":"photo","url":"https://pbs.twimg.com/media/..."}]
user.totalFollowers	Follower count (from nested user)	229037864

Bonus fields include: verified, isPinned, isQuote, isRetweet, isReply, quotes, tweetUserId, and a rich user object (avatar, username, userFullName, description, location, website, joinDate, verified, totalLikes, totalTweets, totalFollowing, totalFollowers, url, userId, totalMediaCount). You can export your dataset to JSON, CSV, or Excel for downstream analytics — perfect for a Twitter to CSV scraper workflow.

Key features

• ⚡ Automatic proxy fallback for reliability
  Built-in logic sets a proxy and falls back to residential proxies if requests are blocked, improving stability for a real-time Twitter scraping tool.

• 🔍 Multi-mode inputs (profiles and search)
  Accepts profile URLs, usernames (with or without @), and keyword queries — making it a versatile X profile scraper tool and Twitter search results scraper.

• 💬 Replies toggle
  Control whether to include replies using the withReplies flag for precise datasets in your Twitter mentions and replies scraper workflows.

• 👤 Rich user metadata (optional)
  Include or exclude the nested user object via includeUserInfo to tailor output for lightweight or enriched pipelines (e.g., Twitter username and bio scraper needs).

• 📏 Tunable limits for performance
  Use maxTweets (1–100) per target to balance depth and speed — great for bulk Twitter tweet downloader scenarios.

• 🧠 Headless browser + GraphQL capture
  Powered by Playwright automation with session token capture to fetch tweets accurately — a robust Twitter API alternative data extractor.

• 💾 Flexible data export
  Download results from the Apify Dataset in JSON, CSV, or Excel for easy integration into BI tools and data warehouses.

• ☁️ Built for Apify cloud
  Run at scale on Apify’s infrastructure and integrate this Twitter tweets and profiles scraper into scheduled workflows.

How to use Twitter X Tweets Profiles Scraper - step by step

1. Create or log in to your Apify account
   Access the actor from your Apify dashboard.

2. Open the Twitter X Tweets Profiles Scraper actor
   Find it in the Apify Store and click Try for free.

3. Add input data
   In startUrls, enter any mix of:

   • Profile URLs (e.g., https://x.com/username)
   • Usernames (e.g., username, @username)
   • Keywords (e.g., "AI trends", "product launch")

4. Configure options

   • maxTweets: Set 1–100 results per input
   • withReplies: Include or exclude replies
   • includeUserInfo: Toggle nested user details
   • sortOrder: Choose "newest", "oldest", or "popular" (as provided in the input schema)
   • proxyConfiguration: Optionally enable Apify Proxy

5. Run the actor
   Click Start. The run opens a headless browser session, captures tokens, and fetches tweets for your inputs.

6. Monitor and review
   Track progress in the run console. Tweets are pushed incrementally to the Dataset.

7. Export your results
   Download your dataset as JSON, CSV, or Excel for analytics and integrations.

Pro tip: Combine keyword and profile inputs in one run to build richer datasets for a Twitter hashtag scraper or X tweets scraper without API workflows.

Use cases

Use case name	Description
Social media analytics for marketing teams	Measure engagement (likes, replies, retweets) across competitor and influencer profiles to inform campaign strategy.
Brand monitoring & social listening	Track brand or product keywords using keyword inputs for a reliable Twitter search results scraper workflow.
Audience & profile intelligence	Enrich lead lists with public bios, websites, and follower counts using includeUserInfo in a Twitter user profile data scraper.
Content research & trend tracking	Extract topical tweets on-demand to support editorial calendars and NLP-based sentiment analysis.
Academic & data science projects	Build reproducible datasets for language modeling and behavior analysis with structured tweet fields.
Developer pipelines (ETL/ELT)	Feed tweet records into data lakes or dashboards, enabling a practical Twitter API alternative data extractor.

Why choose Twitter X Tweets Profiles Scraper?

• 🎯 Precision-first extraction using headless automation and captured API responses for reliable results.
• 🚀 Scales to multiple profiles and keywords with tunable limits (maxTweets per input).
• 🧩 Developer-friendly outputs with consistent field names suited for analytics and ML pipelines.
• 🔐 Safe-by-design: Works with public data and does not require login or API keys.
• 🌍 Flexible exports: Move clean data to CSV, JSON, or Excel for fast analysis.
• 🛡️ Robustness built in: Automatic proxy fallback helps reduce blocks and failures.
• 💸 Cost-effective alternative to unstable extensions and DIY scripts — production-ready on Apify.

In short, this is a dependable Twitter X data scraper vs. browser-based alternatives, designed for automation and repeatability.

Is it legal / ethical to use Twitter X Tweets Profiles Scraper?

Yes — when used responsibly. The actor collects publicly available information from X (Twitter) and does not access private accounts, protected content, or login-required pages. To stay compliant:

• Review and respect Twitter/X Terms of Service.
• Adhere to data protection laws such as GDPR and CCPA.
• Use the data ethically for research, analytics, and monitoring — not for spam or abuse.
• Verify compliance with your legal team for edge cases and jurisdiction-specific rules.

Input parameters & output format

Example input JSON

{
  "startUrls": [
    "https://x.com/elonmusk",
    "mrbeast",
    "AI trends"
  ],
  "maxTweets": 10,
  "withReplies": true,
  "includeUserInfo": true,
  "sortOrder": "newest",
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

Field	Type	Required	Default	Description
startUrls	array (stringList)	Yes	—	List of Twitter/X profile URLs (e.g., https://x.com/username), usernames (e.g., username or @username), or search keywords.
sortOrder	string (enum: newest, oldest, popular)	No	"newest"	How to sort the tweets.
maxTweets	integer (1–100)	No	10	Maximum number of tweets to scrape per profile/keyword.
withReplies	boolean	No	true	Include reply tweets in the results.
includeUserInfo	boolean	No	true	Include detailed user profile information with each tweet.
proxyConfiguration	object	No	{"useApifyProxy": false}	Proxy settings. Actor will automatically fallback to datacenter then residential proxy if requests are blocked.

Example output JSON

{
  "id": "1519480761749016577",
  "url": "https://x.com/elonmusk/status/1519480761749016577",
  "verified": true,
  "username": "@elonmusk",
  "fullname": "Elon Musk",
  "timestamp": "Thu Apr 28 00:56:58 +0000 2022",
  "text": "Next I'm buying Coca-Cola to put the cocaine back in",
  "links": [],
  "isPinned": false,
  "isQuote": false,
  "isRetweet": false,
  "isReply": false,
  "likes": 4289224,
  "replies": 170050,
  "retweets": 594428,
  "quotes": 167104,
  "user": {
    "avatar": "https://pbs.twimg.com/profile_images/...",
    "username": "elonmusk",
    "userFullName": "Elon Musk",
    "description": "",
    "location": null,
    "website": null,
    "joinDate": "Tue Jun 02 20:12:29 +0000 2009",
    "verified": true,
    "totalLikes": 182734,
    "totalTweets": 89153,
    "totalFollowing": 1226,
    "totalFollowers": 229037864,
    "url": null,
    "userId": "44196397",
    "totalMediaCount": 4225
  },
  "media": [
    {
      "type": "photo",
      "url": "https://pbs.twimg.com/media/..."
    }
  ],
  "tweetUserId": "44196397"
}

Notes:

• When includeUserInfo is set to false, the user object is omitted from each pushed record.
• media is an array of objects with type and url keys.

FAQ

Is there a free trial?

Yes. This actor offers trial minutes on Apify (trialMinutes: 120 in the listing), so you can test small runs before subscribing.

Do I need API keys or login to use it?

No. The scraper operates without official API credentials and targets publicly available content.

Can it scrape keywords and hashtags?

Yes. Add keywords (e.g., "AI trends") to startUrls and it will collect matching tweets from search — ideal for a Twitter hashtag scraper workflow.

Does it extract follower lists?

It does not extract follower lists. However, it outputs follower metrics via user.totalFollowers in the nested user object when includeUserInfo is true.

How many tweets can I get per input?

You can set maxTweets between 1 and 100 per profile or keyword. The actor will return up to that limit per item in startUrls.

What formats can I export?

You can export your Apify Dataset to JSON, CSV, or Excel — a simple way to build a Twitter to CSV scraper pipeline.

Does it capture replies and quotes?

Yes. The output includes isReply, isQuote, and quotes counts. You can also toggle withReplies to include or skip replies.

Is it suitable for automation and large workflows?

Yes. It’s designed for Apify’s cloud runtime and supports multiple inputs per run, making it practical for bulk Twitter tweet downloader and monitoring use cases.

Final thoughts

Twitter X Tweets Profiles Scraper is built to collect tweets and profile metadata reliably, at scale, and in structured form. With flexible inputs (profiles or keywords), per-run limits, optional user enrichment, and robust proxy fallback, it fits the needs of marketers, developers, analysts, and researchers. Developers can plug the clean JSON into pipelines, or export to CSV/Excel for quick analysis. Start building your real-time Twitter scraping toolchain and extract smarter insights from X today.