Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper is a scalable X (Twitter) data extraction tool that collects public tweets and profile details for analytics and research — a powerful Twitter X data scraper and Twitter profile scraper for marketers, developers, data analysts, and researchers. It helps you scrape Twitter profiles and tweets, run keyword or hashtag searches, and download tweets from X without API limits. Built on Apify’s cloud, it enables consistent, repeatable collection of structured data at scale.

What data / output can you get?

This actor produces clean, structured records for each tweet. Below are key fields returned in the dataset, using real field names exactly as they appear in the output.

Data type	Description	Example value
id	Tweet ID as a string	"1519480761749016577"
url	Direct URL to the tweet	"https://x.com/elonmusk/status/1519480761749016577"
username	Handle of the tweeting account (prefixed with @)	"@elonmusk"
fullname	Display name of the account	"Elon Musk"
timestamp	Original tweet creation time (UTC)	"Thu Apr 28 00:56:58 +0000 2022"
text	Full tweet text	"Next I'm buying Coca-Cola to put the cocaine back in"
verified	Whether the account is verified (blue)	true
likes	Like count	4289224
replies	Reply count	170050
retweets	Retweet/Repost count	594428
quotes	Quote count	167104
links	Array of expanded URLs found in tweet/cards/media	[]
isPinned	Whether the tweet was pinned when captured	false
isQuote	Whether the tweet is a quote tweet	false
isRetweet	Whether the tweet is a retweet/repost	false
isReply	Whether the tweet is a reply	false
media	Array of attached media items with type and URL	[{"type":"photo","url":"https://pbs.twimg.com/media/..."}]
tweetUserId	Numeric user ID (as string) of the tweeting account	"44196397"
user.avatar	Profile image URL	"https://pbs.twimg.com/profile_images/..."
user.userFullName	Account display name	"Elon Musk"
user.totalFollowers	Followers count at capture time	229037864
user.userId	Account user ID	"44196397"
user.website	Website from profile (expanded)	null

Notes:

• The user object also includes: username, description, location, joinDate, verified, totalLikes, totalTweets, totalFollowing, url, totalMediaCount.
• Media includes best-available video URLs (MP4) or image URLs when present.
• Export your dataset as JSON, CSV, or Excel directly from Apify.

Key features

• 🚀 Multi-mode inputs
  Provide profile URLs, usernames, or keyword queries to run focused profile scraping or broad Twitter search results scraping in one workflow.

• 🧭 Reply inclusion control
  Use the withReplies setting to include or exclude replies from results, tailoring output for timelines vs. original posts.

• 🧑‍💼 Rich user details (optional)
  Toggle includeUserInfo to attach a structured user object with avatar, joinDate, and follower/following/tweet counts to each record.

• 📈 Configurable limits
  Control throughput with maxTweets (1–100) per profile/keyword to quickly build datasets or run fast spot checks.

• 🛡️ Smart proxy fallback
  Automatic proxy handling with a built-in fallback to residential proxies if requests are blocked, ensuring higher success rates.

• ⚙️ Cloud-native automation
  Run on Apify’s reliable infrastructure with scheduling and monitoring for consistent, repeatable data collection.

• 📁 Export-ready datasets
  Clean, well-structured records designed for analytics pipelines and data science workflows, including a media array and extracted links.

• 🐍 Python-based, production-ready
  Implemented with Playwright and Apify SDK for robustness — a dependable X API alternative tweet scraper without API keys.

How to use Twitter X Tweets Profiles Scraper - step by step

1. Sign in to Apify
   Create a free account or log in to access the actor.

2. Open the actor page
   Search for “Twitter X Tweets Profiles Scraper” in the Apify Store.

3. Add input data
   In startUrls, paste items such as:

   • Profile URLs: "https://x.com/elonmusk"
   • Usernames: "mrbeast" or "@mrbeast"
   • Keyword or hashtag queries: "AI trends" or "#startups"

4. Configure options

   • maxTweets: set between 1 and 100 per input
   • withReplies: true/false to include or exclude replies
   • includeUserInfo: true/false to attach the user object
   • sortOrder: "newest", "oldest", or "popular"
   • proxyConfiguration: enable Apify Proxy or keep direct connection

5. Start the run
   Click Start. The actor launches a headless browser session, navigates X, and streams structured tweet records to the dataset.

6. Monitor progress
   View logs in real time. The actor automatically normalizes inputs and applies your withReplies and maxTweets settings.

7. Download results
   Open the dataset and export as JSON, CSV, or Excel for analysis or integration.

Pro Tip: Schedule runs on Apify for continuous monitoring of profiles or topics, then pull the dataset via the Apify API into your BI dashboards.

Use cases

Use case	Description
Social listening & brand monitoring	Track public conversations by scraping Twitter profiles and tweets from key accounts and keyword searches to quantify reach and engagement.
Competitor posting analysis	Measure posting cadence, likes, replies, retweets, and quotes for competitor accounts to benchmark performance.
Content research & trend discovery	Collect recent tweets via a Twitter search results scraper to identify topics that resonate with your audience.
Academic & NLP datasets	Build structured corpora with timestamps, engagement counts, and media links for machine learning and sentiment analysis.
Campaign tracking	Monitor replies and quote activity around branded profiles to evaluate community response and creative performance.
Market intelligence	Use an X tweets scraper to export timelines to CSV/JSON for time series analysis and reporting.
Hashtag/topic exploration	Run keyword or hashtag queries as a Twitter hashtag scraper to see what’s trending without API constraints.

Why choose Twitter X Tweets Profiles Scraper?

This actor is engineered for precision, reliability, and scale — a cloud-based Twitter data extraction tool purpose-built for production use.

• ⚡ Fast and scalable: Collect up to 100 tweets per input in a single run for rapid insights.
• 🧩 Structured for analytics: Clean fields, consistent schema, and optional user object for downstream analysis.
• 🛡️ Resilient networking: Automatic proxy fallback to residential when blocks are detected.
• 🔒 No API keys required: An X API alternative tweet scraper that works without authentication keys.
• 🧑‍💻 Developer-friendly: Run on Apify, access datasets programmatically, and integrate with your pipelines.
• 🌐 Cloud automation: Schedule runs and let the platform handle uptime and orchestration.
• ✅ Safer than extensions: Avoid fragile browser plugins and unstable scripts with a production-ready actor.

Bottom line: a robust, export-ready Twitter profile scraper and X tweets scraper that prioritizes data quality and operational reliability.

Is it legal / ethical to use Twitter X Tweets Profiles Scraper?

Yes — when used responsibly. This actor collects publicly available information from X (Twitter) and does not access private accounts, protected content, or login-required pages.

Guidelines for compliant use:

• Scrape only public data and respect platform Terms of Service.
• Ensure alignment with applicable privacy laws (e.g., GDPR, CCPA).
• Use the data ethically for research, analytics, and automation — never for spam or harassment.
• Consult your legal team for edge cases or jurisdiction-specific requirements.

Input parameters & output format

Example input JSON

{
  "startUrls": [
    "https://x.com/elonmusk",
    "mrbeast",
    "AI trends"
  ],
  "maxTweets": 10,
  "withReplies": true,
  "includeUserInfo": true,
  "sortOrder": "newest",
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

Field	Type	Required	Default	Description
startUrls	array (string list)	Yes	—	List of Twitter/X profile URLs (e.g., https://x.com/username), usernames (e.g., username or @username), or search keywords.
sortOrder	string	No	"newest"	How to sort the tweets. One of: "newest", "oldest", "popular".
maxTweets	integer	No	10	Maximum number of tweets to scrape per profile/keyword (1–100).
withReplies	boolean	No	true	Include reply tweets in the results.
includeUserInfo	boolean	No	true	Include detailed user profile information with each tweet.
proxyConfiguration	object	No	{"useApifyProxy": false}	Proxy settings. Actor will automatically fallback to datacenter then residential proxy if requests are blocked.

Notes:

• startUrls accepts plain strings; the actor also handles objects with a url field if provided.
• Results are capped to 100 tweets per input per run.

Example output JSON

{
  "id": "1519480761749016577",
  "url": "https://x.com/elonmusk/status/1519480761749016577",
  "verified": true,
  "username": "@elonmusk",
  "fullname": "Elon Musk",
  "timestamp": "Thu Apr 28 00:56:58 +0000 2022",
  "text": "Next I'm buying Coca-Cola to put the cocaine back in",
  "links": [],
  "isPinned": false,
  "isQuote": false,
  "isRetweet": false,
  "isReply": false,
  "likes": 4289224,
  "replies": 170050,
  "retweets": 594428,
  "quotes": 167104,
  "user": {
    "avatar": "https://pbs.twimg.com/profile_images/...",
    "username": "elonmusk",
    "userFullName": "Elon Musk",
    "description": "",
    "location": null,
    "website": null,
    "joinDate": "Tue Jun 02 20:12:29 +0000 2009",
    "verified": true,
    "totalLikes": 182734,
    "totalTweets": 89153,
    "totalFollowing": 1226,
    "totalFollowers": 229037864,
    "url": null,
    "userId": "44196397",
    "totalMediaCount": 4225
  },
  "media": [
    {
      "type": "photo",
      "url": "https://pbs.twimg.com/media/..."
    }
  ],
  "tweetUserId": "44196397"
}

Field behavior:

• When includeUserInfo is false, the user object is omitted from the output.
• Some user fields (e.g., location, website) may be null if not present on the profile.
• media may be empty when no attachments are present; for videos, the best-available MP4 URL is selected when possible.

FAQ

Is the Twitter X Tweets Profiles Scraper free to try?

Yes. You can run the actor on Apify with free credits, which is ideal for small tests before scaling up.

Does this require API keys or login?

No. It works without API authentication keys and does not access private or login-only areas, making it an effective X API alternative tweet scraper.

Can it scrape keywords or hashtags?

Yes. Add keyword or hashtag queries to startUrls and the actor will return public search results, making it a reliable Twitter search results scraper and Twitter hashtag scraper.

Can it include replies or only original tweets?

Both. Set withReplies to true to include replies from timelines and searches, or false to exclude them.

Does it scrape followers?

It captures follower metrics in the user object (e.g., user.totalFollowers) for each tweet’s author. It does not extract follower lists.

How many results can I get per run?

You can set maxTweets between 1 and 100 per profile or keyword in a single run. You can queue multiple inputs for larger collections and schedule recurring runs for continuous monitoring.

What export formats are supported?

You can export the dataset from Apify as JSON, CSV, or Excel for analysis, reporting, or integration with your data pipelines.

Is it legal to scrape Twitter/X?

Yes, when done responsibly. The actor collects only publicly available data. Always ensure compliance with Twitter’s Terms of Service and relevant privacy laws (e.g., GDPR/CCPA).

Closing thoughts

Twitter X Tweets Profiles Scraper is built to collect public tweets and profile context at scale — fast, structured, and ready for analytics. With configurable limits, optional user enrichment, reply inclusion, and resilient proxy handling, it serves marketers, developers, data analysts, and researchers alike. Run it on Apify, export to JSON/CSV/Excel, and plug results into your dashboards or models. Start extracting smarter Twitter/X datasets for social listening, trend analysis, and competitive intelligence today.