Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper is an Apify actor that extracts public tweets and profile metadata from X (Twitter) at scale. It solves the challenge of gathering real-time social content by turning profile URLs, usernames, and keyword searches into clean, structured datasets — ideal for marketers, developers, analysts, and researchers. Use this X tweets scraper and Twitter profile scraper for social listening, trend tracking, brand monitoring, and competitive intelligence — without API keys or rate limits. 🚀

What data / output can you get?

The actor pushes structured tweet objects to the Apify dataset. Below are the real output fields it produces, with examples.

Data type	Description	Example value
id	Tweet ID (string)	"1519480761749016577"
url	Tweet URL	"https://x.com/elonmusk/status/1519480761749016577"
username	Screen name with @ prefix	"@elonmusk"
fullname	Display name of the author	"Elon Musk"
verified	Whether the author is verified	true
timestamp	Tweet creation time (UTC)	"Thu Apr 28 00:56:58 +0000 2022"
text	Full tweet text	"Next I'm buying Coca-Cola to put the cocaine back in"
likes	Number of likes	4289224
replies	Number of replies	170050
retweets	Number of retweets	594428
quotes	Number of quote tweets	167104
isPinned	Whether the tweet is pinned	false
isQuote	Whether the tweet is a quote tweet	false
isRetweet	Whether the tweet is a retweet	false
isReply	Whether the tweet is a reply	false
links	Array of expanded URLs found in the tweet	[]
media	Array of media objects { type, url }	[{"type":"photo","url":"https://pbs.twimg.com/media/..."}]
user	Embedded user object with profile metadata	See Output Format JSON
tweetUserId	Author user ID (string)	"44196397"

Notes:

• The user object includes fields like avatar, userFullName, description, location, website, joinDate, totalLikes, totalTweets, totalFollowing, totalFollowers, url, userId, totalMediaCount.
• Some fields may be null if not available on the public profile (e.g., location, website).
• Export results from the Apify dataset in formats such as JSON, CSV, or Excel for downstream analysis (e.g., X tweets to CSV scraper workflows).

Key features

• 🛡️ Smart proxy fallback Automatically falls back to Apify Residential proxy when requests are blocked, maintaining reliability for your Twitter data scraper jobs.

• 🧩 Multi-mode inputs Accepts profile URLs, plain usernames (with or without @), numeric user IDs, and keywords — perfect for Twitter tweets scraper and Twitter search results scraper scenarios.

• 🔀 Reply filtering Control output depth using withReplies to include or exclude replies from results based on your use case.

• 👤 Optional user enrichment Use includeUserInfo to toggle the embedded user profile object per tweet — great for X user data extractor needs without bloating downstream pipelines.

• 🧰 Headless, API-free collection Uses a headless browser to collect tokens and fetch timelines without API keys — an X tweets scraper without API and Twitter scraper without API approach.

• 📦 Dataset-first outputs Structured JSON objects are pushed incrementally to the dataset for instant consumption and easy export (CSV/JSON/Excel).

• ⚙️ Developer-ready and scalable Built on the Apify platform with Python + Playwright for dependable batch runs across many profiles and queries.

How to use Twitter X Tweets Profiles Scraper - step by step

1. Sign in to Apify
   Create a free Apify account or sign in to access the actor.

2. Open the actor
   Find “Twitter X Tweets Profiles Scraper” in the Apify Store and click Try for free.

3. Add input data
   In startUrls, enter a list of:

• Profile URLs (e.g., https://x.com/username)
• Usernames (e.g., username or @username)
• Keywords (e.g., AI trends)

4. Configure options

• maxTweets: Set how many tweets to collect per input (1–100).
• withReplies: Include or exclude replies.
• includeUserInfo: Include or exclude the embedded user object.
• proxyConfiguration: Set useApifyProxy if you want to route traffic via Apify Proxy.

5. Start the run
   Click Start. The actor launches a headless session, collects session tokens, and begins extracting tweets or search results.

6. Monitor progress
   View logs and live dataset items as they are pushed. Errors are retried with proxy fallback if needed.

7. Export results
   Open the Run dataset and export to JSON, CSV, or Excel for analytics pipelines, dashboards, or CRM imports.

Pro Tip: Mix multiple profiles and keywords in a single run to build a comprehensive dataset for your X user scraper tool workflows.

Use cases

Use case name	Description
Social listening for brands	Track public tweets from target profiles and topics to quantify engagement for campaigns and sentiment analysis.
Competitor timeline analysis	Analyze posting frequency, engagement, and content types from competitor profiles to inform strategy.
Influencer monitoring	Collect recent posts from creators and thought leaders to spot trends and partnership opportunities.
Keyword-based research	Use keyword inputs to build datasets of topical posts for trend detection and research (Twitter search results scraper).
Academic & NLP datasets	Export structured tweets and profile metadata for machine learning, language models, and behavior research.
Market intelligence	Aggregate posts from industry voices to inform product decisions and go-to-market planning.
Lead research & outreach	Enrich records with bio fields, follower counts, and profile signals captured in the user object.

Why choose Twitter X Tweets Profiles Scraper?

This actor focuses on precision, automation, and reliability for X/Twitter data.

• ⚡ Production-ready scale: Run batch jobs across many inputs with cloud execution.
• 🔒 No API keys required: Works without API authentication, avoiding rate-limit constraints.
• 🛡️ Robust proxy strategy: Automatic fallback to residential proxies when needed.
• 🧠 Structured, analysis-ready data: Clean fields for analytics, dashboards, and NLP.
• 🧑‍💻 Developer-friendly: Use Apify datasets and API to integrate with your stack.
• 🧾 Cost-effective: Built for repeatable workflows with predictable performance.
• ✅ Safer alternative to unstable tools: Avoid brittle browser extensions and ad-hoc scripts with a maintained, store-listed solution.

Bottom line: a reliable X tweets scraper and Twitter profile scraper designed for real workflows.

Is it legal / ethical to use Twitter X Tweets Profiles Scraper?

Yes — when used responsibly. The actor collects only publicly available information and does not access private accounts, protected content, or login-required pages. You are responsible for ensuring compliance with:

• X (Twitter) Terms of Service
• Applicable data protection regulations (e.g., GDPR, CCPA)
• Ethical usage guidelines and your organization’s policies

Do not use the data for spam or harassment. For edge cases, consult your legal team.

Input parameters & output format

Below is the exact input schema this actor accepts, followed by a real example output object.

Example JSON input

{
  "startUrls": [
    "https://x.com/elonmusk",
    "mrbeast",
    "AI trends"
  ],
  "sortOrder": "newest",
  "maxTweets": 10,
  "withReplies": true,
  "includeUserInfo": true,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

Field	Type	Description	Default	Required
startUrls	array (stringList)	List of Twitter/X profile URLs (e.g., https://x.com/username), usernames (e.g., username or @username), or search keywords.	—	Yes
sortOrder	string (enum: newest, oldest, popular)	How to sort the tweets. Note: Captured in input; current version prioritizes newest results via timeline fetch.	"newest"	No
maxTweets	integer (1–100)	Maximum number of tweets to scrape per profile/keyword.	10	No
withReplies	boolean	Include reply tweets in the results.	true	No
includeUserInfo	boolean	Include detailed user profile information with each tweet.	true	No
proxyConfiguration	object (editor: proxy)	Proxy settings. Actor will automatically fallback to datacenter then residential proxy if requests are blocked.	{"useApifyProxy": false}	No

Example JSON output

{
  "id": "1519480761749016577",
  "url": "https://x.com/elonmusk/status/1519480761749016577",
  "verified": true,
  "username": "@elonmusk",
  "fullname": "Elon Musk",
  "timestamp": "Thu Apr 28 00:56:58 +0000 2022",
  "text": "Next I'm buying Coca-Cola to put the cocaine back in",
  "links": [],
  "isPinned": false,
  "isQuote": false,
  "isRetweet": false,
  "isReply": false,
  "likes": 4289224,
  "replies": 170050,
  "retweets": 594428,
  "quotes": 167104,
  "user": {
    "avatar": "https://pbs.twimg.com/profile_images/...",
    "username": "elonmusk",
    "userFullName": "Elon Musk",
    "description": "",
    "location": null,
    "website": null,
    "joinDate": "Tue Jun 02 20:12:29 +0000 2009",
    "verified": true,
    "totalLikes": 182734,
    "totalTweets": 89153,
    "totalFollowing": 1226,
    "totalFollowers": 229037864,
    "url": null,
    "userId": "44196397",
    "totalMediaCount": 4225
  },
  "media": [
    {
      "type": "photo",
      "url": "https://pbs.twimg.com/media/..."
    }
  ],
  "tweetUserId": "44196397"
}

Notes:

• If includeUserInfo is false, the user object is omitted from each item.
• Fields like location, website, and url may be null depending on the public profile.

FAQ

Is there a free trial for this actor?

Yes. The listing includes a free trial period of 120 minutes so you can evaluate the X tweets scraper without commitment. After the trial, pricing is flat at $19.99 per month as specified in the actor’s listing.

Do I need API keys to use it?

No. This Twitter scraper without API uses a headless session to collect public data, so you don’t need API authentication.

What inputs does it support?

You can enter profile URLs, usernames (with or without @), and keywords in startUrls. The actor will normalize entries and run either a profile timeline scrape or a keyword search scrape accordingly.

How many tweets can it scrape per input?

You can set maxTweets between 1 and 100. The actor enforces an upper cap of 100 items per input to keep runs efficient and stable.

Can it include or exclude replies?

Yes. Set withReplies to true to include replies, or false to exclude them from the output.

Does it extract follower lists?

No. It does not extract follower lists. However, the embedded user object includes follower and following counts, plus other profile metadata (bio, avatar, joinDate, totals).

Can I export results to CSV or Excel?

Yes. After the run completes, open the dataset and export to JSON, CSV, or Excel for analysis, dashboards, or CRM workflows.

Does it work with hashtags or search queries?

It supports keyword-based search scraping via startUrls. Provide topical keywords (e.g., “AI trends”) to collect recent posts matching that query.

Closing CTA / Final thoughts

Twitter X Tweets Profiles Scraper is built for fast, reliable extraction of public tweets and profile signals from X (Twitter). With smart proxy fallback, optional user enrichment, and dataset-first outputs, it’s a robust X user scraper tool for marketers, developers, analysts, and researchers. Export to CSV/JSON/Excel, connect to your analytics stack, or automate pipelines via the Apify platform. Start extracting smarter social insights today and turn timelines into actionable data.