Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper

Twitter X Tweets Profiles Scraper is an Apify-powered X.com scraper that extracts public tweets and profile metadata at scale — a reliable X tweets scraper and Twitter profile scraper for marketers, developers, data analysts, and researchers. It solves the “Twitter API alternative scraper” problem by collecting tweet text, engagement metrics, media, and user info from public sources without API keys. Use it to scrape Twitter profiles and tweets for social listening, competitor research, and lead generation with consistent, structured outputs ready for CSV/JSON exports.

What data / output can you get?

Below are the real fields this Twitter tweet extractor pushes to the dataset. You can export the data to JSON, CSV, or Excel from Apify.

Data type	Description	Example value
id	Unique tweet ID (string)	"1519480761749016577"
url	Canonical tweet URL	"https://x.com/elonmusk/status/1519480761749016577"
verified	Whether the tweet author is verified	true
username	Screen name with @ prefix	"@elonmusk"
fullname	Author’s display name	"Elon Musk"
timestamp	Tweet creation time (UTC string)	"Thu Apr 28 00:56:58 +0000 2022"
text	Full tweet text content	"Next I'm buying Coca-Cola to put the cocaine back in"
links	URLs extracted from entities/cards/media	[]
isPinned	Whether the tweet is pinned on profile	false
isQuote	Whether the tweet is a quote tweet	false
isRetweet	Whether the tweet is a retweet	false
isReply	Whether the tweet is a reply	false
likes	Favorite/like count	4289224
replies	Reply count	170050
retweets	Retweet count	594428
quotes	Quote count	167104
media	Array of media objects with type and best URL	[{ "type": "photo", "url": "https://pbs.twimg.com/media/..." }]
tweetUserId	Author’s numeric user ID (string)	"44196397"
user.avatar	Profile image URL	"https://pbs.twimg.com/profile_images/..."
user.username	Screen name (without @)	"elonmusk"
user.userFullName	Display name	"Elon Musk"
user.description	Profile bio	""
user.location	Profile location if public	null
user.website	Expanded website URL from profile	null
user.joinDate	Account creation time (UTC string)	"Tue Jun 02 20:12:29 +0000 2009"
user.verified	Whether the account is verified	true
user.totalLikes	Total likes (favourites_count)	182734
user.totalTweets	Total tweets (statuses_count)	89153
user.totalFollowing	Following count	1226
user.totalFollowers	Followers count	229037864
user.url	Shortened URL shown on profile	null
user.userId	Author’s rest_id	"44196397"
user.totalMediaCount	Media count	4225

Note:

• If includeUserInfo is false, the user object will be omitted from each item.
• Some fields can be null when not present publicly (e.g., user.location, user.website, user.url).
• Apify makes it easy to export Twitter tweets to CSV, JSON, or Excel for downstream analysis.

Key features

• 🛡️ Robust proxy fallback Automatically attempts datacenter proxies and falls back to residential proxies when requests are blocked, ensuring high reliability for your Twitter data scraping tool.

• 🧩 Multi-mode input Accepts profile URLs, @usernames, numeric IDs, and keyword search terms — perfect for both a Twitter profile scraper and Twitter search results scraper workflows.

• 🎛️ Configurable depth & filters Control maximum tweets per input (1–100) and include or exclude replies to match your social listening or analysis goals.

• 👤 Optional user enrichment Toggle includeUserInfo to attach a rich user object (bios, join date, follower counts, website, media count) to each tweet, or exclude it for leaner exports.

• 🧭 Real browser session for fresh data Uses Playwright with Chromium to capture live GraphQL responses from X.com, delivering a dependable Twitter web scraping without API experience.

• 💾 Flexible data export Download datasets in JSON, CSV, or Excel from Apify — ready for BI tools, CRMs, or custom pipelines.

• ☁️ Cloud-native automation Schedule runs, chain tasks, and integrate via the Apify API for production-ready X.com scraper workflows.

• 👨‍💻 Developer-friendly Trigger runs and fetch datasets programmatically through the Apify API — ideal for Python Twitter scraper for profiles and tweets pipelines.

How to use Twitter X Tweets Profiles Scraper - step by step

1. Sign in to Apify Create a free Apify account or log in to access the actor.

2. Open the actor Find “Twitter X Tweets Profiles Scraper” in the Apify Store and open the actor page.

3. Add input data Paste targets into startUrls. You can use:

• Profile URLs: https://x.com/username
• Usernames: username or @username
• Keyword searches: e.g., "AI trends" or "crypto news"

4. Configure options

• maxTweets: Set the number of tweets to collect per input (1–100).
• withReplies: Include reply tweets in results (true/false).
• includeUserInfo: Attach the detailed user object (true/false).
• sortOrder: Choose "newest", "oldest", or "popular".
• proxyConfiguration: Toggle useApifyProxy or keep direct connection.

5. Run the actor Click Start. The scraper launches a headless browser session, navigates X.com, and streams results to the dataset.

6. Monitor progress Check the run console for logs about session setup, proxy usage, and processed inputs.

7. Export your data Open the run’s Dataset and export to JSON, CSV, or Excel for analysis or integration.

Pro Tip: Use the Apify API to automate runs, pull datasets into your data warehouse, or orchestrate an X tweets scraper pipeline alongside other marketing intelligence tools.

Use cases

Use case	Description
Social media analytics for brands	Track competitor and influencer posts, analyze engagement rates, and benchmark performance with a Twitter data scraping tool.
Topic & trend research	Extract recent posts matching keyword queries to power dashboards for market intelligence with a Twitter tweet extractor.
Audience & profile insights	Enrich records with user follower counts, join dates, and bios via a streamlined Twitter user data extractor.
Journalism & timelines	Reconstruct chronological activity for sources and events with a dependable X tweets scraper.
Lead generation & outreach	Identify prospects using bios and profile metadata, then export to CSV for CRM workflows.
Academic research	Build reproducible datasets for NLP and social-behavior studies from an X.com scraper without API keys.
Developer data pipelines	Run scheduled extractions and fetch results programmatically for Python-based processing and analytics.

Why choose Twitter X Tweets Profiles Scraper?

This actor is built for precision at scale: production-ready infrastructure, structured outputs, and automation-friendly design.

• ⚡ Fast and scalable: Cloud execution handles multiple inputs and returns up to 100 tweets per target per run.
• 🧱 Structured & analytics-ready: Consistent fields that are ideal for BI, NLP, and dashboarding.
• 🔒 No API keys required: A practical Twitter API alternative scraper for public data collection.
• 🤝 Developer access: Automate via Apify’s REST API in Python or any language.
• 🛡️ Safer operations: Focused on publicly available content; no private or login-gated data.
• 💸 Cost-effective: Start with trial minutes, then scale as your workload grows.
• 🧰 More reliable than extensions: Avoid unstable browser plugins with a rigorous, Playwright-powered backend and smart proxy fallback.

In short: a stable, cloud-native Twitter web scraping without API solution that outperforms brittle DIY approaches.

Is it legal / ethical to use Twitter X Tweets Profiles Scraper?

Yes — when used responsibly. This actor collects only publicly available information from X (Twitter) and does not access private accounts, protected content, or login-only pages.

Guidelines:

• Comply with Twitter/X Terms of Service.
• Respect data protection laws (e.g., GDPR, CCPA).
• Use results ethically and for legitimate purposes (research, analytics, monitoring).
• Consult your legal team for edge cases or regulated use.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://x.com/username",
    "username",
    "search keyword"
  ],
  "maxTweets": 10,
  "withReplies": true,
  "includeUserInfo": true,
  "sortOrder": "newest",
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Input parameter details:

• startUrls (array, required): List of Twitter/X profile URLs (e.g., https://x.com/username), usernames (e.g., username or @username), or search keywords. Default: None. Prefill examples: ["https://x.com/elonmusk", "mrbeast"].
• sortOrder (string, optional): How to sort the tweets. Allowed values: "newest", "oldest", "popular". Default: "newest".
• maxTweets (integer, optional): Maximum number of tweets to scrape per profile/keyword (1–100). Default: 10.
• withReplies (boolean, optional): Include reply tweets in the results. Default: true.
• includeUserInfo (boolean, optional): Include detailed user profile information with each tweet. Default: true.
• proxyConfiguration (object, optional): Proxy settings. Actor will automatically fallback to datacenter then residential proxy if requests are blocked. Default prefill: { "useApifyProxy": false }.

Notes:

• If includeUserInfo is false, the user object will be excluded from each dataset item.
• The actor processes each item in startUrls and caps output to maxTweets (up to 100) per input.

Example JSON output

{
  "id": "1519480761749016577",
  "url": "https://x.com/elonmusk/status/1519480761749016577",
  "verified": true,
  "username": "@elonmusk",
  "fullname": "Elon Musk",
  "timestamp": "Thu Apr 28 00:56:58 +0000 2022",
  "text": "Next I'm buying Coca-Cola to put the cocaine back in",
  "links": [],
  "isPinned": false,
  "isQuote": false,
  "isRetweet": false,
  "isReply": false,
  "likes": 4289224,
  "replies": 170050,
  "retweets": 594428,
  "quotes": 167104,
  "user": {
    "avatar": "https://pbs.twimg.com/profile_images/...",
    "username": "elonmusk",
    "userFullName": "Elon Musk",
    "description": "",
    "location": null,
    "website": null,
    "joinDate": "Tue Jun 02 20:12:29 +0000 2009",
    "verified": true,
    "totalLikes": 182734,
    "totalTweets": 89153,
    "totalFollowing": 1226,
    "totalFollowers": 229037864,
    "url": null,
    "userId": "44196397",
    "totalMediaCount": 4225
  },
  "media": [
    {
      "type": "photo",
      "url": "https://pbs.twimg.com/media/..."
    }
  ],
  "tweetUserId": "44196397"
}

FAQ

Is the Twitter X Tweets Profiles Scraper free?

Yes. You can start on Apify with trial minutes to test the actor for small projects before upgrading for larger workloads.

Do I need API keys or login?

No. This is a Twitter API alternative scraper that works without API keys or account login, focusing on publicly available data.

Can it scrape followers?

It captures follower metrics in the user object (e.g., user.totalFollowers). It does not fetch full follower lists.

How many tweets can it extract per target?

Up to maxTweets per input (1–100). Internally, the actor caps output to a maximum of 100 tweets per profile/keyword per run input.

Can it scrape keywords or search results?

Yes. Provide a search term in startUrls and the actor will return matching tweets from the Twitter search results scraper flow.

What data fields are returned?

See the Output Format section for the complete schema, including id, text, engagement counts, media, links, and the detailed user object.

Does it support proxies?

Yes. It supports Apify Proxy and automatically falls back from datacenter to residential proxies if requests are blocked.

Can developers integrate it into Python or data pipelines?

Yes. Trigger runs and fetch datasets via the Apify API — ideal for Python Twitter scraper for profiles and tweets workflows.

Final thoughts

Twitter X Tweets Profiles Scraper is built to extract tweets and structured profile insights at scale — reliably and without API keys. With robust proxy fallback, configurable depth, and export-ready datasets, it serves marketers, developers, analysts, and researchers who need a dependable X.com scraper. Use the Apify API to automate runs, export Twitter tweets to CSV/JSON, and plug results into your analytics or CRM stack. Start extracting smarter social insights with a production-ready Twitter profile scraper and X tweets scraper today.