Twitter X Profile Scraper — Scrape X (Twitter) Profiles, Tweets & Media Without an API Key

Extract tweets and complete profile information from any X (Twitter) account with advanced filters in 4 sec. This powerful scraper auto-detects what to collect—profiles, tweets, users, or lists—and delivers clean, structured data instantly. No API key, no login credentials, and no rate-limit headaches. Built by MikoLabs and hosted on Apify.

---

What Is Twitter X Profile Scraper?

Twitter X Profile Scraper is an ultra-fast, production-ready data extraction tool for X (formerly Twitter). It allows developers, researchers, marketers, and data teams to extract public profile metadata, tweets, threads, replies, media, and search queries at scale—without dealing with the restrictive and expensive official X API.

Whether you provide a single Twitter username (@elonmusk), a profile URL (https://x.com/apify), a search term, or a list, the Actor's smart engine auto-detects the target entity and returns fully structured JSON, CSV, or Excel data in under 4 seconds.

Explore live demos and advanced scraping tools:

• Apify Actor: Twitter X Profile Scraper on Apify
• Advanced Search Tool: MikoLabs Twitter Advanced Search
• API Alternative & Docs: TwitterAPI.xyz Scraper

---

⚡ Official X API vs. Twitter X Profile Scraper

The official X (Twitter) API charges $100 to $5,000+ per month, requires lengthy developer approval workflows, imposes stringent rate caps, and limits historical data retrieval. Twitter X Profile Scraper by MikoLabs offers an instant, cost-effective alternative.

Feature	Official X (Twitter) API	Twitter X Profile Scraper (MikoLabs)
Monthly Starting Cost	$100 / month (Basic) to $5,000 / month (Pro)	$0 to start ($5 free credit / month on Apify)
API Keys & Approval	Mandatory application and verification	None required (Instant extraction)
Account Credentials	Requires user tokens and OAuth	No login or cookies needed
Speed to First Result	Variable (rate limits, backoff waits)	~4 seconds per target
Target Auto-Detection	Manual endpoint configuration	Auto-detects profiles, tweets, users, or lists
Export Formats	Raw JSON only	JSON, CSV, Excel (XLSX), XML, RSS, HTML
Anti-Blocking System	Strict IP and query rate limits	Built-in proxy rotation & automatic retries
Historical & Virality Filters	Heavily restricted on lower tiers	Full support for date ranges, min likes/retweets

---

Key Features & Extracted Data

1. Smart Target Auto-Detection

Drop in any input format—the scraper automatically identifies what to collect:

• Single or multiple Twitter usernames (figma, @sama, apify)
• Profile URLs (https://x.com/username or https://twitter.com/username)
• Keyword search queries and hashtag filters
• User lists and curated timelines

2. Complete Profile Information

• Full name, handle (@username), and bio / description
• Follower count, following count, total tweets count, and likes count
• Profile creation / join date (joined)
• Verification badges (Blue, Gold, Government, Legacy)
• Avatar profile picture URL and header banner image URL
• Listed website URL and location text

3. Comprehensive Tweet Data

• Full tweet text (including extended un-truncated content)
• Tweet ID and direct URL (https://x.com/user/status/...)
• Precise UTC publication timestamps
• Engagement metrics: likes, retweets, replies, quote tweets
• Hashtags (#), user mentions (@), and external URLs (urls)
• Original author information for retweets and quoted tweets

4. Rich Media & Attachments

• High-resolution images and photos
• Embedded video URLs (MP4 streams and thumbnails)
• Animated GIFs and multimedia cards
• Optional NSFW / sensitive media extraction

5. Advanced Search & Virality Filtering

• Filter by date range: startDate and endDate (YYYY-MM-DD)
• Engagement thresholds: minimum likes (minLikes), retweets (minRetweets), or replies (minReplies)
• Media-only filter (mediaOnly) to capture visual content only
• Reply controls: include or isolate conversational threads

---

Top Use Cases for Scraping X (Twitter) Data

Industry / Application	How This Scraper Delivers Value
AI & LLM Training	Build high-quality datasets for conversational AI, fine-tuning LLMs, and social NLP sentiment models.
Competitive Intelligence	Track competitor product announcements, posting velocity, audience engagement spikes, and media strategies.
Financial & Market Sentiment	Monitor real-time ticker sentiment ($NVDA, $BTC, $ETH), executive announcements, and market-moving tweets.
Influencer Discovery & Creator Research	Identify micro-influencers and creators based on engagement ratios, follower milestones, and niche keywords.
Brand Reputation & Crisis Alerting	Detect viral customer complaints, product bugs, or PR crises in real time before they escalate.
B2B Lead Generation	Pinpoint founders, developers, and decision-makers actively discussing industry pain points and technology needs.
Academic & Sociological Research	Study public discourse, viral misinformation trends, political commentary, and communication patterns.

---

How to Scrape X (Twitter) — Step-by-Step Guide

Step 1: Open the Actor

Navigate to Twitter X Profile Scraper on Apify and click Try for free or Save as task.

Step 2: Configure Your Target Input

• Enter one or more Twitter handles in twitterHandles (e.g., ["elonmusk", "apify"]).
• Or paste full profile links into twitterUrls.
• Select your maximum items (maxItems) — set to 20 for quick tests or 0 for complete timeline extraction.

Step 3: Apply Filters (Optional)

• Set minLikes or minRetweets to surface viral posts only.
• Enable mediaOnly to scrape tweets with images or videos.
• Add startDate and endDate to constrain historical data collection.

Step 4: Run the Scraper

Click Start. The scraper completes extraction in approximately 4 seconds per profile.

Step 5: Export Your Clean Data

Open the Dataset tab in Apify Console and download your results in your preferred format: JSON, CSV, Excel (XLSX), XML, RSS, or HTML Table.

---

Input Parameters

Configure the scraper easily using the Apify Console visual UI or pass a JSON object via the REST API / Apify SDKs:

Parameter	Type	Default	Description
twitterHandles	array	["elonmusk"]	Usernames to extract (with or without @).
twitterUrls	array	[]	Direct profile URLs (e.g. https://x.com/elonmusk).
scrapeProfileInfo	boolean	true	Extract complete profile metadata (bio, followers, banner, etc.).
maxItems	integer	20	Max tweets to extract per profile (0 = unlimited).
includeReplies	boolean	false	Include reply posts in the timeline extraction.
includeRetweets	boolean	true	Include shared retweets in timeline results.
mediaOnly	boolean	false	Only extract posts containing photos, videos, or GIFs.
searchTerms	array	[]	Keywords or search queries to filter within tweets.
startDate	string	""	Filter tweets posted on or after this date (YYYY-MM-DD).
endDate	string	""	Filter tweets posted on or before this date (YYYY-MM-DD).
minLikes	integer	0	Minimum likes threshold (virality filter).
minRetweets	integer	0	Minimum retweets threshold.
minReplies	integer	0	Minimum comments/replies threshold.
location	string	""	Filter tweets by geographical location name.
nsfwContent	boolean	true	Enable extraction of sensitive or age-restricted media.
useResidentialProxy	boolean	true	Route through residential proxies for anti-blocking resilience.
proxyConfiguration	object	{"useApifyProxy": true}	Apify proxy configuration settings.

Example Input Payloads

Basic Profile & Tweet Scrape

{
  "twitterHandles": ["elonmusk", "apify"],
  "scrapeProfileInfo": true,
  "maxItems": 25,
  "includeReplies": false,
  "includeRetweets": true
}

Advanced Filtered Search (Viral Media Tweets)

{
  "twitterHandles": ["figma"],
  "searchTerms": ["AI", "update"],
  "startDate": "2024-01-01",
  "endDate": "2024-12-31",
  "minLikes": 50,
  "mediaOnly": true,
  "maxItems": 100,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

Output Data Format

The scraper returns clean, normalized datasets. Below are sample records for profile metadata and tweet objects.

Sample Profile Record

{
  "type": "profile",
  "username": "apify",
  "fullname": "Apify",
  "bio": "Web scraping and automation platform for data extraction. Automate anything on the web.",
  "followers": 15200,
  "following": 420,
  "tweets": 2340,
  "likes": 1280,
  "verified": true,
  "verified_type": "blue",
  "avatar": "https://pbs.twimg.com/profile_images/1789012345678901234/example_avatar.jpg",
  "banner": "https://pbs.twimg.com/profile_banners/123456789/example_banner.jpg",
  "website": "https://apify.com",
  "location": "San Francisco, CA & Prague, Czech Republic",
  "joined": "January 2015",
  "scrape_date": "2026-10-06T12:00:00.000Z"
}

Sample Tweet Record

{
  "type": "tweet",
  "tweet_id": "1845123456789012345",
  "url": "https://x.com/apify/status/1845123456789012345",
  "text": "Extract tweets and complete profile information from any X account in 4 sec with Twitter X Profile Scraper! #webscraping #automation",
  "username": "apify",
  "fullname": "Apify",
  "date": "2026-10-06T12:05:00.000Z",
  "likes": 320,
  "retweets": 85,
  "replies": 24,
  "quotes": 12,
  "hashtags": ["#webscraping", "#automation"],
  "mentions": ["@apify"],
  "urls": ["https://apify.com/mikolabs/twitter-x-profile-scraper"],
  "media": [
    {
      "type": "image",
      "url": "https://pbs.twimg.com/media/example_media_preview.jpg",
      "thumbnail": "https://pbs.twimg.com/media/example_media_thumb.jpg"
    }
  ],
  "is_retweet": false,
  "is_reply": false,
  "is_quoted": false,
  "author": {
    "username": "apify",
    "fullname": "Apify",
    "avatar": "https://pbs.twimg.com/profile_images/1789012345678901234/example_avatar.jpg",
    "verified": true
  },
  "scrape_date": "2026-10-06T12:05:30.000Z"
}

---

Data Field Reference

Profile Object Fields

Field Name	Type	Description
type	string	Always "profile".
username	string	User's handle (e.g. apify).
fullname	string	Display name of the user.
bio	string	Full profile bio description.
followers	integer	Count of followers.
following	integer	Count of accounts followed.
tweets	integer	Total number of tweets posted.
likes	integer	Number of likes given by the account.
verified	boolean	Account verification status.
avatar	string	Direct link to profile avatar image.
banner	string	Direct link to profile banner image.
website	string	External link provided in profile.
location	string	User-stated location.
joined	string	Account registration date.
scrape_date	string	ISO timestamp of when data was extracted.

Tweet Object Fields

Field Name	Type	Description
type	string	Record type ("tweet", "reply", etc.).
tweet_id	string	Unique Twitter post identifier.
url	string	Canonical URL to the post on X.com.
text	string	Full tweet text content.
username	string	Author's handle.
fullname	string	Author's display name.
date	string	Tweet publication timestamp.
likes	integer	Total like count.
retweets	integer	Total retweet count.
replies	integer	Total comment/reply count.
quotes	integer	Total quote tweet count.
hashtags	array	List of hashtags in the tweet.
mentions	array	List of tagged handles.
urls	array	List of external links referenced.
media	array	Attached media objects (images, videos, thumbnails).
is_retweet	boolean	Whether post is a retweet.
is_reply	boolean	Whether post is a conversation reply.
scrape_date	string	ISO timestamp of extraction.

---

Free vs. Paid Plan Capabilities

Feature	Free Tier	Paid / Subscribed Tier
Runs per Day	5 free runs per day	Unlimited runs
Items per Target	10 items per profile	Unlimited (set maxItems: 0)
Extraction Latency	~4 seconds per target	~4 seconds per target (High concurrency)
Proxy Routing	Direct & Auto-failover	Premium Residential (US/CA) + Worldwide
Concurrency	Standard	High Concurrency Multi-Worker
Data Delivery Guarantee	Community	Priority SLA & Dedicated Queue

[!NOTE] Every Apify account receives $5 in free monthly usage credits, allowing you to test hundreds of scrapes at zero cost. For large-scale data harvesting or continuous pipelines, upgrade to an Apify Paid Plan.

---

Tips for High-Efficiency Scraping

1. Verify with Low Limits First: Test your initial configuration with maxItems: 10 before running large batches.
2. Filter Out Noise: Use includeReplies: false to focus exclusively on original posts and threads.
3. Capture Virality: Set minLikes: 100 or minRetweets: 25 to isolate high-engagement posts for content analysis.
4. Target Visual Content: Enable mediaOnly: true when aggregating images, infographics, or video clips.
5. Pinpoint Time Windows: Always apply startDate and endDate when analyzing seasonal campaigns or historical events.
6. Parallel Extraction: Pass multiple usernames in twitterHandles—the engine processes targets concurrently for maximum throughput.

---

Python Quick Start

Extract Twitter / X data programmatically using the official Apify Python SDK:

from apify_client import ApifyClient

# 1. Initialize ApifyClient with your API token
client = ApifyClient("YOUR_APIFY_TOKEN")

# 2. Configure the Actor input
run_input = {
    "twitterHandles": ["elonmusk", "apify"],
    "maxItems": 20,
    "scrapeProfileInfo": True,
    "includeReplies": False,
    "proxyConfiguration": {
        "useApifyProxy": True,
        "apifyProxyGroups": ["RESIDENTIAL"]
    }
}

# 3. Call the Actor and wait for completion (~4 sec per target)
run = client.actor("mikolabs/twitter-x-profile-scraper").call(run_input=run_input)

# 4. Fetch and print the extracted dataset items
dataset_url = f"https://console.apify.com/storage/datasets/{run['defaultDatasetId']}"
print(f"Dataset ready at: {dataset_url}\n")

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    if item.get("type") == "profile":
        print(f"[PROFILE] @{item['username']} - {item['followers']} followers")
    else:
        print(f"[TWEET] @{item['username']}: {item['text'][:80]}... ({item.get('likes', 0)} likes)")

---

Node.js / JavaScript Quick Start

import { ApifyClient } from 'apify-client';

// Initialize the Apify client
const client = new ApifyClient({
    token: 'YOUR_APIFY_TOKEN',
});

// Define input
const input = {
    twitterHandles: ['figma'],
    maxItems: 30,
    mediaOnly: false,
};

// Start the Actor and wait for results
const run = await client.actor('mikolabs/twitter-x-profile-scraper').call(input);

// Fetch items from the dataset
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Extracted ${items.length} records!`);
console.log(items.slice(0, 3));

---

Automation & Integrations

Twitter X Profile Scraper connects with any workflow, database, or analytics platform:

• No-Code Automation: Integrate with Make (Integromat), Zapier, and n8n.
• Databases & Sheets: Sync directly into Google Sheets, Airtable, Notion, Snowflake, BigQuery, or Amazon S3.
• Real-Time Webhooks: Set up Apify Webhooks to notify your backend API as soon as a scraper run completes.
• REST API: Fetch data via standard HTTP requests (GET https://api.apify.com/v2/datasets/.../items).

---

Frequently Asked Questions (FAQ)

Can I scrape Twitter / X without an API key?

Yes. Twitter X Profile Scraper requires zero API keys, zero Twitter developer account approvals, and zero user logins. Everything is handled automatically.

How fast is this scraper?

The engine is optimized for high velocity, returning profiles and recent tweets in approximately 4 seconds per target.

Does the scraper auto-detect what to collect?

Yes. You can provide Twitter handles, complete profile URLs (https://x.com/... or https://twitter.com/...), search keywords, or lists. The scraper automatically detects the entity type and executes the optimal extraction pipeline.

Can I export tweets directly to Excel or CSV?

Yes. Once your run finishes, you can export your data in Excel (XLSX), CSV, JSON, XML, RSS, or HTML Table directly from the Apify Console Dataset tab.

Can I scrape private or protected Twitter profiles?

No. In compliance with data privacy standards and technical constraints, only publicly visible profiles and tweets can be extracted.

Is web scraping legal?

Yes. Scraping publicly available internet data is legal under established legal precedents (e.g., hiQ Labs v. LinkedIn). Always adhere to privacy standards such as GDPR and CCPA when handling personal data. For more details, consult Apify's Legal Guide to Web Scraping.

Can I perform Twitter Advanced Searches?

Yes. You can supply search terms, hashtags, and date ranges in the input parameters. You can also explore MikoLabs Twitter Advanced Search for dedicated keyword query tools.

---

Related Scrapers & Resources

• Apify Actor Page: Twitter X Profile Scraper on Apify
• Advanced Search Web App: MikoLabs Twitter Advanced Search
• API Alternative & Reference: TwitterAPI.xyz Scraper
• Official Developer Documentation: Apify Documentation

---

Support & Custom Solutions

Need custom integrations, dedicated high-volume proxies, or enterprise data feeds?

• Leave a Review: ⭐ If you find this scraper helpful, please leave us a 5-star rating on the Apify Reviews Page!
• Issues & Feedback: Submit feedback via the Issues tab on the Apify Actor page.
• Enterprise Solutions: Visit MikoLabs for custom web scraping and data pipeline engineering.

---

Engineered and maintained by MikoLabs — Fast, scalable data extraction tools.