X (Twitter) Profile Scraper

Extract every public tweet from any X (Twitter) profile — full text, engagement metrics, media, and author details — and export the results as JSON, CSV, or Excel. Just enter a handle or profile URL and run.

What It Does

This actor scrapes the tweet history of any public X/Twitter profile. Give it a username (or a full profile URL) and it pulls tweets in reverse-chronological order, going far beyond the ~3,200-tweet limit most tools hit by using deep-history pagination to reach much further back into a profile's timeline.

Key Features

• Deep tweet history — collects well beyond Twitter's standard ~1,000–3,200 tweet profile cap
• Media tweets included — photos, videos, and GIFs are picked up even when they don't appear on the main timeline
• Replies filtering — choose to include or exclude reply tweets
• Bulk profile scraping — scrape dozens or hundreds of profiles in a single run
• Resumable runs — long scrapes checkpoint progress and can resume after a restart
• Structured, ready-to-use output — clean JSON with engagement stats, hashtags, links, and mentions already parsed out

Input Parameters

Field	Description
Twitter/X Handles	List of usernames to scrape (with or without @), e.g. elonmusk, @nasa
Profile URLs	Direct profile URLs to scrape instead of/alongside handles, e.g. https://x.com/elonmusk
Max Tweets per Profile	Maximum number of tweets to collect per profile (default: 100)
Include Replies	Also collect tweets that are replies, not just original posts (default: off)
Max Total Items	Optional hard cap on total items pushed across all profiles in the run
Search Fallback Mode	Controls how the actor digs past the standard profile wall for older tweets — recommended default works well out of the box
Enable Sub-Tabs Fallback	Also checks a profile's Media and Replies tabs to surface tweets missed on the main timeline (recommended, on by default)
Debug Logging	Turn on for detailed diagnostic logs (off by default)

Output Fields

Each scraped tweet includes:

• id — tweet ID
• url — direct link to the tweet
• text — full tweet text
• createdAt — publish date/time
• author — user object (username, display name, bio, followers, verified status, profile picture, etc.)
• likeCount, retweetCount, replyCount, quoteCount, viewCount, bookmarkCount — engagement metrics
• media — attached photos/videos with direct URLs
• hashtags, mentions, urls — extracted from the tweet text
• isRetweet, isReply, isQuote — tweet type flags
• quotedTweet — full details of a quoted tweet, if any
• lang — detected language
• source — app used to post (e.g. "Twitter for iPhone")

Pricing

This actor uses pay-per-result pricing — you're charged only for the tweets and profile records actually delivered to your dataset. No charge for failed or skipped profiles.

Example Use Cases

• Social media monitoring — track a competitor's or influencer's posting activity over time
• Market & brand research — analyze what a company or public figure says about your industry
• Content archiving — back up a profile's full tweet history
• Academic & data research — build datasets of public discourse on a topic or account
• Lead generation — identify engaged followers and frequent posters in a niche