🐦 X/Twitter Public Data Scraper

Scrape public tweet data and user profiles from X (Twitter) without any login or authentication. No cookies, no API keys, no Bearer tokens needed.

✨ Features

• Tweet Lookup Mode: Get full tweet details including text, engagement metrics (likes, retweets, replies, quotes, views), media URLs, author info, and more
• Profile Overview Mode: Fetch the most recent tweets from any public user profile
• No Login Required: Uses publicly accessible APIs — no Twitter/X account needed
• Datacenter Friendly: Works from any IP address, including cloud and datacenter IPs
• Batch Processing: Process multiple tweets or profiles in a single run

🔧 How It Works

Tweet Lookup Mode

Uses the FXTwitter API to fetch detailed tweet data. This community-maintained API provides rich tweet information including full engagement metrics.

Input: List of tweet URLs (x.com or twitter.com) or raw tweet IDs Output: Full tweet details with engagement counts, media, author info

Profile Overview Mode

Uses Twitter's Syndication API to fetch recent tweets from a user's timeline. This endpoint returns the ~12 most recent tweets from a public profile.

Input: List of profile URLs or usernames Output: Recent tweets from each profile (note: engagement metrics are not available in this mode)

📋 How to Use

1. Select a mode: Choose "Tweet Lookup" or "Profile Overview"
2. Provide input:
   • For Tweet Lookup: Add tweet URLs like https://x.com/user/status/123456
   • For Profile Overview: Add profile URLs like https://x.com/username or just the username
3. Run the Actor and download results from the dataset

📊 Sample Output

Tweet Lookup Mode

{
    "tweet_id": "1897366028841664967",
    "url": "https://x.com/elonmusk/status/1897366028841664967",
    "text": "Example tweet text...",
    "created_at": "Thu Mar 06 02:15:00 +0000 2025",
    "likes": 125000,
    "retweets": 18500,
    "replies": 9200,
    "quotes": 3100,
    "views": 45000000,
    "language": "en",
    "author_name": "Elon Musk",
    "author_screen_name": "elonmusk",
    "author_avatar": "https://pbs.twimg.com/profile_images/...",
    "author_followers": 210000000,
    "media_type": "photo",
    "media_urls": ["https://pbs.twimg.com/media/..."],
    "fetched_at": "2025-03-23T12:00:00Z"
}

Profile Overview Mode

{
    "tweet_id": "1897366028841664967",
    "url": "https://x.com/elonmusk/status/1897366028841664967",
    "text": "Recent tweet text...",
    "created_at": "Thu Mar 06 02:15:00 +0000 2025",
    "likes": null,
    "retweets": null,
    "author_name": "Elon Musk",
    "author_screen_name": "elonmusk",
    "media_type": null,
    "media_urls": [],
    "source": "syndication",
    "fetched_at": "2025-03-23T12:00:00Z"
}

⚠️ Notes

• Tweet Lookup: ~87-95% success rate per tweet. Some tweets may fail due to rate limits or availability.
• Profile Overview: Returns approximately 12 most recent tweets per profile. Engagement metrics (likes, retweets, etc.) are not available in this mode — only tweet text, media, and author info.
• Rate Limits: Built-in retry logic with automatic backoff. For large batches, the Actor adds small delays between requests.
• Public Profiles Only: Private/protected accounts cannot be scraped.
• No Authentication: This Actor does not use any Twitter/X login credentials. It only accesses publicly available data through unauthenticated endpoints.

💡 Use Cases

• Monitor specific tweets for engagement tracking
• Collect recent posts from public accounts
• Build datasets of tweet content and metadata
• Track media attachments (photos, videos) from tweets
• Research public Twitter/X content without API access