Twitter X.com User Search Scraper - Fast and Efficient User Extraction

This Actor provides a powerful and specific way to scrape user data from Twitter (now X). It allows you to reliably extract detailed user profiles utilizing search queries, making it ideal for researchers, analysts, and social media tracking.

Key Features

• Focused Input Methods: Get straightforward, exact data from user queries:

  • Search Terms: Provide target search terms (e.g. "elonmusk", "apify") to extract matching users.

• Targeted Output:

  • Maximum Items: Control the maximum number of user profiles retrieved for each query.
  • Custom Map Function: Transform and shape the output data using a custom JavaScript function before it is saved (for data shaping, not filtering).

• Built-in Concurrency & Pagination:

  • Efficiently crawls and paginates through search results for quick and stable extraction, utilizing Apify actors' concurrent network architecture.

• Cost-Effective & Event-Driven:

  • Charge for Event.

Use Cases

• Market & Influencer Research: Discover profiles relevant to specific topics or keywords.
• Academic Research: Gather user-centric data for social media and political science studies.
• Competitive Analysis: Monitor targeted competitors' digital footprints.
• Data Archival: Regularly save out the profile metrics for designated entities for record keeping.

Quick Start Examples

Here are some example input configurations to get you started:

Fetching Users based on Search Terms:

{
    "searchTerms": [
        "elonmusk",
        "apify"
    ],
    "maxItems": 50
}

Fetching Users and Mapping Output Fields:

{
    "searchTerms": [
        "elonmusk"
    ],
    "maxItems": 10,
    "customMapFunction": "(user) => { return { id: user.id, name: user.name, followers: user.followers_count, url: user.url } }"
}

Explanation of Key Input Fields

• searchTerms: An array of explicit text queries you want to search.
• maxItems: An integer limiting the maximum number of paginated output user profiles for each target.
• customMapFunction: Execute raw javascript logic to mutate or adjust the parsed user object right before it is pushed to the Actor storage. Caution: improper functions may break output data shape.

Output Example

{
    "id": "472460718",
    "url": "https://x.com/elonmusk_9714",
    "twitterUrl": "https://twitter.com/elonmusk_9714",
    "name": "ELON R.M",
    "screen_name": "elonmusk_9714",
    "description": "",
    "followers_count": 105,
    "normal_followers_count": 105,
    "fast_followers_count": 0,
    "friends_count": 0,
    "favourites_count": 15986,
    "statuses_count": 60284,
    "media_count": 1328,
    "location": "Texas, USA",
    "created_at": "Mon Jan 23 23:51:42 +0000 2012",
    "advertiser_account_service_levels": [
        "analytics"
    ],
    "advertiser_account_type": "promotable_user",
    "analytics_type": "enabled",
    "blocked_by": false,
    "blocking": false,
    "can_dm": false,
    "can_media_tag": false,
    "entities": {
        "description": {
            "hashtags": [],
            "symbols": [],
            "urls": [],
            "user_mentions": []
        }
    },
    "follow_request_sent": false,
    "followed_by": false,
    "following": false,
    "geo_enabled": true,
    "has_custom_timelines": true,
    "has_extended_profile": true,
    "id_str": "472460718",
    "is_translator": false,
    "muting": false,
    "notifications": false,
    "pinned_tweet_ids_str": [
        "1847958242489672135"
    ],
    "profile_background_color": "000000",
    "profile_banner_url": "https://pbs.twimg.com/profile_banners/472460718/1760038286",
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/1976369939058434048/I2HjvguS_normal.jpg",
    "profile_interstitial_type": "",
    "profile_link_color": "E81C4F",
    "profile_location_place": {
        "country": "",
        "country_code": "",
        "full_name": "Texas, USA",
        "id": "e0060cda70f5f341",
        "name": "Texas, USA",
        "place_type": "unknown"
    },
    "protected": false,
    "translator_type_enum": "None",
    "verified": false,
    "want_retweets": false,
    "withheld_in_countries": []
}

Usage Guidelines (Important!)

• Data Limits: Ensure you understand the event limit configuration of the actor as it runs in pay-per-result (or similar) mode.
• Respect Twitter's Terms of Service: Always use this tool ethically and responsibly.
• Concurrent Batches: If passing many terms, the Actor natively parallelizes requests. Make sure memory settings can accommodate heavy payload iterations.

Ethical Use and Data Practices

Our 'actor' operates without logging in to X.com. This means it does not implicitly accept any Terms of Service (ToS) that require a login, as we only process data that is publicly displayed and accessible to everyone without authentication.

We are fully committed to the principle of privacy by design and by default. All data collected explicitly excludes sensitive personal information or non-public data.

Furthermore, our actor runs on Apify, an EU-based company, which means our operations are designed to be compliant with relevant EU data protection regulations, including GDPR, where applicable. You can find more information about the legality of web scraping on Apify's blog: https://blog.apify.com/is-web-scraping-legal/

We have implemented robust technical measures to ensure the actor operates gently and does not impose an undue burden on X.com's servers. Our sole purpose is to facilitate responsible research and public data analysis, and we strictly prohibit any use that could cause harm to any party or the platform itself.

Troubleshooting

If you encounter issues like early termination, check if your Apify workspace event allocation limits were breached.

Get Started

For other TikTok data needs, explore these related APIs:

1. TikTok Actors

⚡ Fast TikTok API (No WM)	👤 Tiktok User Profile API	🔍 Advanced Search TikTok
🔎 TikTok Search Scraper	📈 Tiktok Trend API	💬 TikTok Comment API
🎞️ TikTok Profile Videos API	#️⃣ TikTok Hashtag API	🎵 TikTok Sound Music API
👥 TikTok Followers API	🔢 Multiple Hashtags Scraper	🏆 TikTok Scraper Ultimate
🎶 TikTok Music Trend API	🛍️ TikTok Shop Scraper	💰 TikTok Scraper (Pay per video)
📄 Fast TikTok API (Simple)	🆔 TikTok User Profile Scraper	📍 TikTok Location API
🤖 TikTok AI Video Scraper	🗯️ TikTok Comment (Novi)	🏷️ TikTok Scraper (Fixed price)
🗣️ TikTok Comment + Replies

2. X.com (Twitter) Actors

🐦 X.com Twitter API Scraper	🐦 X.com Twitter User Tweets Scraper	🐦 X.com Twitter User Tweets Scraper

3. YouTube Actors

📜 YouTube Transcript API