Twitter Advanced X Scraper (Apify Actor)

Collect structured Twitter (X) data from 12 powerful endpoints in one flexible actor. Ideal for social listening, research, content discovery, growth analytics, and reporting. ⚡

• Clean, structured dataset output
• Built-in retries, key rotation, and global rate limiting
• Single request or batch mode in one run

---

Table of Contents

• Features
• Supported Endpoints
• Endpoints — Simple Guide
• Quick Start
• Input Parameters
• Input Configuration
• Output Data
• Use Cases
• Best Practices
• FAQ
• Related Actors
• Keywords

---

✨ Features

✅ 12 Powerful Endpoints - Access multiple Twitter/X data sources
✅ User Affiliates - Extract verified organizations and affiliations
✅ Trending Topics - Get real-time trends from 40+ countries
✅ Tweet Threads - Scrape complete tweet threads with all replies
✅ Community Data - Access Twitter communities and their timelines
✅ Job Listings - Search for job postings on Twitter
✅ Twitter Spaces - Get detailed information about live and recorded Spaces
✅ List Management - Extract data from Twitter lists (followers, members, timeline)
✅ Pagination Support - Retrieve large datasets with cursor-based pagination
✅ Fast & Reliable - Built on Apify platform for scalable data extraction
✅ Easy Integration - Simple API with comprehensive documentation

Supported Endpoints

Endpoint	Description	Required Input	Output Type
👥 Affiliates	Get user affiliates and verified organizations	Username	User profiles
📈 Trends	Get trending topics by country	Country	Trending topics
🧵 Tweet Thread	Get complete tweet thread with replies	Tweet ID	Tweet + replies
💬 Latest Replies	Get latest replies to a tweet	Tweet ID	Reply tweets
📜 List Timeline	Get tweets from a Twitter list	List ID	Tweet timeline
💼 Jobs	Search for job postings	Search query	Job listings
🔍 Search Communities Latest	Search latest posts in communities	Search query	Community posts
🔍 Search Communities	Search for communities	Search query	Communities
👥 Community Timeline	Get timeline from a community	Community ID	Community posts
👥 List Followers	Get followers of a Twitter list	List ID	User profiles
👥 List Members	Get members of a Twitter list	List ID	User profiles
🎙️ Spaces	Get Twitter Space information	Space ID	Space details

Endpoints — Simple Guide

Below, all 12 endpoints are explained in simple, straightforward terms. Each point includes the required and optional parameters.

• affiliates

  • What it does: Returns a list of affiliates for the given screenname.
  • Required: screenname
  • Optional: cursor

• trends

  • What it does: It provides the trending topics for a country.
  • Required: country
  • Optional: —

• tweet_thread

  • What it does: Retrieves the entire thread of a tweet.
  • Required: id (tweet ID)
  • Optional: cursor

• latest_replies

  • What it does: Retrieves the most recent replies to a tweet.
  • Required: id (tweet ID)
  • Optional: cursor

• listtimeline

  • What it does: Retrieves the timeline (posts) of a Twitter list.
  • Required: list_id
  • Optional: cursor

• jobs

  • Twitter displays job search results.
  • Required: query
  • Optional: —

• search_communities_latest

  • The latest posts from communities that match your query.
  • Required: query
  • Optional: cursor

• search_communities

  • It searches for communities by keywords/names.
  • Required: query
  • Optional: cursor

• community_timeline

  • This shows the timeline of a community. You can choose between top or latest posts from the 'Ranking' option.
  • Required: community_id
  • Optional: cursor, ranking (values: Top | Latest)

• list_followers

  • Provides a list of users who follow the given list.
  • Required: list_id
  • Optional: cursor

• list_members

  • Provides a list of the members in the given list.
  • Required: list_id
  • Optional: cursor

• spaces

  • Retrieves the details of a space.
  • Required: id (space ID)
  • Optional: —

Quick Start 🚀

1. Open this actor on Apify and click Run.
2. Choose an endpoint and fill required parameters.
3. Optionally, add multiple jobs in requests (batch mode).
4. Start the run and download results from the default Dataset (JSON/CSV/Excel/Parquet).

Input Parameters 🧰

The actor supports single-request mode and batch mode. In the UI, fields are grouped with section captions for clarity.

Field	Type	Required	Description
endpoint	string	No (required in single mode)	One of the supported endpoints listed above.
screenname	string	Conditional	For affiliates.
id	string	Conditional	For tweet_thread, latest_replies, spaces.
list_id	string	Conditional	For listtimeline, list_followers, list_members.
community_id	string	Conditional	For community_timeline.
query	string	Conditional	For jobs, search_communities, search_communities_latest.
ranking	enum	Optional	Top or Latest for community_timeline.
country	enum	Conditional	For trends.
cursor	string	Optional	For paginated endpoints to continue from a position.
requests	array	Optional	Batch mode: list of objects { endpoint, params }.
RATE_LIMIT_PER_HOUR	integer	Optional	Global rate limit; default 1200.

📊 Input Configuration

Endpoint-Specific Fields

👥 Affiliates Endpoint

{
  "endpoint": "affiliates",
  "screenname": "elonmusk",
  "cursor": "optional-cursor-for-pagination"
}

📈 Trends Endpoint

{
  "endpoint": "trends",
  "country": "UnitedStates"
}

🧵 Tweet Thread Endpoint

{
  "endpoint": "tweet_thread",
  "tweetId": "1738106896777699464",
  "cursor": "optional-cursor-for-pagination"
}

💬 Latest Replies Endpoint

{
  "endpoint": "latest_replies",
  "tweetId": "960249348624797696",
  "cursor": "optional-cursor-for-pagination"
}

📜 List Timeline Endpoint

{
  "endpoint": "list_timeline",
  "listId": "1343798673386434560",
  "cursor": "optional-cursor-for-pagination"
}

💼 Jobs Endpoint

{
  "endpoint": "jobs",
  "query": "Data scientist"
}

🔍 Search Communities Latest Endpoint

{
  "endpoint": "search_communities_latest",
  "query": "technology",
  "cursor": "optional-cursor-for-pagination"
}

🔍 Search Communities Endpoint

{
  "endpoint": "search_communities",
  "query": "NASA",
  "cursor": "optional-cursor-for-pagination"
}

👥 Community Timeline Endpoint

{
  "endpoint": "community_timeline",
  "communityId": "1783950561068339371",
  "ranking": "Top",
  "cursor": "optional-cursor-for-pagination"
}

👥 List Followers Endpoint

{
  "endpoint": "list_followers",
  "listId": "1177128103228989440",
  "cursor": "optional-cursor-for-pagination"
}

👥 List Members Endpoint

{
  "endpoint": "list_members",
  "listId": "1177128103228989440",
  "cursor": "optional-cursor-for-pagination"
}

🎙️ Spaces Endpoint

{
  "endpoint": "spaces",
  "spaceId": "1yoJMwpbmaXKQ"
}

---

💾 Output Data

Data Format

All data is returned in JSON format and stored in the Apify dataset. Each result includes:

{
  "endpoint": "endpoint-name",
  "data": {
    // Endpoint-specific data structure
  }
}

Sample Outputs

Affiliates Output

{
  "endpoint": "affiliates",
  "data": {
    "affilates": [
      {
        "user_id": "44196397",
        "screen_name": "elonmusk",
        "name": "Elon Musk",
        "description": "",
        "followers_count": 228708818,
        "friends_count": 1223
      }
    ],
    "next_cursor": "cursor-string"
  }
}

Trends Output

{
  "endpoint": "trends",
  "data": {
    "trends": [
      {
        "name": "Cowboys",
        "description": null,
        "context": "NFL · Trending"
      }
    ]
  }
}

Jobs Output

{
  "endpoint": "jobs",
  "data": {
    "jobs": [
      {
        "id": "unique-job-id",
        "title": "Data Scientist",
        "company_name": "OpenAI",
        "location": "San Francisco, California",
        "salary_min": 255000,
        "salary_max": 405000,
        "salary_currency": "USD"
      }
    ]
  }
}

---

📖 Use Cases

The actor pushes one or more dataset items depending on the endpoint:

• For array-like responses (e.g., timeline, followers, members, jobs, affiliates, communities), items are pushed individually with a small meta object that may include cursors.
• For single-object responses, the actor pushes a single item containing data and optional meta.

Best Practices ✅

• Use the correct combination of parameters for the selected endpoint.
• Use cursor to paginate where provided; the output includes meta.next_cursor when available.
• If you process many jobs, prefer requests batch mode.
• Tune RATE_LIMIT_PER_HOUR if you observe rate-limit errors.

FAQ ❓

• Does this actor log in?
  • No. It fetches publicly accessible data for the selected endpoints.
• How do I paginate?
  • Use the cursor input and the meta.next_cursor or meta.cursor returned in previous results.
• Can I run many endpoints together?
  • Yes, use requests to queue multiple endpoint+params jobs in one run.
• Why are some fields missing?
  • Availability depends on the data returned for a given resource and region.
• Where is the data saved?
  • The default Apify Dataset. Export as JSON, CSV, Excel, or Parquet from the run page.

---

Related Actors

• X/Twitter Profile Viewer: https://apify.com/igview-owner/x-twitter-profile-viewer
• Twitter X Video Downloader: https://apify.com/igview-owner/twitter-x-video-downloader
• Twitter X Scraper Pro: https://apify.com/igview-owner/twitter-x-scraper-pro

---

Keywords

twitter scraper, x scraper, twitter data extraction, twitter thread scraper, twitter replies scraper, twitter list scraper, twitter jobs, x spaces, x communities, social media data, apify actor, twitter automation, twitter analytics, twitter dataset export