Twitter X Reply Scraper

Twitter X Reply Scraper

Twitter X Reply Scraper is a production-ready Apify actor that collects tweet replies at scale from public X (Twitter) search results. It acts as a focused Twitter reply scraper and X reply extractor that pulls the Latest search timeline and then loads direct replies per tweet — perfect for social listening, brand monitoring, competitor analysis, and research. Built for marketers, developers, data analysts, and researchers, it lets you scrape Twitter replies, download tweet replies, and power dashboards and sentiment analysis workflows at scale.

What data / output can you get?

This actor saves a structured item for each tweet found in your X search results, plus an array of direct replies for each tweet.

Data field	Description	Example value
tweetLink	Canonical link to the tweet	https://x.com/acme/status/1784567890123456789
avatar	Author profile image URL (bigger size)	https://pbs.twimg.com/profile_images/..._bigger.jpg
fullname	Author display name	Acme Inc.
handle	Author handle (with @)	@acme
verified	Whether the author is verified (true/false or null)	true
tweetDate	Tweet timestamp in ISO-like format	2026-04-26T12:34:56.000Z
tweetContent	Full text of the tweet	Launching our new product today!
commentCount	Reply count on the tweet	42
retweetCount	Retweet/Repost count	18
quoteCount	Quote count	5
likeCount	Like count	256
repliesData	Array of direct reply objects (same fields as above, excluding repliesData)	[ { ...reply object... } ]

Notes:

• Each repliesData item includes: tweetLink, avatar, fullname, handle, verified, tweetDate, tweetContent, commentCount, retweetCount, quoteCount, likeCount.
• You can export your dataset as CSV or JSON and access it via the Apify API for integration with reporting and dashboards.

Key features

• 🔎 Latest search timeline + direct replies Uses X GraphQL SearchTimeline to collect the Latest search results, then loads direct replies with TweetDetail for precise, conversation-focused extraction.

• 🧭 Dynamic GraphQL query ID resolution Automatically extracts live query IDs from X’s main JavaScript bundle and generates x-client-transaction-id values, improving stability over hardcoded approaches.

• 🔐 Session-auth scraping (auth token + ct0) Runs with your authenticated X session (authToken and ct0), enabling reliable access and accurate data for your queries.

• 🌐 Smart proxy strategy (optional) Start direct by default or enable Apify Proxy. The actor escalates connection strategy on blocks (direct → datacenter → residential) to keep your runs moving.

• 📊 Configurable scope and depth Control throughput with maxSearchResults (per search URL) and tailor conversation depth with maxReplies (per tweet).

• 💾 Export-ready results Structured output designed for analytics: export CSV/JSON or pull via the Apify API for BI dashboards, reporting, and sentiment pipelines.

• 🧰 Developer-friendly (Python + API) Built on apify/actor-python with clean dataset output — ideal for Python Twitter reply scraper workflows and “Twitter reply scraping API” integrations.

• 🧱 Production-focused reliability Robust error handling, ID discovery, and controller_data handling from the first timeline page ensure consistent scraping across runs.

How to use Twitter X Reply Scraper - step by step

1. Sign in to Apify and open the Twitter X Reply Scraper actor.
2. Add Start URLs: paste one or more X search page links (the same URLs you get when you search on x.com). The actor parses the q= parameter automatically.
3. Set your session: enter authToken and ct0 in the input or set environment variables AUTH_TOKEN and CT0 in Apify.
4. Configure limits: choose maxSearchResults (per search URL) and maxReplies (per tweet) to control volume and depth.
5. (Optional) Enable Apify Proxy: toggle proxyConfiguration.useApifyProxy to true if you prefer routing through Apify’s network from the start.
6. Run the actor: click Start. The run logs will show pages loaded and rows saved as each tweet and its replies are processed.
7. Download results: open the Output / Dataset tab to browse, then export to CSV or JSON. Use the Apify API to integrate with your systems.

Pro Tip: Chain this Twitter replies crawler with your NLP pipeline for sentiment and topics, or trigger it via the Apify API to keep your “Twitter reply export tool” updated on a schedule.

Use cases

Use case	Description
Social listening & brand monitoring	Track brand mentions and analyze direct replies for sentiment and themes using a tweet replies extractor.
Competitor analysis	Monitor competitor announcements and mine reply reactions to benchmark engagement and feedback.
Campaign performance	Capture reply streams around launches or hashtags to evaluate audience response in near real time.
Customer support insights	Surface common issues and questions in replies for faster triage and improved knowledge bases.
Academic & market research	Collect conversation data from public threads to study discourse, topics, and attention patterns.
Reporting & dashboards	Export Twitter replies to CSV and connect via API to BI tools for daily or weekly reporting.
API pipelines	Use as a Twitter reply scraping API source in ETL workflows to populate data lakes and ML features.
Product feedback mining	Gather direct customer feedback from replies to inform roadmap prioritization.

Why choose Twitter X Reply Scraper?

Built for precision, automation, and reliability, this X reply scraper outperforms brittle, manual tools.

• 🎯 GraphQL-native accuracy: Uses SearchTimeline and TweetDetail with controller_data for consistent, first-class extraction.
• 🔐 Session-based reliability: Authenticated runs with authToken + ct0 keep results stable for your specific queries.
• 📈 Scalable controls: Tune maxSearchResults (1–5000) and maxReplies (1–500) for breadth and depth that fit your needs.
• 🧰 Developer access: Integrate via Apify’s dataset API for a Python Twitter reply scraper workflow or internal automations.
• 🌐 Resilient networking: Optional Apify Proxy with automatic escalation from direct to DC to residential on blocks.
• 💾 Analytics-ready: Clean JSON you can export to CSV or pull via API to power dashboards and sentiment analysis.
• 🛡️ Safer than extensions: Avoid unstable browser add-ons — run on Apify’s infrastructure with production-grade reliability.

In short, a focused Twitter comments scraper and Twitter conversation scraper designed for structured data and scale.

Is it legal / ethical to use Twitter X Reply Scraper?

Yes — when done responsibly. This actor collects data from public X (Twitter) content and requires your authenticated session to access standard features. You are responsible for ensuring your use complies with X’s terms and applicable laws.

Guidelines to follow:

• Scrape only public content you’re permitted to access with your session.
• Respect platform terms and rate limits.
• Comply with data protection laws (e.g., GDPR, CCPA) and internal policies.
• Keep authToken and ct0 secure; never share them publicly.
• Consult your legal team for edge cases or commercial deployments.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://x.com/search?q=%23journorequest%20min_replies%3A10&src=typed_query&f=live"
  ],
  "maxSearchResults": 10,
  "maxReplies": 5,
  "authToken": "YOUR_AUTH_TOKEN_HERE",
  "ct0": "YOUR_CT0_HERE",
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

• startUrls (array, required)
  • Description: Add one or more X search page links (the same URLs you get when you search on x.com). Each link defines what topic or keywords you want to follow.
  • Default: none
• maxSearchResults (integer, optional)
  • Description: Choose how many posts you want from each search link.
  • Default: 10 (min 1, max 5000)
• maxReplies (integer, optional)
  • Description: For each post found, decide how many replies to keep in your results.
  • Default: 5 (min 1, max 500)
• authToken (string, optional)
  • Description: Your X account session token (or set the AUTH_TOKEN environment variable in Apify).
  • Default: ""
• ct0 (string, optional)
  • Description: The companion security value for your X session (or use the CT0 env var).
  • Default: ""
• proxyConfiguration (object, optional)
  • Description: Optional Apify Proxy settings for smoother runs in the cloud.
  • Default prefill: { "useApifyProxy": false }

Example JSON output

[
  {
    "tweetLink": "https://x.com/acme/status/1784567890123456789",
    "avatar": "https://pbs.twimg.com/profile_images/abc_bigger.jpg",
    "fullname": "Acme Inc.",
    "handle": "@acme",
    "verified": true,
    "tweetDate": "2026-04-26T12:34:56.000Z",
    "tweetContent": "Launching our new product today!",
    "commentCount": 42,
    "retweetCount": 18,
    "quoteCount": 5,
    "likeCount": 256,
    "repliesData": [
      {
        "tweetLink": "https://x.com/user123/status/1784567890123456790",
        "avatar": "https://pbs.twimg.com/profile_images/def_bigger.jpg",
        "fullname": "Jane Doe",
        "handle": "@user123",
        "verified": null,
        "tweetDate": "2026-04-26T12:40:10.000Z",
        "tweetContent": "Congrats! Looking forward to trying it out.",
        "commentCount": 1,
        "retweetCount": 0,
        "quoteCount": 0,
        "likeCount": 7
      }
    ]
  }
]

Notes:

• repliesData contains direct replies only — those where the in_reply_to status matches the focal tweet. Nested replies to replies are not included.
• Some fields may be null or zero when not present in the source (e.g., verified).

FAQ

Do I need to log in or provide cookies to use this tool?

Yes. You must provide your X session via authToken and ct0 in the input, or set the AUTH_TOKEN and CT0 environment variables. This session enables the actor to access the Latest search results reliably and fetch tweet replies.

What types of data does the Twitter X Reply Scraper extract?

It outputs each tweet’s link, author avatar, fullname, handle, verified flag, date, full text, and engagement counts, plus an array of direct reply objects with the same fields. This makes it a precise tweet replies extractor for public conversations.

Does it collect entire threads or only direct replies?

It collects direct replies to the focal tweet. Each reply in repliesData is validated against the original tweet ID, so deeper nested replies (replies to replies) are not included.

How many results can I collect per run?

You control volume with two limits: maxSearchResults per search URL (1–5000) and maxReplies per tweet (1–500). This flexibility supports both quick samples and larger X reply scraper jobs.

Can I export to CSV/JSON and integrate via API or Python?

Yes. Results are stored in an Apify dataset you can download as CSV or JSON, or access via the Apify API. This fits Python Twitter reply scraper workflows and “Twitter reply scraping API” integrations for pipelines and dashboards.

Do I need to enable a proxy?

Not necessarily. By default, the actor tries a direct connection. If blocks occur, it escalates from direct to Apify datacenter and then residential proxies. You can also enable Apify Proxy from the start via proxyConfiguration.

Which searches are supported?

Provide X search URLs (e.g., https://x.com/search?q=...&f=live). The actor parses the q parameter and requests the Latest product results, functioning as a targeted Twitter reply exporter for your chosen keywords and filters.

Is it legal to scrape Twitter/X with this tool?

Yes, when done responsibly. The actor accesses public content using your session and leaves compliance to your use case. Ensure you follow X’s terms and applicable laws, and keep your session credentials secure.

Final thoughts

Twitter X Reply Scraper is built to extract tweet replies from public X search results with structure and scale. With authenticated stability, dynamic GraphQL handling, optional proxying, and export-ready datasets, it serves marketers, analysts, researchers, and developers alike. Connect it to your Twitter reply scraping API workflow, power Python pipelines, and export Twitter replies to CSV for sentiment, reporting, and dashboards. Start extracting smarter conversation insights, at the depth and scale your projects demand.

What are other Twitter scraping tools?

If you want to scrape specific Twitter data, you can use any of the dedicated scrapers below for faster and more targeted results.

Scraper Name	Scraper Name
Twitter (X) Tweets Scraper	Twitter Profile Phone Number Scraper
Twitter (X.com) Tweets & Profiles Scraper	Twitter Profile Scraper
Twitter B2b Email Scraper	Twitter Trends Scraper
Twitter B2b Lead Scraper	Twitter User Following Scraper
Twitter B2b Phone Number Scraper	Twitter X Posts Scraper
Twitter Email Scraper	Twitter X Tweets Profiles Scraper
Twitter Lead Scraper	X Twitter Email Scraper
Twitter Phone Number Scraper	X Twitter Lead Scraper
Twitter Posts Scraper	X Twitter Phone Number Scraper
Twitter Profile Email Scraper	X Twitter Posts Search
Twitter Profile Lead Scraper