X (Twitter) Posts Scraper

X (Twitter) Posts Scraper

Data extraction tool designed to harvest individual posts (tweets), engagement metrics, and author details from X.

Track viral tech threads, monitor brand mentions, or compile datasets for sentiment analysis.

Capture deep metadata from public posts

FEATURES

Complete Content Capture: Extract the full text payload across multiple fields (text, body, and headline) ensuring no character limits break your text data.

Granular Engagement Metrics: Track real-time virality indicators including lifetime view counts (views), bookmarks, likes (likes), retweets (retweets), quotes (quotes), and deep reply counts (replies).

Author Identity Mapping: Link posts instantly to their creators with full author metadata, including author_id, author_name, @author_username, and high-resolution profile images (author_image).

Precise Chronology: Capture immutable ISO timestamps for both created_at and published_at variations to build accurate time-series datasets.

Direct Canonical Access: Automatically generates clean destination URLs (url) mapping directly back to the live status post for downstream review.

USE CASES

Social Listening & Brand Auditing: Monitor real-time consumer conversations, tracking metrics like views and replies to gauge organic reach and public sentiment during product launches.

Trend & Viral Thread Aggregation: Programmatically isolate high-performing text posts (e.g., educational RAG or AI tutorials) that clear specific engagement thresholds (e.g., >500 likes) to power curation dashboards.

Dataset Generation for NLP Training: Gather massive amounts of natural language prose, specialized jargon, or community feedback to train custom Large Language Models (LLMs) or fine-tune sentiment analysis engines.

Competitive Intelligence: Keep tabs on target corporate handles or industry thought leaders to benchmark their average engagement distribution over time.

OUTPUT

From Profile

{
  "url": "https://x.com/elonmusk/status/1812256998588662068",
  "retweets": 332474,
  "quotes": 36465,
  "replies": 82667,
  "views": 224116766,
  "bookmark": 74515,
  "likes": 2195248,
  "text": "I fully endorse President Trump and hope for his rapid recovery https://t.co/ZdxkF63EqF",
  "created_at": "2024-07-14 00:45:13",
  "input": "https://x.com/elonmusk",
  "video_url": "https://video.twimg.com/amplify_video/1812256938383568896/pl/-oS-CTRNmFjed6Rm.m3u8?tag=16&v=a8d",
  "image_url": "https://pbs.twimg.com/amplify_video_thumb/1812256938383568896/img/_R5F6myzmRblxf_8.jpg",
  "quoted_tweet": ""
}

From Direct Post

{
  "headline": "Good",
  "body": "Good",
  "created_at": "2024-08-01T17:48:24.000Z",
  "published_at": "2024-08-01T17:48:24.000Z",
  "comments": 29135,
  "post_id": "1819067673818681724",
  "url": "https://x.com/elonmusk/status/1819067673818681724",
  "text": "Good",
  "author_username": "elonmusk",
  "author_name": "Elon Musk",
  "author_url": "https://x.com/elonmusk",
  "author_id": "44196397",
  "author_image": "https://pbs.twimg.com/profile_images/2053244804520427520/m8mdWZCG_normal.jpg",
  "likes": 1707489,
  "retweets": 151317,
  "quotes": 6283,
  "replies": 29135,
  "views": 181643918,
  "bookmark": 20247,
  "input": "https://x.com/elonmusk/status/1819067673818681724",
  "video_url": "",
  "image_url": "",
  "quoted_tweet": "https://x.com/BRICSinfo/status/1818819892138668114"
}

🛟 SUPPORT

Share your runs with the developer team and create issues on error to help us improve actor quality.

You might discover edge case we didn't test yet

We stay available anytime