X/Twitter search scraper

What this Actor does

This Apify Actor collects publicly visible X (Twitter) posts matching your search query and writes them to a Dataset. Each item includes text, engagement counts, time, author profile, flags for reply/retweet/quote, and image/video URLs when available. Use it for monitoring, research exports, and integrations via API, Zapier, Make, and more.

You can schedule runs in the Apify Console, review history, and use platform features such as proxies (depending on your plan).

Why use it

• Pull a batch of public posts by keywords, hashtags, time range, and other filters supported by X search.
• Download results as JSON, CSV, or Excel, or pipe them into your own pipeline.
• Run repeatable, observable jobs in the cloud instead of one-off local scripts.

How to use it

1. Open this Actor on Apify and confirm your maintainer has configured the required runtime (account pool and any secrets—see deployment notes for this Actor).
2. Open Input and set Search query. You can build the same filters and operators in X’s UI, then copy the string here: Advanced search (keywords, from:, since:, until:, etc.).
3. Set Maximum number of posts (upper bound for rows written in this run).
4. Click Start. Inspect results under Dataset or fetch them via the API.

For local runs: apify run (with dependencies and config in place).

Input

Configure in the Input tab or equivalent JSON:

Field	Description
query	Search expression (keywords, from:, since:, until:, etc.). Compose it in X Advanced Search and paste the query into this field.
maxTweets	Positive integer: maximum number of posts to write to the dataset in this run.

Example:

{
  "query": "apify lang:en",
  "maxTweets": 500
}

Output

Each record is one post. You can export the default dataset as JSON, CSV, Excel, etc.

Example (fields may evolve slightly; trust the live Dataset):

{
  "type": "tweet",
  "id": "1728108619189874825",
  "url": "https://x.com/example/status/1728108619189874825",
  "text": "Example text",
  "retweetCount": 0,
  "replyCount": 0,
  "likeCount": 0,
  "quoteCount": 0,
  "createdAt": "2023-11-24 17:49:36+00:00",
  "lang": "en",
  "quoteId": "",
  "bookmarkCount": 0,
  "isReply": false,
  "source": "Twitter for Android",
  "author": {
    "type": "user",
    "userName": "example",
    "url": "https://x.com/example",
    "id": "44196397",
    "name": "Example User",
    "isVerified": true,
    "isBlueVerified": true,
    "verifiedType": "",
    "profilePicture": "https://pbs.twimg.com/profile_images/…/normal.jpg",
    "followers": 1000,
    "following": 100
  },
  "isRetweet": false,
  "isQuote": false,
  "imgUrls": "",
  "videoUrls": ""
}

Main fields

Field	Meaning
id / url	Post id and link
text	Body text
retweetCount / replyCount / likeCount / quoteCount / bookmarkCount	Engagement (as surfaced by the platform)
createdAt	Post time
lang	Language code
quoteId	Quoted post id, if any
isReply / isRetweet / isQuote	Structural flags
source	Client name when available
author	Display name, avatar, follower counts, etc.
imgUrls / videoUrls	Media URLs, comma-separated when multiple

Pricing

Cost depends on your Apify plan, maxTweets, runtime length, and network usage. See Apify pricing. Smaller time windows and lower caps usually reduce cost per run.

Tips

• Start with a small maxTweets to validate the query and fields, then scale up.
• Comply with X Terms of Service, applicable laws, and platform rules; use data lawfully.
• If you get fewer rows than expected, widen the window or simplify the query and retry.

Disclaimer and support

Availability of public posts, field completeness, and platform behavior can change; the Actor does not guarantee parity with the website UI. You are responsible for lawful collection and use of data.

Report issues via this Actor’s Issues on Apify; contact the developer for custom work.

Resources

• Apify Python SDK
• Actor documentation