Twitter User Search Scraper

What does Twitter User Search Scraper do?

Twitter User Search Scraper extracts user-search-specific public data from live Twitter/X sources. It uses the target type exposed by this Actor rather than a one-size-fits-all input.

The Actor stores only values fetched during the run. If the platform exposes only page metadata, oEmbed data, or an access-control page, that exact live response is represented; placeholder records are never generated.

Live targets

Use this Actor for public Twitter/X pages, status URLs, profiles, search pages, and mode-specific targets. Public visibility, rate limits, login walls, consent screens, regional restrictions, and source changes can limit specialized fields.

Input

The packaged input.json is a runnable example for this actor:

{
  "keywords": [
    "apify"
  ]
}

Use the mode-specific URL or query field above. maxItems limits dataset records and maxRequests limits source URLs. includeRawData is disabled by default. Proxy settings are optional and never bypass authentication, CAPTCHA, or access controls.

Output

Each dataset row is a live record. The following is an anonymized shape example matching fields this actor can emit when the source exposes them:

{
  "platform": "twitter",
  "actorMode": "user-search",
  "recordType": "profile",
  "username": "exampleuser",
  "displayName": "Example Creator",
  "title": "Example public profile",
  "text": "Example public profile description fetched at run time.",
  "sourceUrl": "https://x.com/exampleuser",
  "canonicalUrl": "https://x.com/exampleuser",
  "profileUrl": "https://x.com/exampleuser",
  "metrics": {
    "followers": 840,
    "following": 120,
    "posts": 75
  },
  "mediaUrls": [
    "https://cdn.example.com/profile/example.jpg"
  ],
  "httpStatus": 200,
  "retrievalMethod": "direct",
  "scrapedAt": "2025-01-15T12:01:00.000Z"
}

retrievalMethod identifies whether a row came from a direct request, Apify Proxy, or the TikTok public-reader fallback. Missing platform fields stay absent or nullable; they are not filled with fabricated values.

Run and inspect

Run locally with apify run --purge from this actor folder, then inspect storage/datasets/default. Validate the input form with apify validate-schema. The Output tab links to the default dataset through .actor/output_schema.json.

Compliance

Only public responses are processed. Do not use this Actor to bypass authentication, CAPTCHA, private-account controls, or platform permissions. Follow applicable terms, privacy requirements, and laws.