X (Twitter) Search Crawler

This Apify Actor fetches tweets from X (formerly Twitter) based on provided search queries. It uses the X API to search for tweets and returns the data in a structured format.

Input

The Actor accepts the following input parameters:

Field	Type	Description
searchQueries	Array	Array of search queries to fetch tweets from X (e.g., from:username since:2024-01-01 until:2024-01-31)

Search Query Syntax

X (Twitter) supports a variety of search operators that you can use to refine your search:

• from:username - Tweets from a specific user
• to:username - Tweets replying to a specific user
• since:YYYY-MM-DD - Tweets after a specific date
• until:YYYY-MM-DD - Tweets before a specific date
• #hashtag - Tweets containing a specific hashtag
• url:example.com - Tweets containing links to a specific domain
• filter:media - Tweets containing media (images, videos)
• filter:links - Tweets containing links
• filter:replies - Tweets that are replies
• filter:retweets - Tweets that are retweets
• min_retweets:n - Tweets with at least n retweets
• min_faves:n - Tweets with at least n likes

You can combine these operators to create more specific searches.

Search Query Examples

A simple search query example:

from:apify since:2024-01-01 until:2024-01-31

A search query example with multiple operators:

from:apify since:2024-01-01 until:2024-01-31 filter:media

Output

The Actor outputs the tweet data in a structured format, including:

• Tweet ID
• Tweet text
• Tweet URL
• Creation timestamp
• Engagement metrics (likes, retweets, replies, quotes, bookmarks)
• Media attachments (if present)
• Information about whether the tweet is a retweet or quote
• Search query used to find the tweet

Output Schema

Each tweet is returned as a JSON object with the following structure:

Field	Type	Description
url	String	The full URL to the tweet on X.com
id	String	The unique identifier of the tweet
text	String	The full text content of the tweet
retweet_count	Number	Number of retweets
reply_count	Number	Number of replies
like_count	Number	Number of likes
quote_count	Number	Number of quote tweets
bookmark_count	Number	Number of bookmarks
created_at	String	The timestamp when the tweet was created
isretweet	Boolean	Whether the tweet is a retweet
isquote	Boolean	Whether the tweet is a quote tweet
media	Array	Array of media objects attached to the tweet
search_query	String	The search query used to find this tweet

For tweets with media, each item in the media array has the following structure:

Field	Type	Description
type	String	The type of media (e.g., "photo", "video", "animated_gif")
url	String	The URL to the media file
display_url	String	The shortened URL displayed in the tweet
expanded_url	String	The full URL to the media on X.com

Sample Output

Example of a tweet without media:

{
  "url": "https://x.com/username/status/1234567890123456789",
  "id": "1234567890123456789",
  "text": "@another_user This is an example tweet text showing what the output looks like!",
  "retweet_count": 0,
  "reply_count": 1,
  "like_count": 2,
  "quote_count": 0,
  "bookmark_count": 0,
  "created_at": "Sat Dec 28 15:12:37 +0000 2024",
  "isretweet": false,
  "isquote": false,
  "media": [],
  "search_query": "from:username since:2024-11-26 until:2024-12-31"
}

Example of a tweet with media:

{
  "url": "https://x.com/username/status/1234567890123456789",
  "id": "1234567890123456789",
  "text": "@another_user This is an example tweet with an image attached!",
  "retweet_count": 0,
  "reply_count": 0,
  "like_count": 1,
  "quote_count": 0,
  "bookmark_count": 0,
  "created_at": "Fri Dec 27 22:49:00 +0000 2024",
  "isretweet": false,
  "isquote": false,
  "media": [
    {
      "type": "photo",
      "url": "https://pbs.twimg.com/media/example_image.jpg",
      "display_url": "pic.x.com/example",
      "expanded_url": "https://x.com/username/status/1234567890123456789/photo/1"
    }
  ],
  "search_query": "from:username since:2024-11-26 until:2024-12-31"
}