🐦 Twitter / X Advanced Search Scraper – Apify Actor

A powerful, enterprise-grade Apify Actor for scraping Twitter / X data using advanced search operators — no API key required.

This actor supports 50+ filters, three search modes, rich metadata extraction, and reliable scraping with optional residential proxies.

---

🚀 Key Features

🔎 Three Search Modes

• Global Search Search tweets across all of Twitter using keywords, hashtags, time, geo, media, and engagement filters.
• Profile Search Scrape tweets from a specific user profile (date range, keywords, engagement).
• User Search Discover Twitter user profiles based on search queries.

---

🎯 Advanced Filtering (50+ Options)

Engagement

• Min / Max likes, retweets, replies
• Presets: low, medium, high, viral

Media

• Images, videos, GIFs
• Links, news articles
• Polls (2–4 options)
• Twitter Cards (YouTube, apps, summaries, videos)

Content

• Keywords, exact phrases
• Hashtags, cashtags
• Excluded keywords / hashtags
• Question-based tweets
• Sentiment via emoticons 🙂

Users

• From / To / Mention users
• Exclude users
• Verified / Blue verified only
• Twitter list members

Time

• Date range (since / until)
• Relative time (7d, 24h)
• Tweet ID ranges
• Unix timestamps

Geo

• City / landmark search
• Radius (25km, 15mi)
• Geocode (lat, lng)
• Twitter place IDs

---

📦 Rich Data Extraction

Each result includes:

• Full tweet text

• Tweet ID & URL

• Timestamp

• Engagement stats

• Media URLs (HQ images, videos)

• Author profile details:

  • Name
  • Username
  • Bio
  • Followers
  • Verification status

---

🔐 Privacy & Reliability

• ✅ No Twitter API key required
• 🔁 Automatic retries
• 🌍 Residential proxy support (via Apify)
• ⚡ Optimized crawling & pagination

---

📋 Input Configuration

The actor supports simple search or fully structured advanced filters.

Minimal Example

{
  "query": "python programming",
  "numberOfTweets": 100
}

Advanced Example

{
  "query": "AI OR Machine Learning",
  "queryType": "Top",
  "numberOfTweets": 500,
  "engagementLevel": "high",
  "mediaTypes": ["image", "video"],
  "contentLanguage": "en",
  "timeSince": "2024-01-01",
  "timeUntil": "2024-12-31",
  "usersVerifiedOnly": true
}

💡 You can use either query OR advanced filters — at least one must be provided.

---

📤 Output

Results are stored in the default Apify dataset.

Example Tweet Output

{
  "searchType": "post",
  "type": "tweet",
  "query": "python programming",
  "data": {
    "tweet_url": "https://x.com/username/status/123456789",
    "tweet_id": "123456789",
    "author": {
      "fullname": "Python Dev",
      "username": "pythondev",
      "verified": true
    },
    "text": "Just released a new Python library! #python #coding",
    "stats": {
      "likes": 150,
      "retweets": 45,
      "comments": 12
    },
    "media": [
      {
        "type": "image",
        "url": "https://pbs.twimg.com/media/..."
      }
    ]
  }
}

---

📊 Built-in Dataset Views

Once the actor finishes, you get instant views:

• 📄 All Tweets
• 👤 Users
• 🔥 High Engagement Tweets
• 🖼 Tweets with Media

Perfect for:

• Sentiment analysis
• Market research
• Lead generation
• News tracking
• Influencer discovery

---

🛠️ Development

Tech Stack

• Python
• Apify SDK
• Crawlee

Local Setup

git clone <repo>
pip install -r requirements.txt
apify run

---

📄 License

Licensed under Apache License 2.0 Free to use, modify, and integrate in commercial projects.

---

⭐ Use Cases

• Social listening & trend analysis
• Brand monitoring
• Crypto & stock sentiment tracking
• Lead generation
• Academic & research datasets
• Media & journalism research

---

🔥 If you need precision Twitter scraping without API limits — this actor is built for you.