X (Twitter) Community Search Post Scraper 𝕏
Pricing
from $0.35 / 1,000 results
X (Twitter) Community Search Post Scraper 𝕏
Extract tweets from X (Twitter) communities. Process single or multiple communities, get comprehensive tweet data with community context, and handle large-scale data collection efficiently.
Pricing
from $0.35 / 1,000 results
Rating
4.9
(34)
Developer

API ninja
Actor stats
36
Bookmarked
276
Total users
145
Monthly active users
17 days ago
Last modified
Categories
Share
X (Twitter) Community Tweets Scraper
Extract tweets, media, and engagement data from any X (Twitter) Community. Support for multiple communities, pagination, and sorting options.
What does X (Twitter) Community Tweets Scraper do?
X (Twitter) Community Tweets Scraper is a powerful Apify Actor designed to scrape X (Twitter) Communities without needing the official Twitter API. It allows you to extract public posts, media, and engagement metrics from niche communities on X, delivering the data in structured formats like JSON, CSV, Excel, or HTML.
This is a no-code tool suitable for everyone—from developers to marketers. It handles complex tasks like pagination, rate limiting, and proxy management automatically, so you can focus on the data. It is the perfect tool to download X Community data for analysis.
Who is this for?
- Researchers: Analyzing social groups, public discourse, and niche topics.
- Marketers: Tracking community sentiment, trends, and influencer activity.
- Data Analysts: Building datasets for NLP, sentiment analysis, or social science research.
- Businesses: Monitoring brand mentions and feedback within specific communities.
Use Cases for X (Twitter) Community Data
- Sentiment Analysis: Gauge how specific communities feel about topics, products, or events.
- Trend Monitoring: Identify emerging trends and viral content within niche groups before they hit the mainstream.
- Lead Generation: Find active users and potential leads discussing relevant topics in specialized communities.
- Content Strategy: Analyze top-performing posts to understand what resonates with specific audiences.
- Academic Research: Collect large-scale datasets for sociological or political studies.
Features of X (Twitter) Community Tweets Scraper
This tool is built for flexibility and scale. Here is what makes it powerful:
- 👥 Scrape Multiple Communities: Enter a list of Community IDs to scrape them all in a single run.
- ↕️ Flexible Sorting: Sort tweets by Latest (real-time monitoring) or Top (most popular/viral content).
- 🔄 Deep Pagination: Automatically scrolls through the timeline to collect hundreds or thousands of tweets.
- ♾️ Scrape All Mode: Enable "Scrape All" to retrieve every available tweet from the community timeline.
- 📊 Rich Metadata: Extracts tweet text, author details, like/retweet counts, media URLs, and timestamps.
- 🆔 Context Preserved: Every scraped tweet is tagged with its source
communityId, making it easy to organize data from multiple sources.
The Apify Platform Advantage
Using this Actor on the Apify platform gives you enterprise-grade benefits:
- Full API Access: Integrate the scraper programmatically into your existing pipelines.
- Integrations: Push data directly to Google Sheets, Slack, Zapier, Make, or via webhooks.
- Proxy Rotation: Automatic handling of IP rotation and residential proxies to prevent blocking.
- Scheduling: Set up cron jobs to monitor communities daily, hourly, or weekly.
- Cloud Storage: Long-term retention of your datasets in the secure Apify cloud.
What data can I extract?
The scraper provides comprehensive data for every tweet. Here are the main data points:
| Field | Description |
|---|---|
full_text | The actual text content of the tweet. |
created_at | The exact date and time the tweet was posted. |
favorite_count | Number of likes/hearts. |
retweet_count | Number of retweets. |
reply_count | Number of replies. |
user | Object containing author details (screen name, name, profile image). |
media | Links to images or videos attached to the tweet. |
communityId | The ID of the community this tweet belongs to. |
views | View count (impression metrics). |
How to scrape X (Twitter) Communities
Getting started is easy and requires no programming skills.
- Find the Community ID: Visit a community on X (e.g., Twitter Communities). The Community ID is the long number at the end of the URL (e.g., in
https://twitter.com/i/communities/1472105760389668865, the ID is1472105760389668865). - Input the ID: Copy that number and paste it into the Community IDs field in the Actor input. You can add multiple IDs to scrape them simultaneously.
- Choose Sorting: Select Latest to see what's happening now, or Top to see the best content.
- Set Limits: Choose how many tweets you want (e.g., 100) or enable Scrape All to get everything available.
- Run: Click the Start button.
Pricing
This Actor uses a consumption-based model. You only pay for the Compute Units (CUs) used to scrape the data.
- Efficient: Optimized to minimize resource usage.
- Scalable: The cost scales linearly with the amount of data you extract.
- Transparent: No hidden fees or separate Twitter API subscriptions required.
Note: The cost per 1,000 tweets can vary depending on the complexity of the community and the depth of the scroll.
Input and Output Examples
Input
For a full list of input options, see the Input tab in Apify Console.
{"communityIds": ["1472105760389668865","1567890123456789012"],"sortBy": "Latest","numberOfTweets": 100,"scrapeAll": false}
Output
The results are delivered in a structured JSON format. You can download the dataset in JSON, CSV, Excel, XML, HTML, or RSS, or access it via API.
[{"created_at": "Fri Feb 01 12:00:00 +0000 2026","id_str": "1885829471029384756","full_text": "Just discovered a great new feature in Python! #coding #community","user": {"id_str": "12345678","name": "Python Fan","screen_name": "python_fan_123"},"favorite_count": 42,"retweet_count": 5,"communityId": "1472105760389668865"}]
Related Actors
If you need more data from X (Twitter), check out our other specialized tools:
- X (Twitter) Advanced Search: Perform complex search queries to find historical tweets, monitor hashtags, or track keywords.
- X (Twitter) Followers Scraper: Export followers and following lists from any public profile.
FAQ and Legal
Is it legal to scrape X (Twitter)?
Our scrapers are designed to collect only publicly available data. We do not extract private user data (such as email addresses, gender, or location) unless it is publicly shared by the user. We believe that our scrapers, when used for ethical purposes by Apify users, are safe. However, you should not scrape personal data unless you have a legitimate reason to do so. If you're unsure, consult your legal advisors.
Do I need a Twitter API Key?
No! This Actor handles all the authentication and scraping logic for you. You just need an Apify account.
Why are the results sorted differently than I see on the web?
The "Top" and "Latest" algorithms on X can vary slightly based on personalization. Our scraper fetches data directly from the community endpoints to give you the most raw and unfiltered view possible based on your selected sort order.
Support
If you encounter any bugs, have feature requests, or need a custom scraping solution, please create an issue in the Issues tab or reach out to us directly.