Twitter/X Community Scraper: Search, Members, Tweets & More!

ScrapeBadger provides powerful data extraction capabilities to scrape Twitter/X Communities, offering an incredibly affordable solution for comprehensive community data collection. Extract community details, members, moderators, tweets, and search for communities by keyword. All this starts at just $0.20 per 1,000 results.

Twitter Communities are groups where users with shared interests connect and discuss specific topics. With ScrapeBadger's Communities Scraper, you can analyze these communities for market research, competitor analysis, influencer identification, and audience segmentation.

What can X Community Scraper do?

• Effortless Operation: Designed for ease of use, ScrapeBadger requires you to select a Mode and provide its corresponding identifier (e.g., Community ID for "Get Community Detail", search query for "Search Communities").
• Comprehensive Community Data:
  • Get Community Detail - Fetch metadata including name, description, member count, rules, and admin info.
  • Get Community Members - Extract all members of a community with their profiles.
  • Get Community Moderators - Identify moderators and admins of a community.
  • Get Community Tweets - Retrieve tweets posted within a community (Top, Latest, or Media).
• Powerful Search:
  • Search Communities - Find communities by keyword to discover relevant groups.
  • Search Community Tweets - Search for specific content within a community.
• Flexible and Structured Output: Data is delivered in Apify's standard Dataset, ready for export in CSV, JSON, etc.
• Enterprise-Grade Reliability: Built on the robust Apify platform for consistent results.
• Cost-Effective Solution: Just $0.20 per 1,000 results.

Why scrape X (Twitter) Communities?

• Market Research: Discover communities discussing your products, services, or industry.
• Competitor Analysis: Monitor competitor communities and their engagement.
• Community Management: Analyze successful communities to inform your own strategy.
• Influencer Identification: Find key members and moderators in relevant communities.
• Content Strategy: Understand what topics and content resonate within communities.
• Academic Research: Study online community dynamics and behaviors.

How to scrape X Communities

Mode	Description	Key Input Parameter	JSON Parameter	Optional
Get Community Detail	Get metadata for a specific community	Community ID	community_id	-
Get Community Members	Extract all members of a community	Community ID	community_id	max_results
Get Community Moderators	Get moderators/admins of a community	Community ID	community_id	max_results
Get Community Tweets	Get tweets posted in a community	Community ID	community_id	tweet_type, max_results
Search Communities	Find communities by keyword	Search Query	query	max_results
Search Community Tweets	Search tweets within a community	Community ID, Query	community_id, query	max_results

Request and response examples

1. Get Community Detail

Request:

{
  "mode": "Get Community Detail",
  "community_id": "1494465737469038594"
}

Response:

{
  "id": "1494465737469038594",
  "name": "Crypto Community",
  "description": "A community for crypto enthusiasts...",
  "member_count": 15000,
  "created_at": "2022-02-17T18:00:00+00:00",
  "is_nsfw": false,
  "join_policy": "Open",
  "admin_username": "community_admin",
  "rules": [
    {"name": "Be respectful", "description": "..."}
  ]
}

2. Get Community Members

Request:

{
  "mode": "Get Community Members",
  "community_id": "1494465737469038594",
  "max_results": 500
}

Response (array of community members):

{
  "user": {
    "id": "12345678",
    "username": "member_user",
    "name": "Member Name",
    "followers_count": 500
  },
  "role": "Member",
  "joined_at": "2023-05-15T10:00:00+00:00"
}

3. Get Community Moderators

Request:

{
  "mode": "Get Community Moderators",
  "community_id": "1494465737469038594",
  "max_results": 50
}

4. Get Community Tweets

Request:

{
  "mode": "Get Community Tweets",
  "community_id": "1494465737469038594",
  "tweet_type": "Latest",
  "max_results": 1000
}

Tweet Type Options:

• Top - Most popular/engaging tweets (default)
• Latest - Most recent tweets
• Media - Tweets containing images/videos

5. Search Communities

Request:

{
  "mode": "Search Communities",
  "query": "cryptocurrency",
  "max_results": 100
}

Response (array of communities):

{
  "id": "1494465737469038594",
  "name": "Crypto Traders",
  "description": "Community for crypto trading...",
  "member_count": 8500,
  "is_nsfw": false
}

6. Search Community Tweets

Request:

{
  "mode": "Search Community Tweets",
  "community_id": "1494465737469038594",
  "query": "bitcoin price",
  "max_results": 200
}

What data can X Community Scraper extract?

Community objects include:

• Core: id, name, description
• Membership: member_count, is_member, role
• Settings: is_nsfw, join_policy, invites_policy
• Metadata: created_at
• Administration: creator_id, creator_username, admin_id, admin_username
• Rules: rules (list of community rules)

Community Member objects include:

• User: Full user profile data
• Role: Member, Moderator, or Admin
• Joined: Date joined the community

Tweet objects include:

• Core: id, text, created_at, lang
• Engagement: favorite_count, retweet_count, reply_count, view_count
• Author: user_id, username

Important Note: To prevent API abuse and ensure fair resource allocation, you will be charged for requests that return an empty results set.

How much does it cost to scrape X Communities?

• Highly Targeted Data: Get precisely the Twitter/X community data you need.
• Efficient and Reliable: Built for speed and stability on the Apify platform.
• Unbeatable Value: Just $0.20 per 1,000 results.
• User-Friendly: Easy to configure regardless of technical expertise.
• Seamless Integration: Output data readily available for analysis.

About ScrapeBadger

This actor is powered by ScrapeBadger - a reliable Twitter/X data extraction service.

• Official Website: scrapebadger.com
• Faster Support: Get priority support directly through the ScrapeBadger website
• SDK & API Access: Want to use ScrapeBadger outside of Apify? The Python SDK and REST API are available for direct integration into your own applications

Ready-to-run examples

Each of these is a live, pre-configured task — open one and press Start, no setup:

• Find X Communities in your niche
• Export community members
• Monitor community conversations
• Identify community moderators
• Search inside a community
• Profile a community before joining

What can you do with X (Twitter) Communities data?

Niche audience discovery

Communities are where topic-specific conversation moved after the algorithm took over the main feed. Searching them by keyword finds the rooms your buyers are actually in.

Pre-qualified outreach lists

Everyone in a community opted into its topic. That makes a member export one of the cleanest prospect lists available on any social platform.

Product feedback and support signals

Communities discuss tools candidly, in a semi-private setting. Monitoring the ones around your category surfaces complaints long before they reach your support queue.

Competitive intelligence

Watching a competitor's community shows you what their users struggle with, in their users' own words.

Finding the real authorities

Moderators decide what gets seen. Identifying them tells you who to approach before pitching anything into a community.

Is scraping X legal?

This Actor requests only public X fields — the same content any logged-out visitor can see. It does not access private accounts, direct messages or anything behind a login.

Results can still contain personal data. Personal data is protected by the GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers.

Frequently asked questions

Where do I find a Community ID?

It is the number in the community URL: x.com/i/communities/1471580197908586507. Or use Search Communities to find it by keyword.

Do I need to be a member to scrape a community?

No. Only publicly visible community data is returned, and no X credentials are supplied to the Actor.

Can I search inside one specific community?

Yes — Search Community Tweets scopes a keyword search to a single community, which is far more precise than a global search.

Your feedback and support

Found a bug, missing a field, or need a mode that is not here? Open a ticket on the Issues tab, or email support@scrapebadger.com.