Twitter/X Community Scraper: Search, Members, Tweets & More!

ScrapeBadger: Twitter/X Communities Scraper - Extract Community Data, Members, Tweets, and More!

ScrapeBadger provides powerful data extraction capabilities to scrape Twitter/X Communities, offering an incredibly affordable solution for comprehensive community data collection. Extract community details, members, moderators, tweets, and search for communities by keyword. All this starts at just $0.20 per 1,000 results.

Twitter Communities are groups where users with shared interests connect and discuss specific topics. With ScrapeBadger's Communities Scraper, you can analyze these communities for market research, competitor analysis, influencer identification, and audience segmentation.

Key Features

• Effortless Operation: Designed for ease of use, ScrapeBadger requires you to select a Mode and provide its corresponding identifier (e.g., Community ID for "Get Community Detail", search query for "Search Communities").
• Comprehensive Community Data:
  • Get Community Detail - Fetch metadata including name, description, member count, rules, and admin info.
  • Get Community Members - Extract all members of a community with their profiles.
  • Get Community Moderators - Identify moderators and admins of a community.
  • Get Community Tweets - Retrieve tweets posted within a community (Top, Latest, or Media).
• Powerful Search:
  • Search Communities - Find communities by keyword to discover relevant groups.
  • Search Community Tweets - Search for specific content within a community.
• Flexible and Structured Output: Data is delivered in Apify's standard Dataset, ready for export in CSV, JSON, etc.
• Enterprise-Grade Reliability: Built on the robust Apify platform for consistent results.
• Cost-Effective Solution: Just $0.20 per 1,000 results.

Great For

• Market Research: Discover communities discussing your products, services, or industry.
• Competitor Analysis: Monitor competitor communities and their engagement.
• Community Management: Analyze successful communities to inform your own strategy.
• Influencer Identification: Find key members and moderators in relevant communities.
• Content Strategy: Understand what topics and content resonate within communities.
• Academic Research: Study online community dynamics and behaviors.

How to Use - Mode-Specific Input Parameters

Mode	Description	Key Input Parameter	JSON Parameter	Optional
Get Community Detail	Get metadata for a specific community	Community ID	community_id	-
Get Community Members	Extract all members of a community	Community ID	community_id	max_results
Get Community Moderators	Get moderators/admins of a community	Community ID	community_id	max_results
Get Community Tweets	Get tweets posted in a community	Community ID	community_id	tweet_type, max_results
Search Communities	Find communities by keyword	Search Query	query	max_results
Search Community Tweets	Search tweets within a community	Community ID, Query	community_id, query	max_results

Request and Response Examples

1. Get Community Detail

Request:

{
  "mode": "Get Community Detail",
  "community_id": "1494465737469038594"
}

Response:

{
  "id": "1494465737469038594",
  "name": "Crypto Community",
  "description": "A community for crypto enthusiasts...",
  "member_count": 15000,
  "created_at": "2022-02-17T18:00:00+00:00",
  "is_nsfw": false,
  "join_policy": "Open",
  "admin_username": "community_admin",
  "rules": [
    {"name": "Be respectful", "description": "..."}
  ]
}

2. Get Community Members

Request:

{
  "mode": "Get Community Members",
  "community_id": "1494465737469038594",
  "max_results": 500
}

Response (array of community members):

{
  "user": {
    "id": "12345678",
    "username": "member_user",
    "name": "Member Name",
    "followers_count": 500
  },
  "role": "Member",
  "joined_at": "2023-05-15T10:00:00+00:00"
}

3. Get Community Moderators

Request:

{
  "mode": "Get Community Moderators",
  "community_id": "1494465737469038594",
  "max_results": 50
}

4. Get Community Tweets

Request:

{
  "mode": "Get Community Tweets",
  "community_id": "1494465737469038594",
  "tweet_type": "Latest",
  "max_results": 1000
}

Tweet Type Options:

• Top - Most popular/engaging tweets (default)
• Latest - Most recent tweets
• Media - Tweets containing images/videos

5. Search Communities

Request:

{
  "mode": "Search Communities",
  "query": "cryptocurrency",
  "max_results": 100
}

Response (array of communities):

{
  "id": "1494465737469038594",
  "name": "Crypto Traders",
  "description": "Community for crypto trading...",
  "member_count": 8500,
  "is_nsfw": false
}

6. Search Community Tweets

Request:

{
  "mode": "Search Community Tweets",
  "community_id": "1494465737469038594",
  "query": "bitcoin price",
  "max_results": 200
}

Output Fields

Community objects include:

• Core: id, name, description
• Membership: member_count, is_member, role
• Settings: is_nsfw, join_policy, invites_policy
• Metadata: created_at
• Administration: creator_id, creator_username, admin_id, admin_username
• Rules: rules (list of community rules)

Community Member objects include:

• User: Full user profile data
• Role: Member, Moderator, or Admin
• Joined: Date joined the community

Tweet objects include:

• Core: id, text, created_at, lang
• Engagement: favorite_count, retweet_count, reply_count, view_count
• Author: user_id, username

Important Note: To prevent API abuse and ensure fair resource allocation, you will be charged for requests that return an empty results set.

Why Choose ScrapeBadger?

• Highly Targeted Data: Get precisely the Twitter/X community data you need.
• Efficient and Reliable: Built for speed and stability on the Apify platform.
• Unbeatable Value: Just $0.20 per 1,000 results.
• User-Friendly: Easy to configure regardless of technical expertise.
• Seamless Integration: Output data readily available for analysis.

About ScrapeBadger

This actor is powered by ScrapeBadger - a reliable Twitter/X data extraction service.

• Official Website: scrapebadger.com
• Faster Support: Get priority support directly through the ScrapeBadger website
• SDK & API Access: Want to use ScrapeBadger outside of Apify? The Python SDK and REST API are available for direct integration into your own applications