Threads Posts Scraper - Extract Posts & Profiles from Threads by Meta

🚀 Powerful Threads scraper to extract posts, user profiles, and search results from Threads.net (Meta's Twitter alternative). Perfect for social media monitoring, influencer discovery, and competitor analysis.

⚠️ Experimental Actor: This is an experimental tool. Website structure may change occasionally, which could affect data extraction. Please test with small batches before large-scale use. If you encounter any issues, please report them via the Issues section. Thank you!

⚠️ Important: Data Scraping Limitations

Threads data scraping has the following inherent limitations:

• Data Volume Limits: Threads platform restricts the amount of accessible data. Actual results vary based on account activity, content type, and other factors
• Dynamic Loading: Threads uses infinite scroll to load content but stops loading after a certain amount
• Text Truncation: Longer post content may be truncated in the feed, requiring additional processing for complete text
• Rate Limiting: Too frequent requests may trigger platform protection mechanisms
• Content Availability: Private accounts, deleted content, or region-restricted content cannot be accessed

🚀 Best Practices

1. Small Batch Testing: Start with smaller limits for initial testing and gradually increase to find optimal settings
2. Realistic Expectations: Understand that actual results may be less than requested
3. Error Handling: Be prepared to handle partial failures or incomplete results
4. Execution Intervals: Avoid too frequent scraping; recommend at least 5-10 minute intervals
5. Data Validation: Always validate scraped data for completeness and accuracy
6. Backup Plans: For critical data, consider multiple scraping attempts or different parameters

🌟 Key Features

• ✅ Two Scraping Modes: User posts with full profile data & Keyword search
• ✅ Three Search Filters: Popular (trending), Recent (latest), Profiles (user discovery)
• ✅ Complete Profile Data: Bio, follower counts, verification status
• ✅ Rich Post Content: Text, mentions, hashtags, media URLs
• ✅ No Login Required: Public data only
• ✅ Export Formats: JSON, CSV, Excel
• ✅ Fast & Reliable: Optimized for performance

📊 What Data Can You Get?

User Profile Information

• Username and display name
• Bio/description (complete text)
• Profile picture URL
• Follower count (accurate numbers)
• Verification status
• Profile URL

Post Content

• Text content (may be truncated for long posts*)
• Post creation time
• Post URL and unique code
• Media attachments (images/videos)
• Hashtags used
• User mentions (@username.xxx format)
• External links

💡 Pro Tip: Use the "All fields" view in Apify to see all extracted data fields. For long posts that get truncated, you can use the post URL with an HTTP request tool for complete content.

🎯 Use Cases

• Social Media Monitoring: Track brand mentions and conversations
• Influencer Discovery: Find content creators with follower metrics
• Competitor Research: Monitor competitor activities and engagement
• Content Analysis: Analyze trending topics and hashtags
• Lead Generation: Discover profiles in your niche
• Market Research: Understand audience sentiment

🚀 How to Use

⚠️ Important: Correct Input Format

Please use the exact field names as shown below to avoid errors:

❌ Common Mistakes to Avoid:

• Don't use action → use mode instead
• Don't use query → use keyword instead
• Don't use usernames array → use single username string
• Don't include @ symbol in username

✅ Correct Input Examples:

Scraping User Posts:

{
  "mode": "user",
  "username": "zuck",
  "limit": 30
}

Searching by Keyword:

{
  "mode": "keyword",
  "keyword": "artificial intelligence",
  "searchFilter": "recent",
  "limit": 20
}

Input Configuration

The actor accepts the following input parameters:

Parameter	Type	Description	Example
mode	String	Scraping mode: user or keyword	"user"
username	String	Target username (for user mode)	"nike"
keyword	String	Search keyword (for keyword mode)	"AI automation"
searchFilter	String	Search filter type (keyword mode only)	"recent"
limit	Number	Maximum posts to scrape (1-100)	30
headless	Boolean	Run browser in headless mode	true

Mode 1: Scrape User Posts (with Profile Data)

Extract posts AND complete profile information from a specific user:

{
  "mode": "user",
  "username": "zuck",
  "limit": 50
}

This returns:

• User's bio and follower count
• All recent posts with mentions and hashtags
• Profile verification status
• Media attachments

Mode 2: Search Posts by Keyword

Search for posts or profiles containing specific keywords:

Popular/Trending Posts (Default)

{
  "mode": "keyword",
  "keyword": "artificial intelligence",
  "searchFilter": "default",
  "limit": 30
}

Recent Posts

{
  "mode": "keyword",
  "keyword": "#AI",
  "searchFilter": "recent",
  "limit": 30
}

Discover User Profiles

{
  "mode": "keyword",
  "keyword": "tech entrepreneur",
  "searchFilter": "profiles",
  "limit": 20
}

📤 Output Format

Viewing Your Data

1. Dataset View: Click "Preview" to see extracted posts
2. All Fields: Switch to "All fields" view to see complete data including:
   • Full user profile information
   • Complete mention arrays
   • Media metadata
   • Additional extracted fields

Dataset Output Example

Each post is saved as a separate record:

{
  "username": "user123",
  "display_name": "John Doe",
  "bio": "Tech enthusiast | AI researcher | Building the future",
  "is_verified": true,
  "followers_count": 5043,
  "profile_pic_url": "https://...",
  "profile_url": "https://www.threads.com/@user123",
  "post_code": "C123456",
  "text_content": "This is my post about AI...",
  "created_at": "2024-01-15T10:30:00+00:00",
  "has_media": true,
  "media_items": [
    {
      "media_type": "image",
      "media_url": "https://..."
    }
  ],
  "hashtags": ["AI", "Technology"],
  "mentions": [
    {
      "username": "friend.name",
      "display_text": "@friend.name"
    }
  ],
  "post_url": "https://www.threads.com/@user123/post/C123456"
}

Working with Long Posts

⚠️ Note on Long Content: Posts with extensive text may be truncated in the scraper output. To get complete content:

1. Use the extracted post_url
2. Make an HTTP request to fetch the full page
3. Parse the complete content from the response

Example using the post URL:

https://www.threads.com/@username/post/C123456

🔧 Advanced Features

Search Tips

• Use # for hashtag searches (e.g., #AI)
• Usernames with dots are fully supported (e.g., @user.name)
• Multi-language support (English, Chinese, Japanese, Spanish, etc.)
• Combine keywords with spaces for broader results

Data Quality Features

• Accurate follower count parsing (handles K, M, 萬 notations)
• Clean text extraction (removes timestamps and UI elements)
• Complete mention extraction (preserves full username format)
• Bio text cleaning (removes follower count artifacts)

💡 Example Use Cases

1. Influencer Discovery with Metrics

{
  "mode": "keyword",
  "keyword": "fitness coach",
  "searchFilter": "profiles",
  "limit": 30
}

Get profiles with follower counts to identify micro and macro influencers.

2. Competitor Analysis

{
  "mode": "user",
  "username": "competitor_brand",
  "limit": 50
}

Extract complete profile data including bio and all recent posts.

3. Hashtag Monitoring

{
  "mode": "keyword",
  "keyword": "#YourBrand",
  "searchFilter": "recent",
  "limit": 50
}

Track real-time mentions and conversations.

4. Content Research

{
  "mode": "keyword",
  "keyword": "AI tools",
  "searchFilter": "default",
  "limit": 30
}

Find trending content in your niche.

🔄 Integration Examples

Using with Apify API

from apify_client import ApifyClient

client = ApifyClient('YOUR_API_TOKEN')
actor = client.actor('YOUR_USERNAME/threads-posts-scraper')

# Run the actor
run = actor.call(run_input={
    "mode": "user",
    "username": "meta",
    "limit": 30
})

# Get results with all fields
for item in client.dataset(run['defaultDatasetId']).iterate_items():
    print(f"@{item['username']} ({item['followers_count']} followers)")
    print(f"Bio: {item['bio']}")
    print(f"Post: {item['text_content'][:100]}...")
    print("---")

Webhook Integration

Set up webhooks to get notified when scraping completes:

{
  "mode": "keyword",
  "keyword": "your brand",
  "limit": 50,
  "webhooks": [{
    "url": "https://your-server.com/webhook",
    "eventTypes": ["ACTOR.RUN.SUCCEEDED"]
  }]
}

📈 Performance & Limits

Post Limits:

• User posts: Only recent posts accessible, quantity varies by account
• Keyword search: Limited by Threads' search results
• Profile search: Limited by search results

Note: Threads dynamically loads content and may limit the amount of data available through scrolling. Actual results may be less than the requested limit.

❓ Frequently Asked Questions

Q: Why do I see truncated text for long posts? A: Threads displays truncated content in the feed. Use the post URL to fetch complete content via HTTP request.

Q: How do I see all available data fields? A: In the Apify console, switch from "Preview" to "All fields" view to see complete extracted data.

Q: Can I get email addresses? A: No, email addresses are not publicly displayed on Threads profiles.

Q: Why are follower counts important? A: Follower counts help identify influencers, verify account authenticity, and measure reach for social monitoring.

Q: Does it work with usernames containing dots? A: Yes! Usernames like @user.name are fully supported.

Q: What's the best way to find influencers? A: Use keyword mode with searchFilter: "profiles" to discover users, complete with follower counts.

Q: Why am I getting fewer results than my limit? A: Threads limits the amount of content available through their interface. The actual number of posts available varies based on multiple factors including account activity, content type, and more.

💡 Share Your Best Practices

If you've discovered effective scraping techniques or encountered issues, please share your feedback:

• Leave comments in the Actor's comment section
• Report issues via the Issues tab
• Rate and provide feedback

🆘 Support

Having issues or questions?

• Check the Apify documentation
• View all fields in the dataset for complete data
• Contact support through the Apify platform

📚 Disclaimer

This tool is provided for educational and research purposes only. Use it responsibly and in accordance with Threads' Terms of Service.

---

Keywords: Threads scraper, Threads API, Meta Threads, social media scraper, Instagram Threads, Threads posts, Threads data extraction, social media monitoring, Threads automation, influencer discovery, follower count scraper

Happy Scraping! 🎉