🧵 Threads Post & Profile Scraper

A powerful, high-performance scraper built to extract posts, thread conversations, author profiles, follower metrics, engagement numbers, media attachments, and search results directly from Threads (threads.net).

---

🌟 Features

• 📊 Comprehensive Social Metrics: Extracts like count, reply count, repost count, quote count, reshare count, media types, and timestamps.
• 👤 Rich Author Profiles: Gathers author username, display name, user ID, profile picture URL, follower count, biography, and verification badge status.
• 🎯 Multi-Mode Scraping: Supports User Profile mode (@username), Direct Post / Thread URL mode, and Topic / Keyword Search mode.
• ⚡ Multi-Layer Extraction Pipeline: Combines direct GraphQL API interception, embedded pre-rendered JSON script parsing, and dynamic DOM evaluation fallback.
• 📜 Smart Dynamic Pagination: Autonomously scrolls down feeds, handles content hydration, and enforces hard item limits (maxItems).
• 🛡️ Advanced Anti-Bot Stealth: Built-in fingerprint randomization (User-Agents, screen resolutions, navigator webdriver masking) and full Apify Residential proxy support.
• 📦 Standard Apify Schemas: Fully configured dataset_schema.json and output_schema.json for export to JSON, CSV, Excel, XML, or webhooks.

---

📥 Input Parameters

Parameter	Type	Required	Default	Description
mode	string	No	"profile"	Primary mode: "profile" (User profile), "post" (Thread URL), or "search" (Keyword search).
username	string	No	"instagram"	Threads account handle to scrape (e.g. "instagram", "zuck", "openai").
searchQuery	string	No	"artificial intelligence"	Search keyword or topic query when using search mode.
startUrls	array	No	[]	List of direct Threads URLs (profile, post, or search URLs).
maxItems	integer	No	50	Maximum number of posts / records to extract.
includeReplies	boolean	No	false	When true, extracts replies and comment threads in addition to top-level posts.
headless	boolean	No	true	Runs browser automation in headless mode.
proxyConfiguration	object	No	{ "useApifyProxy": true }	Proxy settings. Residential proxies recommended for high volume scraping.

Sample Input JSON

{
  "mode": "profile",
  "username": "instagram",
  "maxItems": 25,
  "includeReplies": false,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

📤 Output Data Format

Each scraped item is saved directly to the Apify dataset in structured JSON format. Below is an example record:

{
  "id": "3967923927276492693",
  "code": "DcQ5cn1FpeV",
  "url": "https://www.threads.net/@instagram/post/DcQ5cn1FpeV",
  "text": "sorry i didn’t respond… sent you a reel instead",
  "author": "instagram",
  "authorName": "Instagram",
  "authorId": "63404918397",
  "authorProfilePic": "https://instagram.fixm3-1.fna.fbcdn.net/v/t51.82787-19/551831784_17922536550118398_7111076689237569379_n.jpg",
  "authorFollowers": 38176763,
  "authorBio": "Discover what's new on Instagram 🔎✨",
  "authorIsVerified": true,
  "likeCount": 2603,
  "replyCount": 251,
  "repostCount": 116,
  "quoteCount": 15,
  "reshareCount": 51,
  "images": [],
  "videos": [],
  "mediaType": 19,
  "isReply": false,
  "isPinned": false,
  "replyToAuthor": "",
  "postedAt": "2026-08-20T13:43:34.000Z",
  "scrapedAt": "2026-08-21T07:54:34.607Z"
}

---

🎯 Use Cases

1. Brand Sentiment & Social Listening: Track audience engagement, brand mentions, and sentiment across Threads discussions.
2. Influencer Discovery & Outreach: Identify high-performing creators, analyze follower count growth, and measure engagement ratios.
3. Viral Trend Analysis: Discover emerging topics, hashtags, and viral content strategies in real time.
4. Competitor Benchmarking: Monitor competitor post frequencies, messaging strategies, and audience interaction metrics.

---

💡 Tips & Best Practices

• Residential Proxies: Threads employs rate-limiting on high-frequency requests. Always configure Apify Residential Proxies (RESIDENTIAL proxy group) for smooth runs.
• Direct URLs: You can provide any mix of user profiles, post links, or search URLs in the startUrls field.
• Export Options: Export datasets instantly to JSON, CSV, Excel, or consume records programmatically via Apify API.

---

📄 License

ISC