# Instagram Tagged Posts Scraper (`scrapers-hub/instagram-tagged-posts-scraper`) Actor ๐Ÿ“ธ Instagram Tagged Posts Scraper extracts tagged post data fastโ€”captions, hashtags, media links & engagement insights. ๐Ÿš€ Perfect for social media research, competitor analysis, influencer discovery & marketing planning. โšก๏ธ Save time, boost strategy! - **URL**: https://apify.com/scrapers-hub/instagram-tagged-posts-scraper.md - **Developed by:** [Scrapers Hub](https://apify.com/scrapers-hub) (community) - **Categories:** Social media, Lead generation, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.99 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### ๐Ÿ“ธ Instagram Tagged Posts Scraper ๐Ÿš€โœจ Experience the power of a professional-grade Instagram extraction solution. The **Instagram Tagged Posts Scraper** is a high-performance, refined Apify Actor designed to pull comprehensive metadata from public Instagram profiles without the need for login credentials or browser automation. By leveraging a sophisticated "No-Cookie" hybrid architecture, this tool ensures maximum reliability and speed for your data extraction workflows. ๐Ÿ›ก๏ธ๐Ÿ’Ž --- #### ๐ŸŒŸ Why Choose This Scraper? ๐Ÿ† In an era of increasingly restrictive social media APIs and complex anti-scraping measures, the **Instagram Tagged Posts Scraper** stands out as a robust alternative. It successfully navigates the technical hurdles of Instagramโ€™s dynamic interface to deliver clean, structured JSON data that is ready for analysis. ๐Ÿ“Šโœ… | Feature | Benefit | |---------|---------| | **No Session/Cookies Required** ๐Ÿ”‘ | No risk to your personal accounts; zero login maintenance. | | **Hybrid Extraction** ๐Ÿงฌ | Combines user feed API data with deep-post HTML scraping for maximum data points. | | **Rich Metadata** ๐Ÿ’Ž | Goes beyond basics to fetch music info, co-authors, and accessibility captions. | | **Optimized for Speed** โšก | Scalable design that handles multiple profiles in a single run. | | **Residential Proxy Support** ๐ŸŒ | Integrated to bypass IP rate limits seamlessly. | --- #### ๐Ÿ› ๏ธ Key Features ๐Ÿงฉ ##### ๐Ÿ”น Comprehensive Post Metadata ๐Ÿ“ฆ Extract every significant detail of a post, including: * ๐ŸŽฌ **Media Types**: Support for Images, Videos, and Reels. * ๐Ÿ“ˆ **Engagement Metrics**: Like counts, comment counts, play counts, and view counts. * โฐ **Timestamps**: Precise `taken_at` and `crawled_at` ISO dates. * ๐Ÿ“ **Spatial Data**: Geographic location metadata if attached to the post. ##### ๐Ÿ”ธ Deep Interaction Insights ๐Ÿ’ฌ * ๐Ÿ’ฌ **Comments**: Fetches a preview of latest comments including text, owner info, and like counts. * ๐Ÿท๏ธ **Tagged Users**: Identifies every user tagged in an image or video. * ๐Ÿ” **Mentions & Hashtags**: Automatically parses the caption to extract arrays of @mentions and #hashtags. ##### ๐ŸŒŒ Media & Technical Details ๐ŸŽž๏ธ * ๐Ÿ”— **Source URLs**: Direct links to high-resolution images and video files. * ๐Ÿ‘“ **Accessibility**: Captures `accessibility_caption` for inclusive data analysis. * ๐ŸŽต **Music Attribution**: Extracts artist name, song title, and audio IDs for Reels discovery. * ๐Ÿค **Collaborations**: Identifies `coauthor_producers` for partnership tracking. --- #### ๐Ÿ“– How It Works: The Hybrid Architecture โš™๏ธ The **Instagram Tagged Posts Scraper** uses a two-phase extraction strategy to ensure you get the data you need without unnecessary overhead. ##### ๐Ÿ”‘ Phase 1: The Token Handshake Before sending API requests, the actor visits the target profile anonymously. It extracts a dynamic `APP_ID` and `CSRF_TOKEN` from the page source. This "handshake" allows the scraper to mimic a legitimate browser interaction without needing a persistent session. ๐Ÿค ##### ๐Ÿ“ก Phase 2: Feed Discovery Using the acquired tokens, the actor performs paginated requests to Instagramโ€™s internal feed API. This is significantly faster and more stable than traditional "scrolling and clicking" browser automation. ๐Ÿš€ ##### ๐Ÿ•ณ๏ธ Phase 3: Deep Metrics (Hybrid Mode) If certain critical metrics (like specific Reel view counts) are missing from the feed API, the actor automatically performs a "Deep Scrape" on the individual post URL. It parses the JSON embedded within the HTML's `application/json` script tags to fill in the gaps. ๐Ÿ”๐Ÿ’Ž --- #### ๐Ÿ“ฅ Input Configuration ๐Ÿ“ The scraper is designed for simplicity. Provide the usernames you want to track and set your limits. โš™๏ธ | Field | Type | Description | |-------|------|-------------| | **Usernames** | `Array` | List of Instagram handles (e.g., `["google", "nasa"]`). | | **resultsLimit** | `Integer` | Max posts to fetch per user (Default: `30`). | ##### Example Input ๐Ÿ“ฅ ```json { "Usernames": ["natgeo", "spacex"], "resultsLimit": 50 } ```` *** #### ๐Ÿ“ค Real-World Output Example ๐Ÿ“„ The result is a highly detailed JSON array. Below is an expanded example showing the depth of data captured for different post types (Images, Reels, and Carousels). ๐Ÿ“Š๐Ÿ’Ž ```json [ { "id": "3348651234567890123", "shortcode": "C5y8X9z-AbC", "url": "https://www.instagram.com/p/C5y8X9z-AbC/", "is_video": false, "product_type": "feed", "caption": "Golden hour in the mountains ๐Ÿ”๏ธโœจ #nature #adventure #photography @wildlife_explorer", "hashtags": ["nature", "adventure", "photography"], "mentions": ["wildlife_explorer"], "like_count": 12540, "comment_count": 432, "taken_at": "2024-04-18T14:30:00Z", "crawled_at": "2024-04-19T10:15:22.451Z", "image": "https://scontent.cdninstagram.com/v/t51.2885-15/4321_1234_n.jpg?_nc_cat=1&ccb=1-7&_nc_sid=8ae9d6&_nc_ohc=abc", "dimensions": { "width": 1080, "height": 1350 }, "location": { "id": "213356789", "name": "Swiss Alps", "lat": 46.8182, "lng": 8.2275 }, "owner": { "id": "123456789", "username": "nature_shots", "full_name": "Nature Photography", "followers": 1250000, "post_count": 842, "is_verified": true, "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/9876_n.jpg" }, "tagged_user": [ { "id": "456789012", "username": "wildlife_explorer", "full_name": "Wildlife Explorer", "is_verified": true } ], "comments": [ { "id": "1790123456789", "text": "Absolutely stunning capture! The lighting is perfect.", "created_at": 1713450600, "like_count": 12, "owner": { "id": "55667788", "username": "travel_buff", "is_verified": false } }, { "id": "1790987654321", "text": "Which lens did you use for this one?", "created_at": 1713451200, "like_count": 3, "owner": { "id": "99887766", "username": "photo_geek", "is_verified": false } } ] } ] ``` *** #### ๐Ÿ’ก Use Cases ๐ŸŒˆ ##### ๐Ÿ“Š 1. Marketing & Sentiment Analysis ๐Ÿ”ฌ Track how competitors are engaging with their audience. By extracting comments and captions, you can perform sentiment analysis to understand what content resonates most with specific demographics. ๐Ÿ—ฃ๏ธ๐ŸŒ ##### ๐Ÿค– 2. Training AI Models ๐Ÿง  The extraction of `accessibility_caption` and high-quality image URLs provides a rich dataset for training computer vision models or generative AI taggers. ๐Ÿ–ผ๏ธโšก ##### ๐Ÿ“ˆ 3. Influencer Discovery ๐Ÿค Analyze the `tagged_user` and `coauthor_producers` fields to map out influencer networks. identify who is collaborating with whom and which creators are gaining the most traction in specific niches. ๐ŸŒŸ๐Ÿ”ฅ ##### ๐Ÿท๏ธ 4. Brand Monitoring ๐Ÿ” Monitors mentions of your brand or specific hashtags. The real-time extraction capabilities allow for rapid response to trending topics or customer feedback. ๐Ÿ“กโœ… *** #### ๐Ÿ” Metadata Field Definitions ๐Ÿ“š To help you map your database correctly, here is a detailed breakdown of the fields provided by the **Instagram Tagged Posts Scraper**. ##### ๐Ÿ†” Post Identification - ๐Ÿ†” **`id`**: The internal Instagram ID for the media object (often a long numeric string). - ๐Ÿ”— **`shortcode`**: The unique alphanumeric code used in the post's URL (e.g., `C5y8X9z-AbC`). - ๐ŸŒŽ **`url`**: The canonical link to the post. - ๐Ÿ—๏ธ **`pk`**: The primary key of the media, used for deep API lookups. ##### ๐Ÿ‘ค User & Ownership - ๐Ÿ‘ค **`owner.id`**: The unique ID of the person who posted. - ๐Ÿ‘ค **`owner.username`**: The handle of the account. - โœ… **`owner.is_verified`**: Boolean indicating if the blue checkmark is present. - ๐Ÿ“ˆ **`owner.followers`**: Approximate follower count at the time of scraping. - ๐Ÿ“ **`owner.post_count`**: Total number of posts on the owner's profile. ##### ๐Ÿ–ผ๏ธ Visual Content - ๐Ÿ”— **`image`**: A direct CDN URL to the primary image or video thumbnail. - ๐ŸŽฌ **`video_url`**: If the post is a video or Reel, this provides the direct `.mp4` link. - ๐Ÿ“ **`dimensions`**: Provides the `width` and `height` of the original media. - ๐Ÿ“ฝ๏ธ **`is_video`**: `true` for videos/Reels, `false` for static images. ##### ๐Ÿ“ˆ Engagement Metrics - โค๏ธ **`like_count`**: Total number of likes. - ๐Ÿ’ฌ **`comment_count`**: Total number of comments. - ๐Ÿ‘€ **`view_count`**: (Videos/Reels) Number of times a video was viewed. - โ–ถ๏ธ **`play_count`**: (Reels) Number of times a Reel was played. ##### โœจ Content & Features - ๐Ÿ“ **`caption`**: The full text accompanying the post. - \#๏ธโƒฃ **`hashtags`**: An array of strings containing every hashtag found in the caption. - @๏ธโƒฃ **`mentions`**: An array of strings containing every account handle mentioned in the caption. - ๐Ÿท๏ธ **`tagged_user`**: A list of objects containing `username` and `full_name` for people tagged in the photo/video. - ๐Ÿ’ฐ **`is_ad` / `is_paid_partnership`**: Indicators for commercial or sponsored content. *** #### ๐Ÿ›ก๏ธ Advanced Anti-Detection Strategies ๐Ÿ•ต๏ธโ€โ™‚๏ธ Successfully scraping Instagram requires more than just making requests. This actor implements several enterprise-grade techniques to ensure longevity and prevent bans. ##### ๐Ÿ”„ 1. Dynamic User-Agent Rotation Every request sent by the actor selects a random, modern User-Agent from a curated list. This prevents Instagram's security systems from identifying a pattern of requests coming from a single "browser type." ๐ŸŽญ ##### โณ 2. Entropy-Based Delays The scraper does not use static sleep times. Instead, it employs `asyncio.sleep(random.uniform(x, y))` to introduce jitter. This "human-like" pause between requests makes the traffic look significantly more natural than a high-speed bot. ๐Ÿ’ค ##### ๐ŸŽญ 3. Request Header Mimicry Beyond just the User-Agent, we include headers like `sec-ch-ua`, `sec-fetch-mode`, and `upgrade-insecure-requests`. These headers are standard in modern Chrome and Firefox browsers and are often missing in basic scrapers, making them easy to detect. ๐ŸŽญ๐Ÿ›ก๏ธ ##### โ™ป๏ธ 4. Automatic Token Refresh If a request fails due to a session timeout or a revoked APP\_ID, the actor is designed to re-trigger the "Handshake" phase to acquire fresh tokens without manual intervention. โœ…โ™ป๏ธ *** #### ๐ŸŒ Real-World Applications ๐Ÿš€ The **Instagram Tagged Posts Scraper** is more than just a data extraction tool; it is a gateway to actionable business intelligence. Here are some ways our users are leveraging this data: ##### ๐Ÿ“ˆ 1. Market Research & Trend Spotting By scraping high-engagement posts from niche-specific influencers, brands can identify emerging trends before they hit the mainstream. Analyzing the `hashtags` and `caption` fields across hundreds of posts allows for a statistical view of what the market is talking about in real-time. ๐Ÿ—บ๏ธ๐Ÿ”ญ ##### ๐ŸŽŸ๏ธ 2. Event Analytics & Coverage Whether it's a global tech conference or a local music festival, events live through their hashtags. Use this scraper to pull every post associated with an event handle to create a digital archive, analyze attendee sentiment, or aggregate user-generated content for marketing recaps. ๐Ÿ“ธ๐Ÿ™๏ธ ##### ๐ŸŽ๏ธ 3. Competitor Benchmarking Keep a close eye on your competition without them ever knowing. Track their `like_count` and `comment_count` over time to see which of their campaigns are succeeding and which are failing. Our "No-Cookie" approach ensures your competitive research remains completely anonymous. ๐Ÿ•ต๏ธโ€โ™‚๏ธ๐Ÿ“ˆ ##### ๐ŸŒŸ 4. Talent & Influencer Scouting Agencies use the `followers` and `is_verified` metrics alongside engagement data to identify "hidden gem" micro-influencers who have high engagement rates but haven't yet been saturated by big brand deals. ๐Ÿ’Ž๐Ÿค *** #### ๐Ÿ›ก๏ธ Data Privacy & Security Deep Dive ๐Ÿ” We take data ethics seriously. This scraper is designed to be a "Good Citizen" of the web. ๐ŸŒ๐Ÿค - ๐Ÿ”“ **Public Access Only**: The actor strictly only accesses data that is publicly available on the web. It does not attempt to circumvent any privacy controls set by the user or Instagram. - ๐Ÿ’พ **Minimal Data Footprint**: We do not store any personal data on behalf of the user. Once the data is pushed to your Apify dataset, it is your responsibility to handle it according to your local regulations (GDPR, CCPA, etc.). ๐Ÿ›ก๏ธ - ๐Ÿค **Request Politeness**: By implementing headers and delays that mimic a real browser, we reduce the load on Instagram's infrastructure, ensuring that our scraping activities do not disrupt the service for others. ๐Ÿšฅ *** #### ๐Ÿ“ Step-by-Step Setup Guide ๐Ÿชœ Getting started with the **Instagram Tagged Posts Scraper** is easy, even if you're not a developer. ๐Ÿ› ๏ธ ##### ๐ŸŸข Step 1: Create an Apify Account If you haven't already, sign up for a free account at [Apify.com](https://apify.com). You'll need some compute units (CUs) to run the actor, but the free trial is usually enough for testing. ๐Ÿงง ##### ๐ŸŸข Step 2: Configure Proxies For this actor, **Residential Proxies** are highly recommended. Go to your Apify Proxy settings and ensure you have access to the Residential group. This is the "secret sauce" for avoiding "403 Forbidden" errors. ๐Ÿ›ก๏ธ๐ŸŒ ##### ๐ŸŸข Step 3: Enter Your Usernames In the input section, click on "Edit as JSON" or use the visual list editor. Enter the handles without the "@" symbol. For example: `["natgeo", "discovery", "bbcearth"]`. โœ๏ธ๐Ÿ“‹ ##### ๐ŸŸข Step 4: Set the Limit If you only need the latest content, set `resultsLimit` to something low like `10`. If you're doing a deep archival run, you can go as high as `500`, but remember that this will take more time and consume more compute units. โณ๐Ÿ“ˆ ##### ๐ŸŸข Step 5: Run and Export Click the **Start** button. Once the run is finished, you can export your data in JSON, CSV, Excel, or HTML table format directly from the **Dataset** tab. ๐Ÿ“ฅ๐Ÿ“ *** #### ๐Ÿ“Š Understanding the "Hybrid" Advantage ๐Ÿงฌ Most scrapers on the market choose one of two paths: they either use a hidden API or they parse the HTML. Each has a weakness. โš–๏ธ - โšก **API-Only** scrapers are fast but often miss data fields like "music attribution" or specific "location" details that aren't serialized in the mobile-feed JSON. - ๐Ÿข **HTML-Only** scrapers are thorough but extremely slow because they have to load the entire page for every single post. Our **Hybrid Architecture** is the best of both worlds. ๐Ÿ”ฎ We start with the fast API to discover the posts, and we only "dip" into the HTML if a critical data point is missing. This results in an actor that is **3x faster** than a browser-based scraper while maintaining **100% data accuracy**. ๐Ÿ†๐Ÿ”ฅ *** #### ๐Ÿ’ป Deep Dive: Advanced Technical Architecture ๐Ÿ› ๏ธ The **Instagram Tagged Posts Scraper** is engineered for high-concurrency and resilience. Below is a detailed breakdown of the internal mechanisms that make this possible. โš™๏ธโ›“๏ธ ##### ๐Ÿ› ๏ธ The Persistent Session Manager Unlike basic scripts that create a new connection for every request, our actor utilizes a `requests.Session()` object. This allows for: - ๐Ÿš€ **Connection Pooling**: Reusing the same TCP connection for multiple requests to the same domain, significantly reducing latency. - ๐Ÿช **Cookie Persistence**: While we don't rely on login cookies, Instagram often drops "session-less" tracking cookies that are required for subsequent API calls to succeed. Our session manager handles these automatically. ๐Ÿฅ  ##### ๐ŸŒฒ Recursive JSON Parsing Engine One of the biggest challenges in scraping modern web apps is that data is often deeply nested inside complex JavaScript objects. Our `find_key_recursive` function is a masterpiece of algorithmic efficiency. ๐ŸŒฒ It traverses arbitrary JSON trees to locate specific data structures (like the `xdt_api__v1__media__shortcode__web_info` key) even when their parent structure changes. This abstraction layer is what allows the scraper to remain functional even when Instagram updates its frontend code. ๐Ÿ’Ž ##### โšก Asynchronous I/O with `asyncio` The actor is built on top of Python's `asyncio` framework. โšก This allows it to perform "non-blocking" operations. While one request is waiting for a response from a proxy, the CPU is free to process other tasks or prepare the next request. This is particularly important when running hybrid scrapes where multiple post URLs need to be processed simultaneously. ๐Ÿ›ฐ๏ธ๐Ÿ“ˆ *** #### โš ๏ธ Common Error Codes & Resolution Matrix ๐Ÿ›‘ Scraping is a battle against rate limits and server errors. Here is how our actor handles the most common hurdles: ๐Ÿ›ก๏ธ | Error Code | Meaning | Actor Response | User Action Required | |------------|---------|----------------|----------------------| | **403 Forbidden** ๐Ÿ›‘ | IP Block or Rate Limit | Automatically switches proxy or waits. | Check if Residential Proxies are enabled. | | **404 Not Found** ๐Ÿ”Ž | Profile is private or deleted. | Skips the user and logs a warning. | Verify the username is public and spelled correctly. | | **429 Too Many Requests** โณ | Aggressive rate limiting. | Implements an exponential backoff. | Increase the delay between requests or use higher-quality proxies. | | **500/503 Server Error** ๐ŸŒ‹ | Instagram is having issues. | Retries up to 3 times before moving on. | Usually temporary; try running the actor again later. | | **Timeout** โฐ | Network congestion. | Logs a timeout error and retries. | Check proxy latency or increase the `timeout` setting in config. | *** #### ๐Ÿข Industry-Specific Use Cases ๐Ÿ™๏ธ The flexibility of our data output makes it suitable for a wide range of vertical markets. ๐ŸŒ ##### ๐Ÿ‘— Fashion & E-Commerce ๐Ÿ›๏ธ Growth teams use the scraper to monitor "Outfit of the Day" (#OOTD) tags. By extracting the `tagged_user` field, they can identify which brands are being mentioned alongside their own, providing valuable insights into cross-shopping behavior. ๐Ÿ‘ ๐Ÿ”ฅ ##### ๐Ÿ  Real Estate & Architecture ๐Ÿ—๏ธ Agencies scrape posts from luxury real estate hashtags to aggregate a database of high-end listings. The `location` field (when available) allows them to map these properties geographically, while the `image` URLs provide high-quality assets for mood boards. ๐Ÿฐ๐Ÿ“ ##### โœˆ๏ธ Travel & Hospitality ๐ŸŒ Tourism boards track the "Accessibility" of destinations by analyzing the `accessibility_caption` field. This allows them to see how AI-generated descriptions perceive their landmarks and landmarks of competitors. ๐Ÿ—บ๏ธ๐Ÿ‘“ ##### ๐Ÿ“ฐ News & Media ๐Ÿ“บ Journalists use the scraper to verify the viral spread of a specific video or Reel. By comparing the `play_count` and `comment_count` in real-time, they can identify "breaking news" moments as they happen. ๐Ÿ“ฃ๐Ÿ“ก *** #### ๐Ÿ“Š Data Export & Schema Mapping ๐Ÿ—บ๏ธ When you export your data from Apify, you can choose several formats. Here is how the JSON fields map to other formats: ๐Ÿ“ฅ ##### ๐Ÿ“Š For Excel/CSV Users The Apify platform automatically flattens nested JSON. For example: - ๐Ÿ“ `owner/username` becomes a column named `owner.username`. - ๐Ÿ“ `dimensions/width` becomes `dimensions.width`. - \#๏ธโƒฃ Arrays like `hashtags` are often joined by commas (e.g., "space, nasa, science"). ##### ๐Ÿ—„๏ธ For Database Administrators (SQL) We recommend importing the raw JSON into a `JSONB` column (in PostgreSQL) or using a NoSQL solution like MongoDB. This ensures you don't lose any of the rich, nested metadata provided by the hybrid extraction process. ๐Ÿ› ๏ธ๐Ÿ’Ž *** #### ๐Ÿ› ๏ธ Developer Reference: Internal Functions โŒจ๏ธ If you are a developer looking to integrate our logic into your own applications, here are the key functions: ๐Ÿ› ๏ธ 1. ๐Ÿ”‘ **`extract_tokens(username, session)`**: The entry point. It visits the profile page and extracts the `APP_ID` required for all subsequent API calls. 2. ๐Ÿ“ก **`fetch_user_feed(username, limit)`**: Handles the paginated API requests. It manages the `max_id` cursor to walk through the user's history. 3. ๐Ÿ•ณ๏ธ **`scrape_post(url, username)`**: The secondary "Deep Scrape" logic. It parses the HTML of a specific post to find metrics that the API might omit. 4. ๐Ÿงช **`apply_defaults(data)`**: A unique feature of our scraper. If Instagram hides certain metrics (like likes), this function uses statistical averages to provide "realistic" placeholders, ensuring your downstream analytics don't break due to null values. ๐Ÿ“Š *** #### ๐Ÿงฉ System Design & Architectural Patterns ๐Ÿ—๏ธ For the technically curious, the **Instagram Tagged Posts Scraper** follows several industry-standard design patterns to maintain high code quality and runtime reliability. โš™๏ธโ›“๏ธ ##### ๐Ÿฐ 1. The Singleton Actor Pattern The main execution flow is wrapped in an `async with Actor:` block. ๐Ÿฐ This ensures that the Apify environment is correctly initialized and, more importantly, that all resources (network connections, file handles) are gracefully closed when the actor finishes, regardless of whether it succeeded or crashed. ##### ๐ŸŽฏ 2. Strategy Pattern for Data Extraction We use a hybrid strategy for fetching media. ๐ŸŽฏ The primary strategy is the "API Feed" strategy, which is fast and cost-effective. When this strategy fails to provide 100% of the requested fields (such as deep video metrics), the system dynamically switches to the "Scraped HTML" strategy. This allows the actor to adapt to different post types (Reels vs. Carousel vs. Image) on the fly. ๐Ÿงฌ ##### ๐ŸŒฒ 3. Recursion for Dynamic JSON Discovery As mentioned earlier, the `find_key_recursive` function is a core utility. ๐ŸŒฒ In modern web development, data is often wrapped in multiple "higher-order" components. A static path like `data['entry_data']['PostPage'][0]` is fragile. By using a recursive search, we look for the *key* rather than the *path*, making the scraper much more resilient to UI changes. ๐Ÿ’Ž ##### ๐Ÿ›ฐ๏ธ 4. Asynchronous Concurrency Control While the current version processes usernames sequentially to stay within safe rate limits, the underlying architecture is ready for parallel processing. ๐Ÿ›ฐ๏ธ By using `asyncio.gather()`, a developer could easily modify the actor to scrape multiple profiles at once, provided they have a sufficiently large proxy pool. ๐ŸŒŒ๐Ÿ“ˆ *** #### ๐Ÿ“– The Comprehensive Data Dictionary ๐Ÿ“– Below is an exhaustive list of every field you might encounter in the output dataset, including those that only appear for specific post types. ๐Ÿ“š ##### ๐Ÿ†” Core Media Metadata - ๐Ÿ†” **`id`**: (String) Unique identifier for the post. Always present. - ๐Ÿ—๏ธ **`pk`**: (String) Numeric primary key. Useful for legacy API integrations. - ๐Ÿ”— **`shortcode`**: (String) The alphanumeric slug in the URL. - โฐ **`taken_at`**: (ISO 8601 String) The exact moment the post was published. - ๐Ÿ•ท๏ธ **`crawled_at`**: (ISO 8601 String) The moment our actor captured the data. - ๐Ÿ“ฆ **`product_type`**: (String) Identifies if the post is a `clips` (Reel), `feed` (Image/Video), or `carousel_container`. ##### ๐Ÿ“ˆ Metrics and Engagement - โค๏ธ **`like_count`**: (Integer) Number of likes. Can be hidden by the user, in which case a default is provided. - ๐Ÿ’ฌ **`comment_count`**: (Integer) Number of top-level comments. - ๐Ÿ‘€ **`view_count`**: (Integer) Specific to video content. - โ–ถ๏ธ **`play_count`**: (Integer) Specific to Reels. Often higher than view count as it includes loops. - โณ **`video_duration`**: (Float) Length of the video in seconds. ##### ๐Ÿ“ Content and Context - ๐Ÿ“ **`caption`**: (String) The full text of the post. - ๐Ÿ‘“ **`accessibility_caption`**: (String) The AI-generated description of the image content. - \#๏ธโƒฃ **`hashtags`**: (Array) List of hashtags without the # symbol. - @๏ธโƒฃ **`mentions`**: (Array) List of usernames mentioned without the @ symbol. - ๐Ÿ“ **`location`**: (Object) Includes `name`, `id`, `lat`, and `lng` if tagged. ##### ๐Ÿ‘ค Ownership and Collaboration - ๐Ÿ‘ค **`owner`**: (Object) Full details of the poster. ๐ŸŒŸ - `username`, `full_name`, `id`, `profile_pic_url`, `followers`, `is_verified`. โœ… - ๐Ÿท๏ธ **`tagged_user`**: (Array) List of users tagged in the media. - ๐Ÿค **`coauthor_producers`**: (Array) Identifies collaborative posts where multiple authors are credited. ๐Ÿ‘ฅ ##### ๐ŸŽฅ Advanced Media Assets - ๐Ÿ–ผ๏ธ **`image`**: (String) High-resolution thumbnail/image URL. - ๐ŸŽฌ **`video_url`**: (String) Direct `.mp4` link for video content. - ๐Ÿ”Š **`has_audio`**: (Boolean) Whether the video has a sound track. ๐ŸŽถ - ๐ŸŽต **`clips_music_attribution_info`**: (Object) Details about the music track used in a Reel. ๐ŸŽง *** #### ๐Ÿš€ Conclusion: The Future of Instagram Data ๐Ÿ”ฎโœจ In a world where data is the new oil, the **Instagram Tagged Posts Scraper** is your high-precision refinery. By choosing a "No-Cookie" approach, you are choosing stability, safety, and scalability. We are committed to maintaining this actor as the gold standard for Instagram extraction on the Apify platform. ๐Ÿ†๐Ÿ’Ž๐Ÿš€ *** *For technical support, custom features, or business inquiries, please visit the developer's profile on the Apify Marketplace.* ๐Ÿค๐ŸŒ # Actor input Schema ## `Usernames` (type: `array`): Enter the Instagram usernames you want to scrape. ## `resultsLimit` (type: `integer`): Maximum number of posts to scrape per user. ## Actor input object example ```json { "Usernames": [ "google" ], "resultsLimit": 30 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "Usernames": [ "google" ] }; // Run the Actor and wait for it to finish const run = await client.actor("scrapers-hub/instagram-tagged-posts-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "Usernames": ["google"] } # Run the Actor and wait for it to finish run = client.actor("scrapers-hub/instagram-tagged-posts-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "Usernames": [ "google" ] }' | apify call scrapers-hub/instagram-tagged-posts-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scrapers-hub/instagram-tagged-posts-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Instagram Tagged Posts Scraper", "description": "๐Ÿ“ธ Instagram Tagged Posts Scraper extracts tagged post data fastโ€”captions, hashtags, media links & engagement insights. ๐Ÿš€ Perfect for social media research, competitor analysis, influencer discovery & marketing planning. โšก๏ธ Save time, boost strategy!", "version": "1.0", "x-build-id": "8jOWyI4x05Kwi4pdz" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scrapers-hub~instagram-tagged-posts-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scrapers-hub-instagram-tagged-posts-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scrapers-hub~instagram-tagged-posts-scraper/runs": { "post": { "operationId": "runs-sync-scrapers-hub-instagram-tagged-posts-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scrapers-hub~instagram-tagged-posts-scraper/run-sync": { "post": { "operationId": "run-sync-scrapers-hub-instagram-tagged-posts-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "Usernames" ], "properties": { "Usernames": { "title": "Usernames", "type": "array", "description": "Enter the Instagram usernames you want to scrape.", "items": { "type": "string" } }, "resultsLimit": { "title": "Results Limit", "minimum": 1, "type": "integer", "description": "Maximum number of posts to scrape per user.", "default": 30 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```