Instagram Highlights Scraper

Instagram Highlights Scraper

Instagram Highlights Scraper is a production-ready Apify actor that extracts Instagram story highlights from public profiles at scale. It solves the manual, time-consuming process of checking profiles or screen recording by automatically collecting highlight titles, IDs, cover images, and statuses from each target. Built for marketers, developers, data analysts, and researchers, this Instagram highlights downloader-style workflow helps you export structured data fast for competitor research, brand monitoring, content analysis, and influencer tracking.

What data / output can you get?

Below are the exact fields this actor streams to the Apify dataset in real time. You can export results in JSON or CSV.

Data type	Description	Example value
input_url	The profile URL that was processed	https://www.instagram.com/swarnika.verma_/
username	Resolved Instagram username	swarnika.verma_
user_id	Instagram numeric user ID	72037592921
type	Static record type for traceability	instagram_highlights
id	Unique highlight identifier	highlight:18069978917514346
title	Highlight title as shown on the profile	Luxe🛍️
cover_media	URL of the highlight cover image	https://scontent-iad3-1.cdninstagram.com/v/t51.2885-15/...
success	Whether the highlight metadata was scraped successfully	true
error	Error message if scraping failed; null on success	null
timestamp	UTC ISO timestamp when the item was produced	2026-04-03T10:15:30Z

Notes:

• Results stream item-by-item as highlights are found (real-time dataset updates).
• You can export datasets as JSON or CSV from the Apify platform.
• Some fields may be null when data isn’t available (e.g., cover_media if Instagram doesn’t return a cover image).

Key features

• ⚡ Real-time data streaming Items are pushed to the Apify dataset immediately as they’re discovered, enabling live dashboards and rapid automations.

• 🛡️ Smart anti-blocking with proxy fallbacks Automatic fail-fast detection on HTTP 429/403 with stepwise fallback from no proxy to datacenter, then to residential proxies. Residential mode includes up to 3 retries and “sticky” behavior for stability across remaining URLs.

• 🔁 Robust retry & backoff logic Built-in exponential backoff and randomized delays reduce detection and improve reliability on large batches.

• 📦 Structured outputs for analytics Clean, consistent records with fields like input_url, username, id, title, cover_media, success, error, and timestamp are ready for pipelines and analytics tools.

• 📈 Bulk input support Accepts a list of Instagram profile URLs, usernames (with or without @), or highlight shortcodes. Ideal for Instagram highlights bulk downloader workflows and multi-account monitoring.

• 🔍 No login required (public profiles) Works without cookies or authentication on publicly accessible Instagram profiles, acting as a lightweight Instagram highlights extractor for metadata.

• 🧰 Apify-native reliability Built with the Apify Python runtime, using Actor.push_data and the default dataset. Production-friendly logs document strategy, fallback behavior, and result summaries.

How to use Instagram Highlights Scraper - step by step

1. Sign in to your Apify account and open the Instagram Highlights Scraper actor.

2. Add input targets in startUrls:

   • Full profile URLs (https://www.instagram.com/username)
   • Usernames (username or @username)
   • Highlight shortcodes (ABC123DEF45)

3. Configure proxyConfiguration as needed:

   • You can start with your selection (e.g., Apify Proxy on/off).
   • On 429/403 blocks, the actor automatically falls back: no proxy → datacenter → residential (with retries and sticky mode).

4. Start the run. The actor loads each profile, extracts required tokens, resolves the user ID, then fetches the highlights tray via Instagram’s GraphQL endpoint.

5. Watch real-time logs and data. Items stream to the dataset immediately. Logs show the proxy strategy, retries, and per-item status.

6. Download your results. Export the dataset in JSON or CSV and integrate with your analytics or archiving workflows.

Pro tip: Use the cover_media URLs from the dataset to save Instagram highlights online or download Instagram highlight covers to PC using a simple follow-up downloader in your automation stack.

Use cases

Use case name	Description
Marketing & branding analysis	Analyze highlight titles and covers to benchmark brand storytelling and content themes across competitors.
Competitor & brand monitoring	Track how competitors evolve highlight collections over time for promotions and campaigns.
Influencer tracking & audits	Export Instagram highlights across influencers to review sponsored content, evergreen topics, and brand alignments.
Content backup & archiving	Build an Instagram story highlights archiver pipeline to snapshot highlight metadata for compliance or history.
Academic & social research	Collect structured highlight datasets across categories, geographies, and time for research and trend analysis.
Data enrichment for dashboards	Feed structured highlight metadata (IDs, titles, cover images, timestamps) into BI tools for reporting.

Why choose Instagram Highlights Scraper?

Instagram Highlights Scraper prioritizes precision, reliability, and automation for public highlight metadata extraction.

• ✅ Accurate, structured outputs designed for analytics (JSON/CSV)
• 🚀 Scales across many profiles with bulk inputs and resilient retries
• 🛡️ Production-grade anti-blocking: proxy fallback with residential “sticky” mode
• 🔧 Developer-friendly Apify actor with real-time dataset streaming
• 🔒 Public-profile only operation (no login, no cookies)
• 📊 Ideal for Instagram highlights viewer and downloader workflows where you extract Instagram highlights URLs for downstream tools

In short: a stable, production-ready Instagram highlights scraper tool that outperforms fragile browser extensions and manual methods.

Is it legal / ethical to use Instagram Highlights Scraper?

Yes — when used responsibly. This actor targets public Instagram profiles and does not access private accounts or authenticated areas.

Guidelines:

• Only process publicly available data and respect platform terms.
• Use results for legitimate purposes (e.g., research, analysis, archiving).
• Comply with applicable regulations (e.g., GDPR/CCPA) and your organization’s policies.
• Do not use data for spam or prohibited activities. Consult your legal team for edge cases.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://www.instagram.com/mrbeast/",
    "@instagram"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Parameters

• startUrls (array, required) Description: Add one or more targets — each line is one input. Accepted: full profile URL (https://www.instagram.com/username), username (username or @username), or highlight shortcode (ABC123DEF45). The actor resolves each to the profile and scrapes all highlights (title, ID, cover image, success/error, timestamp). Default/Prefill: ["https://www.instagram.com/mrbeast/"]

• proxyConfiguration (object, optional) Description: Choose which proxies to use. Strategy: start with your selection (e.g., no proxy or Apify proxy). On HTTP 429 or 403 (platform block), the actor fails fast and falls back: first to datacenter, then to residential. Residential gets up to 3 retries with a new proxy URL each time; once residential is used, it stays in "sticky" mode for all remaining URLs so the run stays stable. Default/Prefill: {"useApifyProxy": true}

Example JSON output

[
  {
    "input_url": "https://www.instagram.com/swarnika.verma_/",
    "username": "swarnika.verma_",
    "user_id": "72037592921",
    "type": "instagram_highlights",
    "id": "highlight:18069978917514346",
    "title": "Luxe🛍️",
    "cover_media": "https://scontent-iad3-1.cdninstagram.com/v/t51.2885-15/528310306_1486885775636090_4883732409687731720_n.jpg?...",
    "success": true,
    "error": null,
    "timestamp": "2026-04-03T10:15:30Z"
  },
  {
    "input_url": "https://www.instagram.com/private_or_invalid/",
    "username": "private_or_invalid",
    "user_id": null,
    "type": "instagram_highlights",
    "id": null,
    "title": null,
    "cover_media": null,
    "success": false,
    "error": "Residential proxy failed after 3 attempts",
    "timestamp": "2026-04-03T10:16:10Z"
  }
]

Notes:

• Fields that may be null: user_id, id, title, cover_media, error (on success).
• success indicates whether the highlight metadata was collected successfully for that item.

FAQ

Can I download Instagram highlights with this tool?

Yes for metadata and cover images via URLs. This actor extracts highlight IDs, titles, and cover_media URLs so you can save Instagram highlights online or download Instagram highlight covers using a downstream downloader. It does not retrieve full story media inside each highlight.

Does it work on private accounts?

No. The scraper targets public profiles only. Private profiles and authenticated content are out of scope.

Is login required to run the scraper?

No. The actor does not use cookies or login. It fetches publicly available highlight metadata as an Instagram story highlights scraper.

How many results can I extract per run?

You can process multiple profiles in one run via startUrls. The actor collects all available highlight entries it can access per public profile, making it suitable to export Instagram highlights across many accounts.

Can I export results to CSV or JSON?

Yes. Results stream to the default Apify dataset, which you can download as JSON or CSV for analysis or integration.

What happens if Instagram rate-limits or blocks requests?

The actor detects HTTP 429/403 and automatically falls back from no proxy to datacenter, then to residential proxies with retries. Once residential is used, it remains in sticky mode to keep runs stable.

Is this an Instagram highlights downloader Chrome extension?

No. It’s a cloud-based Instagram highlights scraper tool built as an Apify actor. You can still download Instagram highlights to PC by using the extracted cover_media URLs in your own workflow.

What data fields are included in the output?

Each item includes input_url, username, user_id, type, id, title, cover_media, success, error, and timestamp. These fields enable you to extract Instagram highlights URLs and export Instagram highlights for reporting or archiving.

Closing CTA / Final thoughts

Instagram Highlights Scraper is built for fast, reliable highlight metadata extraction from public Instagram profiles. It delivers structured IDs, titles, cover images, and timestamps with real-time streaming and smart proxy fallbacks.

Whether you’re a marketer, developer, analyst, or researcher, you can use this Instagram highlights extractor to power competitor research, brand monitoring, content analysis, or archival workflows. Developers can plug the dataset into automation pipelines to save Instagram highlights online or drive an Instagram highlights bulk downloader process for cover images. Start extracting smarter, structured highlight insights at scale today.