Instagram Highlights Scraper

Instagram Highlights Scraper

The Instagram Highlights Scraper is a production-ready Apify actor that automatically collects highlight metadata from public Instagram profiles. It solves the pain of manual checks or screen recordings by extracting structured highlight IDs, titles, cover image URLs, and profile identifiers at scale. Built for marketers, developers, data analysts, and researchers, this instagram story highlights scraper streams results in real time and supports resilient proxy strategies for reliability. Use it to extract instagram highlights for analysis, monitoring, and automated workflows across many accounts.

What data / output can you get?

Below are the exact fields the actor pushes to the Apify dataset during a run. Results stream in real time and can be exported to JSON or CSV.

Data type	Description	Example value
input_url	The processed Instagram profile URL	https://www.instagram.com/swarnika.verma_/
username	Resolved Instagram username	swarnika.verma_
user_id	Instagram user ID (if resolved)	72037592921
type	Static type label for records	instagram_highlights
id	Unique highlight identifier	highlight:18069978917514346
title	Title of the highlight	Luxe🛍️
cover_media	URL of the highlight cover image	https://scontent-iad3-1.cdninstagram.com/v/t51.2885-15/...
success	Indicates if the highlight record was scraped successfully	true
error	Error message if something failed, otherwise null	null
timestamp	UTC ISO-8601 timestamp when the item was created	2026-04-15T12:34:56+00:00

Notes:

• cover_media may be null if the cover image cannot be resolved.
• user_id can be null if Instagram’s response doesn’t include it for the profile.
• error contains a descriptive message for failures (e.g., input format issues), and success will be false for those items.

Key features

• ⚡ Real-time data streaming
  Each highlight item is pushed to the Apify dataset immediately as it’s found, enabling fast pipelines and incremental downloads.

• 🛡️ Smart proxy fallback (fail-fast)
  Automatic block detection on HTTP 429/403 with an adaptive policy: start with no proxy, fall back to datacenter, then to residential proxies with up to 3 attempts. Once residential is used, it stays “sticky” for the rest of the run.

• 📈 Batch scraping at scale
  Feed multiple profiles via startUrls to bulk download instagram highlights metadata across many accounts in one run.

• 🧾 Clean, structured schema
  Consistent fields (input_url, username, user_id, type, id, title, cover_media, success, error, timestamp) make it easy to export instagram highlights into analytics dashboards.

• 🔓 Public-profile friendly (no login required)
  Works against publicly available profiles without cookies or authentication, ideal for an instagram highlights viewer workflow focused on metadata.

• 🐍 Python-based & automation-ready
  Implemented in Python and deployable on Apify. Integrate via the Apify platform and API in your pipelines if you’re building a python instagram highlights scraper workflow.

• ♻️ Resilient rate-limit handling
  Built-in backoff and retries reduce flaky runs, improving reliability for instagram highlights archiver and backup use cases.

How to use Instagram Highlights Scraper - step by step

1. Create or log in to your Apify account.
2. Open the Instagram Highlights Scraper actor in the Apify Console.
3. Add input data:
   • Use startUrls as a list of strings.
   • Accepted formats: full profile URLs (https://www.instagram.com/username), plain usernames (username), or @username.
   • Tip: Use full profile URLs or plain usernames for best results.
4. (Optional) Configure proxyConfiguration. By default, the actor uses Apify Proxy and automatically falls back to residential proxies on blocks.
5. Start the run. The actor:
   • Loads each profile,
   • Resolves tokens,
   • Fetches highlight tray data,
   • Streams each highlight to the dataset in real time.
6. Monitor progress in the run logs; you’ll see items being pushed with their IDs and titles.
7. Download results from the dataset in JSON or CSV for analysis or to save instagram highlights cover images using the provided URLs.

Pro Tip: Automate recurring jobs and connect the dataset to your workflows (e.g., Make, n8n, custom ETL) for an instagram highlights download tool pipeline that exports highlight metadata on a schedule.

Note on shortcodes: While the input UI mentions highlight shortcodes, the current implementation validates usernames/URLs only. Shortcodes will produce an error item indicating that extracting a username from a shortcode requires additional API calls.

Use cases

Use case name	Description
Marketing & branding analysis	Compare highlight themes and naming conventions to improve content strategy and storytelling.
Competitor monitoring	Track new or updated highlights to benchmark campaigns and offers across competitors.
Brand & creator audits	Export instagram highlights metadata for reporting on coverage and consistency across profiles.
Social media research	Build datasets of highlight IDs, titles, and cover images for trend analysis at scale.
Data pipelines (API/ETL)	Schedule runs and feed structured outputs (JSON/CSV) into BI tools and research dashboards.
Content backup (metadata)	Use it as an instagram highlights archiver for titles and cover images to maintain lightweight backups.
Quality assurance	Validate presence and naming of highlights across multiple brand profiles automatically.

Why choose Instagram Highlights Scraper?

Built for precision, resilience, and automation, this instagram highlights extractor focuses on clean metadata and stable operations.

• ✅ Accurate, structured outputs aligned to a clear, consistent schema
• 🚀 Scalable multi-profile runs via startUrls with real-time streaming
• 🛡️ Robust block handling with no-proxy → datacenter → residential fallback and sticky residential mode
• 🔓 No login needed for public profiles, minimizing setup and risk
• 🐍 Python implementation and Apify-native deployment for easy integration into pipelines
• 💾 Easy exports to JSON and CSV for fast ingestion into analytics and storage tools
• 🔍 Ideal for marketers, developers, analysts, and researchers who need a reliable instagram highlights backup tool for metadata

In short, it outperforms manual methods and unstable browser extensions by delivering consistent, automation-ready highlight data.

Is it legal / ethical to use Instagram Highlights Scraper?

Yes — when used responsibly. This actor targets publicly available Instagram profile data and does not access private accounts or authenticated resources.

Guidelines:

• Only scrape public profiles and respect platform terms.
• Comply with applicable regulations (e.g., GDPR, CCPA) and your organization’s policies.
• Avoid collecting or using data for spam or misuse.
• Consult your legal team for edge cases or specific jurisdictions.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://www.instagram.com/mrbeast/",
    "@nasa"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Parameters

• startUrls (array of strings)
  Description: Add one or more targets — each line is one input. Accepted: full profile URL (https://www.instagram.com/username), username (username or @username).
  Required: Yes
  Default: None

• proxyConfiguration (object)
  Description: Choose which proxies to use. On HTTP 429/403, the actor fails fast and falls back: no proxy → datacenter → residential (with up to 3 retries). Once residential is used, it stays in “sticky” mode for the rest of the run.
  Required: No
  Default (prefill): {"useApifyProxy": true}

Example JSON output

[
  {
    "input_url": "https://www.instagram.com/swarnika.verma_/",
    "username": "swarnika.verma_",
    "user_id": "72037592921",
    "type": "instagram_highlights",
    "id": "highlight:18069978917514346",
    "title": "Luxe🛍️",
    "cover_media": "https://scontent-iad3-1.cdninstagram.com/v/t51.2885-15/528310306_1486885775636090_4883732409687731720_n.jpg",
    "success": true,
    "error": null,
    "timestamp": "2026-04-15T12:34:56+00:00"
  },
  {
    "input_url": "https://www.instagram.com/invalid-shortcode/",
    "username": null,
    "user_id": null,
    "type": "instagram_highlights",
    "id": null,
    "title": null,
    "cover_media": null,
    "success": false,
    "error": "Shortcode detected but username extraction from shortcode requires additional API calls",
    "timestamp": "2026-04-15T12:35:10+00:00"
  }
]

Notes:

• Fields that may be null: user_id, cover_media, error (null on success).
• success is true only for valid highlight items. Failures are recorded with success=false and a descriptive error.

FAQ – Instagram Highlights Scraper

Do I need to log in or provide cookies?

No. This tool works on public profiles without login or cookies. It requests publicly available pages and extracts highlight metadata.

Can I download Instagram story highlights with this?

Not in this version. The actor extracts highlight IDs, titles, and cover image URLs. You can use cover_media URLs to save highlight covers, but it does not fetch per-story media.

Is there a free trial?

Yes. This actor has a monthly plan and includes a trial (120 trial minutes) so you can test before subscribing.

What input formats are supported?

Use full profile URLs (https://www.instagram.com/username), plain usernames (username), or @username. Shortcodes currently result in an error item and aren’t resolved to a username.

How does it handle blocks and rate limits?

It detects HTTP 429/403 and fails fast to trigger fallback: no proxy → datacenter → residential. Residential mode retries up to three times and stays sticky for stability.

How many profiles can I process in one run?

As many as you include in startUrls. The actor streams results item-by-item and is designed for bulk operations, making it a strong instagram highlights archiver for metadata.

Is this a python instagram highlights scraper?

Yes. The actor is implemented in Python and runs on Apify’s infrastructure, making it easy to integrate with Python-based pipelines.

How do I export results?

Open the run’s default dataset and export to JSON or CSV. This is ideal if you want to save instagram highlights online as structured metadata for analysis.

Closing CTA / Final thoughts

Instagram Highlights Scraper is built to extract clean, reliable highlight metadata from public profiles at scale. With real-time streaming, a consistent schema, and robust proxy fallback, it’s a dependable instagram highlights download tool for titles, IDs, and cover images.

Whether you’re a marketer, developer, analyst, or researcher, you can bulk scrape multiple profiles, export instagram highlights to JSON/CSV, and plug the results into your analytics or automation stack. Developers can orchestrate runs via the Apify platform and integrate outputs into Python pipelines easily.

Start extracting smarter highlight insights today and turn public Instagram data into structured, actionable datasets.