Instagram Profile Scraper

Instagram Profile Scraper

The Instagram Profile Scraper is a production-ready Apify actor that extracts structured data from public Instagram profiles — including profile metadata, follower/following counts, external links, and recent posts — without API keys or logins. As an Instagram profile data scraper and Instagram profile info extractor, it solves the challenge of collecting clean, reliable profile insights at scale using Playwright-powered interception and residential proxies. Built for marketers, developers, data analysts, and researchers, this Instagram user profile scraper enables fast, repeatable data pipelines for enrichment, monitoring, and analysis — all API-ready and automation-friendly.

What data / output can you get?

Below are examples of the structured fields this Instagram profile scraping tool returns. Results are saved to an Apify dataset and can be exported to JSON, CSV, or Excel.

Data type	Description	Example value
inputUrl	Original input normalized to a profile URL	https://www.instagram.com/humansofny
url	Canonical Instagram profile URL	https://www.instagram.com/humansofny
id	Instagram user ID	242598499
username	Profile handle	humansofny
fullName	Display name	Humans of New York
biography	Bio text	New York City, one story at a time...
followersCount	Number of followers	12802590
followsCount	Number of accounts followed	673
postsCount	Total posts on the profile	5839
verified	Verified badge status	true
isBusinessAccount	Business account indicator	false
externalUrl	Main external link from bio	https://bit.ly/dearnewyorkbook
externalUrlShimmed	Instagram-shimmed outbound link	https://l.instagram.com/...
externalUrls	Array of external bio links with metadata	[{"title":"Book","url":"https://bit.ly/dearnewyorkbook"}]
profilePicUrlHD	High-resolution profile image URL	https://instagram.cdn/...
latestPosts[].shortCode	Post shortcode for deep link	DPwJzEVDbwC
latestPosts[].type	Media type: Image, Video, or Sidecar	Sidecar
latestPosts[].likesCount	Post likes	254147
latestPosts[].timestamp	Post timestamp (ISO)	2025-10-13T20:14:46.000Z

Bonus outputs include relatedProfiles (suggested accounts), latestIgtvVideos, and an optional about object with joinedDate and country (when enabled). Export in seconds to JSON, CSV, or Excel.

Key features

• 🌐 Always-on residential proxy reliability
  Uses Apify Residential Proxy by default with 3 automatic retries for consistent success on public Instagram pages — an Instagram public profile scraper that works without API keys or logins.

• 🎯 Structured profile & post metadata
  Captures username, fullName, biography, verification status, profilePicUrl/profilePicUrlHD, followers/follows/posts counts, external links, and normalized post objects with hashtags, mentions, and engagement metrics — a complete Instagram profile data extractor.

• 🧠 Playwright-based interception
  Headless Chromium (Playwright) intercepts the web_profile_info response for clean, robust extraction from Instagram public profiles — ideal for an Instagram profile metadata scraper workflow.

• ⚙️ Real-time dataset saving
  Each profile record is pushed to the dataset as soon as it’s scraped — perfect for long batches and workflow chaining with the Instagram profile scraper API.

• 🧩 Developer-friendly (Apify SDK & API)
  Built on the Apify SDK for easy automation and integration. Export results programmatically or via the Apify UI — great for Python-based pipelines and engineering teams using an Instagram profile scraper Python stack.

• 📦 Batch processing, clear logging
  Processes multiple usernames/URLs sequentially with concise progress logs, retry handling, and graceful errors — a reliable IG profile scraper tool for production.

• 🔎 Optional About section
  Toggle includeAboutSection to add about.joinedDate and about.country (when available in the response) for richer context.

• 🛡️ Production-ready resilience
  Residential proxies, retry logic, and timeouts help this Instagram profile crawler stay stable in real-world use — more reliable than a browser plugin or Instagram profile scraper Chrome extension.

How to use Instagram Profile Scraper - step by step

1. Create or log in to your Apify account at https://console.apify.com.
2. Open the Instagram Profile Scraper actor (instagram-profile-scraper) from your dashboard or Apify Store.
3. Add input data in the startUrls field:
   • Full profile URLs: https://www.instagram.com/username/
   • Usernames only: username
   • Short forms like @username are also accepted.
4. (Optional) Toggle includeAboutSection to include about.joinedDate and about.country in the output when available.
5. (Optional) Review proxyConfiguration. Note: the actor always uses Apify Residential Proxy with 3 automatic retries regardless of your selection.
6. Click Start to run. The scraper will navigate to each profile, intercept the web_profile_info response, and transform it into a standardized record.
7. Monitor progress in the logs. Results are pushed to the dataset in real time as profiles are processed.
8. Export results from the Dataset tab to JSON, CSV, or Excel, or consume them via the Apify API.

Pro Tip: Chain this Instagram profile scraping tool with webhooks or the Apify API to sync results into BI tools, CRMs, or data warehouses automatically.

Use cases

Use case name	Description
Marketing research + competitor profiling	Aggregate bios, follower metrics, and posting activity from public profiles to benchmark competitors and spot trends.
Influencer discovery + vetting	Identify and evaluate potential partners using verified status, follower counts, and post engagement metadata.
Content strategy + hashtag analysis	Extract captions, hashtags, and mentions from recent posts to analyze performance patterns and creative direction.
Brand monitoring + public presence	Track profile changes (bio, links, visuals) and related accounts for ongoing brand intelligence.
Data enrichment + API pipelines	Feed structured Instagram profile metadata into enrichment workflows via the Apify SDK/API for downstream analytics.
Academic & social research	Build reproducible datasets of public Instagram user profiles and post attributes for studies and reports.
Product research + audience insights	Analyze signals like businessCategoryName, verified, and hasChannel to understand market segments.

Why choose Instagram Profile Scraper?

This Instagram profile scraping software is built for precision and reliability at scale — not a brittle browser extension.

• ✅ Accurate, structured fields from official public responses (no API keys needed)
• 🌍 Public-profile only by design; ideal for compliant, ethical research
• 📈 Scales to large batches with real-time dataset writes for incremental progress
• 💻 Developer-ready with Apify SDK and API for automation and orchestration
• 🔒 Always-on residential proxy with 3 retries for higher success rates
• 🔗 Easy exports (JSON/CSV/Excel) and integration into existing workflows
• 🧱 More stable than manual extensions or ad-hoc scripts, with robust logging and error handling

In short: the best Instagram profile scraper for teams that need a reliable, automation-friendly Instagram profile scraping tool for production workflows.

Is it legal / ethical to use Instagram Profile Scraper?

Yes — when done responsibly. This Instagram public profile scraper accesses only publicly available Instagram profile data and does not log in or access private content.

Guidelines for compliant use:

• Scrape only public Instagram profiles and publicly visible fields.
• Do not attempt to access private accounts or authenticated data.
• Respect Instagram’s Terms of Service and platform rate limits.
• Ensure adherence to data protection laws (e.g., GDPR, CCPA) in your jurisdiction.
• Consult your legal team for edge cases and sensitive use cases.

Input parameters & output format

Example input

{
  "startUrls": [
    "https://www.instagram.com/humansofny/",
    "natgeo",
    "@nytimes"
  ],
  "includeAboutSection": true,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Input parameter details

• startUrls (array, required)

  • Description: Add Instagram profiles to scrape. Accepted formats: full URL (https://www.instagram.com/username/), username-only (username), or short forms (instagram.com/username, @username).
  • Default: none
  • Required: Yes

• includeAboutSection (boolean, optional)

  • Description: Enable to extract additional profile information. When enabled, you’ll also get about.joinedDate and about.country when available.
  • Default: false
  • Required: No

• proxyConfiguration (object, optional)

  • Description: Proxy configuration editor. Important: this actor always uses residential proxy with 3 automatic retries for maximum reliability, regardless of your selection.
  • Default: {"useApifyProxy": false}
  • Required: No

Example output

[
  {
    "inputUrl": "https://www.instagram.com/humansofny",
    "url": "https://www.instagram.com/humansofny",
    "id": "242598499",
    "username": "humansofny",
    "fullName": "Humans of New York",
    "biography": "New York City, one story at a time...",
    "externalUrls": [
      {
        "title": "Dear New York Book",
        "lynx_url": "https://l.instagram.com/...",
        "url": "https://bit.ly/dearnewyorkbook",
        "link_type": "external"
      }
    ],
    "externalUrl": "https://bit.ly/dearnewyorkbook",
    "externalUrlShimmed": "https://l.instagram.com/...",
    "followersCount": 12802590,
    "followsCount": 673,
    "hasChannel": false,
    "highlightReelCount": 12,
    "isBusinessAccount": false,
    "joinedRecently": false,
    "businessCategoryName": null,
    "private": false,
    "verified": true,
    "profilePicUrl": "https://instagram.cdn/...",
    "profilePicUrlHD": "https://instagram.cdn/...",
    "igtvVideoCount": 0,
    "postsCount": 5839,
    "relatedProfiles": [
      { "id": "123", "full_name": "Example", "is_verified": false, "profile_pic_url": "https://...", "username": "example", "is_private": false }
    ],
    "latestIgtvVideos": [],
    "latestPosts": [
      {
        "id": "3742534382104984578",
        "type": "Sidecar",
        "shortCode": "DPwJzEVDbwC",
        "caption": "A few years ago I received a DM...",
        "hashtags": [],
        "mentions": ["zohrankmamdani"],
        "url": "https://www.instagram.com/p/DPwJzEVDbwC/",
        "commentsCount": 3841,
        "dimensionsHeight": 1080,
        "dimensionsWidth": 1080,
        "displayUrl": "https://instagram.cdn/...",
        "alt": "Photo of ...",
        "likesCount": 254147,
        "timestamp": "2025-10-13T20:14:46.000Z",
        "ownerUsername": "humansofny",
        "ownerId": "242598499",
        "images": ["https://instagram.cdn/..."],
        "childPosts": [],
        "taggedUsers": [
          { "id": "456", "full_name": "User", "is_verified": true, "profile_pic_url": "https://...", "username": "user" }
        ]
      }
    ],
    "about": {
      "joinedDate": "2010-07-28T00:00:00.000Z",
      "country": "United States"
    }
  }
]

Notes:

• The about object is included only when includeAboutSection is true and values are available.
• latestIgtvVideos and relatedProfiles may be empty arrays if not present.
• latestPosts contains the recent timeline items returned by Instagram’s public web response; fields like taggedUsers and childPosts appear when present.

FAQ

Does this work with private accounts?

❌ No. The Instagram user profile scraper only collects publicly available data from public profiles and does not log in or access private content.

Do I need an API key or login?

✅ No. It uses headless Playwright to intercept the public web_profile_info response. No API keys or logins are required.

How many posts does it scrape per profile?

✅ The actor returns the recent timeline posts available in Instagram’s public web response for that profile. It does not paginate beyond what’s returned in that response.

Will I get blocked by Instagram?

🛡️ The actor always uses residential proxies and includes 3 automatic retries with delays on timeouts/errors to improve success rates for public data requests.

Can I export the data to CSV or Excel?

✅ Yes. All results are stored in an Apify dataset, which you can export to JSON, CSV, or Excel from the UI or via the Apify API.

Can developers integrate this into pipelines?

💻 Yes. It runs on the Apify platform and is built on the Apify SDK, making it easy to automate with the Apify API, webhooks, and downstream tools.

What input formats are accepted?

🧾 You can provide full profile URLs (https://www.instagram.com/username/), username-only values (username), and short forms like @username in the startUrls array.

What extra profile fields can I get?

🧠 You can optionally include the about object (joinedDate and country when available) by enabling includeAboutSection. The scraper also returns relatedProfiles and latestIgtvVideos when present.

Is there a trial?

✅ Yes. This listing includes trial minutes (120) so you can test before subscribing.

Closing thoughts

The Instagram Profile Scraper is built to extract structured, reliable Instagram profile data from public pages for analytics, enrichment, and monitoring. With residential proxies, Playwright-based interception, and real-time dataset writes, it’s ideal for marketers, developers, researchers, and data teams. Use the Apify API to integrate with your stack or power an Instagram profile scraper Python workflow — and start extracting smarter insights from public Instagram profiles today.

What are other Instagram scraping tools?

If you want to scrape specific Instagram data, you can use any of the dedicated scrapers below for faster and more targeted results.

Scraper Name	Scraper Name
Instagram Comments Scraper	Instagram Post Details Scraper
Instagram Dm Automation	Instagram Posts Scraper
Instagram Email Scraper	Instagram Profile Post Scraper
Instagram Followers Count Scraper	Instagram Profile Reels Scraper
Instagram Following Scraper	Instagram Reels Scraper
Instagram Hashtag Username Scraper	Instagram Related Hashtag Stats Scraper
Instagram Highlights Scraper	Instagram Related Person Scraper
Instagram Likes Scraper	Instagram Single Reels Scraper
Instagram Location Scraper	Instagram Story Details Scraper
Instagram Mentions Scraper	Instagram Tagged Mentions Posts Scraper
Instagram Phone Number Scraper	Instagram Tagged Posts Scraper