Instagram Profile Scraper

Instagram Profile Scraper

The Instagram Profile Scraper is a production-ready Apify actor that extracts structured, public Instagram profile data at scale — including profile metadata, follower/following and post counts, related profiles, IGTV entries, and recent post details. It solves the pain of manual research with a reliable, Playwright-powered Instagram profile data extractor that works without login and saves results directly to your Apify dataset. Built for marketers, developers, data analysts, and researchers, this Instagram account scraper enables repeatable, compliant workflows for influencer discovery, competitor tracking, and social analytics.

What data / output can you get?

Below are key fields produced by this Instagram user scraper. Each item is pushed to your Apify dataset as a single JSON record.

• Data type: inputUrl
  • Description: Original input URL normalized to an Instagram profile URL (trailing slash removed)
  • Example: https://www.instagram.com/humansofny
• Data type: url
  • Description: Canonical Instagram profile URL built from the username
  • Example: https://www.instagram.com/humansofny
• Data type: id
  • Description: Instagram user ID
  • Example: 242598499
• Data type: username
  • Description: Instagram handle
  • Example: humansofny
• Data type: fullName
  • Description: Display name
  • Example: Humans of New York
• Data type: biography
  • Description: Profile bio text
  • Example: New York City, one story at a time.
• Data type: followersCount
  • Description: Number of followers
  • Example: 12802590
• Data type: followsCount
  • Description: Number of accounts followed
  • Example: 673
• Data type: postsCount
  • Description: Total number of posts
  • Example: 5839
• Data type: verified
  • Description: Verification flag
  • Example: true
• Data type: isBusinessAccount
  • Description: Business account flag
  • Example: false
• Data type: private
  • Description: Private account flag
  • Example: false
• Data type: profilePicUrl / profilePicUrlHD
  • Description: Profile pictures (standard and HD)
  • Example: https://instagram.cdn/…/photo.jpg
• Data type: externalUrl / externalUrlShimmed
  • Description: Main external link from bio and Instagram-shimmed variant
  • Example: https://bit.ly/dearnewyorkbook / https://l.instagram.com/…
• Data type: externalUrls
  • Description: Array of all links from bio (objects with title, url, etc.)
  • Example: [{ "title": "Shop", "url": "https://example.com" }]
• Data type: latestPosts
  • Description: Array of recent posts with media, engagement, and owner info
  • Example: [{ "id": "3742…", "type": "Sidecar", "shortCode": "DPwJzE…", "likesCount": 254147, "images": ["https://…"] }]
• Data type: relatedProfiles
  • Description: Array of similar/related accounts (user slices)
  • Example: [{ "id": "123", "username": "natgeo", "is_verified": true }]
• Data type: latestIgtvVideos
  • Description: Array of IGTV entries (if any)
  • Example: [{ "id": "987", "shortCode": "C0deX", "displayUrl": "https://…", "timestamp": "2025-06-01T12:00:00.000Z" }]
• Data type: about (optional)
  • Description: Extra metadata when includeAboutSection is true (joinedDate, country)
  • Example: { "joinedDate": "2013-09-01T00:00:00.000Z", "country": "United States" }

Notes:

• Export your dataset to common formats (JSON, CSV, Excel) from the Apify platform.
• Post objects also include hashtags, mentions, dimensions, displayUrl, alt text, timestamp, ownerUsername, ownerId, images, childPosts, and taggedUsers for richer analysis with an Instagram profile data scraper tool.

Key features

• 🌐 Always-on residential proxy
  • The actor programmatically enables Apify Residential proxy on every run for higher success rates, making it a robust Instagram profile scraping API alternative without manual proxy setup.
• 🧭 Playwright-based interception
  • Uses a headless Chromium session to capture Instagram’s web_profile_info response for accurate, structured data — no login or cookies required.
• 📦 Structured, ready-to-use output
  • Pushes clean JSON records to the Apify dataset with profile stats, bio links, related profiles, IGTV entries, and recent posts — perfect for analytics and enrichment.
• 🔁 Resilient with retries
  • Built-in retry logic (3 attempts with delays) handles transient timeouts and network issues for dependable runs.
• 👥 Sequential bulk processing
  • Feed multiple usernames or profile URLs; each is normalized and processed in sequence for predictable throughput in your Instagram profile crawler workflows.
• 🔗 Developer-friendly
  • Ideal for programmatic pipelines via the Apify API, or to plug into your Instagram profile scraper Python workflows.
• 📊 Real-time saves
  • Each scraped profile is pushed as soon as it’s processed so you can monitor results live and export when ready.
• 🛡️ Public data only
  • Designed for public profiles and publicly available fields, aligning with safe and ethical data practices.

How to use Instagram Profile Scraper - step by step

1. Create or log in to your Apify account at console.apify.com.
2. Open the Instagram Profile Scraper actor and click Try for free or Start.
3. Add targets in startUrls:
   • Full URL: https://www.instagram.com/username/
   • Username only: username
   • Short URL or @handle: instagram.com/username or @username
4. (Optional) Toggle includeAboutSection to true if you also want about.joinedDate and about.country in the output.
5. (Optional) proxyConfiguration can be set, but the actor always uses the Apify Residential proxy automatically.
6. Click Start to run. The run opens a headless browser, intercepts the profile API, and saves each result to the dataset.
7. Watch logs for progress. Results appear in the Dataset tab as they are scraped.
8. Export your dataset to JSON, CSV, or Excel for use in BI tools, CRMs, or an Instagram profile leads scraper workflow.

Pro tip: Chain this Instagram profile scraper tool with webhooks or integrate via the Apify API to automate enrichment in your data pipelines.

Use cases

• Influencer discovery for marketing
  • Identify verified creators, assess follower counts, and parse recent posts to prioritize outreach.
• Competitor social benchmarking
  • Compare bios, post cadence, and engagement signals across rivals for strategy insights with an Instagram public profile scraper.
• Content analysis for editorial teams
  • Analyze hashtags, mentions, and media types across the latest posts to guide content planning.
• Market research & brand tracking
  • Monitor business accounts, verification, and link hubs for category trend analysis using an Instagram business profile scraper.
• Data enrichment for CRM/BI
  • Append usernames, profile URLs, and follower metrics to records via an Instagram profile scraping API workflow.
• Academic & social studies
  • Collect structured public data for research on communities, content patterns, and online behavior.

Why choose Instagram Profile Scraper?

Built for precision and reliability, this Instagram profile data scraper delivers structured profile and post data without manual effort or fragile browser extensions.

• ✅ Accurate, structured output: Normalized fields for profiles, posts, and IGTV.
• 🌐 High success rate: Always-on residential proxy and 3 retries per request.
• 🚫 No login required: Works on public data — no cookies or sessions needed.
• 📈 Scales with your needs: Process many usernames or URLs in one run.
• 🧩 Developer access: Integrate via the Apify API or use in an Instagram profile scraper Python pipeline.
• 🔒 Ethical by design: Targets public profiles and fields only.
• 🔗 Platform-native: Real-time dataset writes and easy exports for analysis and reporting.

In short: a dependable Instagram user scraper vs unstable extensions — designed for production workflows.

Is it legal / ethical to use Instagram Profile Scraper?

Yes, when done responsibly. This actor extracts publicly available information from Instagram profiles and does not access private or password-protected content. You should:

• Scrape only public profiles and publicly visible fields.
• Respect Instagram’s Terms of Service and rate limits.
• Ensure compliance with applicable laws and regulations (e.g., GDPR, CCPA).
• Avoid using data for spam, harassment, or other prohibited activities. For specific use cases, consult your legal team to confirm compliance.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://www.instagram.com/humansofny/",
    "natgeo",
    "@nike"
  ],
  "includeAboutSection": false,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

• startUrls (array, required)
  • Description: Instagram profiles to scrape. Accepts full profile URLs, usernames, short URLs, or @handles.
  • Default: none
• includeAboutSection (boolean, optional)
  • Description: When true, the output includes about.joinedDate and about.country (if available).
  • Default: false
• proxyConfiguration (object, optional)
  • Description: Proxy settings editor. Note: The actor always uses the Apify Residential proxy internally regardless of this selection.
  • Default: not specified

Example JSON output

[
  {
    "inputUrl": "https://www.instagram.com/humansofny",
    "url": "https://www.instagram.com/humansofny",
    "id": "242598499",
    "username": "humansofny",
    "fullName": "Humans of New York",
    "biography": "New York City, one story at a time.",
    "externalUrls": [
      {
        "title": "Book",
        "url": "https://bit.ly/dearnewyorkbook",
        "lynx_url": "https://l.instagram.com/...",
        "link_type": "external"
      }
    ],
    "externalUrl": "https://bit.ly/dearnewyorkbook",
    "externalUrlShimmed": "https://l.instagram.com/...",
    "followersCount": 12802590,
    "followsCount": 673,
    "postsCount": 5839,
    "verified": true,
    "isBusinessAccount": false,
    "private": false,
    "profilePicUrl": "https://instagram.cdn/…/photo.jpg",
    "profilePicUrlHD": "https://instagram.cdn/…/photo_hd.jpg",
    "hasChannel": false,
    "highlightReelCount": 12,
    "joinedRecently": false,
    "businessCategoryName": null,
    "igtvVideoCount": 0,
    "relatedProfiles": [
      {
        "id": "17841401154973790",
        "full_name": "National Geographic",
        "is_verified": true,
        "profile_pic_url": "https://instagram.cdn/…/natgeo.jpg",
        "username": "natgeo",
        "is_private": false
      }
    ],
    "latestIgtvVideos": [],
    "latestPosts": [
      {
        "id": "3742534382104984578",
        "type": "Sidecar",
        "shortCode": "DPwJzEVDbwC",
        "caption": "A few years ago I received a DM...",
        "hashtags": [],
        "mentions": ["zohrankmamdani"],
        "url": "https://www.instagram.com/p/DPwJzEVDbwC/",
        "commentsCount": 3841,
        "dimensionsHeight": 1080,
        "dimensionsWidth": 1080,
        "displayUrl": "https://instagram.cdn/…/post.jpg",
        "alt": "Photo of ...",
        "likesCount": 254147,
        "timestamp": "2025-10-13T20:14:46.000Z",
        "ownerUsername": "humansofny",
        "ownerId": "242598499",
        "images": ["https://instagram.cdn/…/image1.jpg"],
        "childPosts": [],
        "taggedUsers": [
          {
            "id": "123",
            "full_name": "Jane Doe",
            "is_verified": false,
            "profile_pic_url": "https://instagram.cdn/…/jane.jpg",
            "username": "janedoe"
          }
        ]
      }
    ]
  }
]

Notes on optionality and variability:

• The about object appears only when includeAboutSection is true and may include joinedDate and country if present in the response.
• latestIgtvVideos and relatedProfiles may be empty arrays when not available.
• Post childPosts entries (for Sidecar media) include firstComment and latestComments placeholders for structure; single-image posts may have empty childPosts.

FAQ

Do I need to log in to scrape Instagram profiles?

No. This Instagram profile scraper works without login and targets public profile data by intercepting the web_profile_info response in a headless browser session.

Does it work for private accounts?

No. The Instagram public profile scraper extracts publicly available information. Private or restricted accounts are not supported.

What post details are included?

The Instagram bio scraper and post extractor returns captions, hashtags, mentions, engagement counts, timestamps, dimensions, image URLs, sidecar child posts, and tagged users for recent posts.

How many profiles can I scrape in one run?

You can provide as many usernames or profile URLs as you need in startUrls. The Instagram profile crawler processes them sequentially and saves each result in real time.

Can I use this with Python or an API?

Yes. Run the actor via the Apify API or incorporate it into an Instagram profile scraper Python workflow for automated enrichment and data pipelines.

What about proxies — do I need to configure them?

You don’t need to. The actor always enables the Apify Residential proxy internally and includes 3 automatic retries to improve success rates.

Which export formats are supported?

Results are stored in the Apify dataset, which you can export to common formats like JSON, CSV, or Excel for analysis and CRM uploads.

Can it scrape business profile metadata?

Yes. Fields like isBusinessAccount, verified, external links, and follower metrics make it a reliable Instagram business profile scraper for brand research.

Closing thoughts

This Instagram Profile Scraper is built to deliver clean, structured Instagram profile and post data for analytics and enrichment. With always-on residential proxy, Playwright-based accuracy, and real-time dataset output, it’s a robust Instagram profile data extractor for marketers, developers, analysts, and researchers. Integrate via the Apify API or your own Instagram profile scraper Python scripts to automate end-to-end workflows. Start extracting smarter, scalable social insights today.