Instagram Public Data Scraper

Scrape publicly available Instagram profiles, posts, reels, hashtags, and search queries at scale without requiring Instagram login credentials or API keys.

---

Features

• 👤 Profile Scraping: Extract profile bio, follower count, following count, post count, verification status, category, external URL, and latest posts.
• 📸 Post Scraping: Extract post captions, shortcodes, post IDs, hashtags, mentions, likes count, comments count, timestamps, owner details, and media URLs.
• 🎬 Reel Scraping: Extract video view/play count, audio track metadata (title, artist, audio URL), video source URL, and thumbnail.
• #️⃣ Hashtag Scraping: Extract total post count, top posts, and recent posts for any target hashtag.
• 🔍 Search Query Scraping: Extract profile search results matching search terms.
• 🚨 Structured Error Emitter: Guarantees raw exceptions are never thrown. Returns structured error records (PROFILE_PRIVATE, POST_NOT_FOUND, LOGIN_REQUIRED, RATE_LIMITED, PROXY_BLOCKED).
• 📊 Strict Dataset Consistency: All fields are present in every dataset row (null returned for unavailable values), making export to CSV, Excel, BigQuery, PostgreSQL, and AI/RAG pipelines flawless.

---

How to Use

Step 1 — Define your target inputs

Specify your target Instagram usernames:

• usernames: Array of Instagram account usernames (e.g. ["focus.on.form", "betamatkarmemes"]).
• urls (optional): Array of full Instagram URLs (profiles, posts, reels, hashtags).
• searchQueries (optional): Array of search terms (e.g. ["fitness"]).
• hashtags (optional): Array of hashtag names (e.g. ["fitness"]).

Step 2 — Configure options

• Set maxItems to cap the number of extracted items per query/feed.
• Toggle scrapeProfiles, scrapePosts, scrapeReels, or scrapeComments.
• Enable Apify Proxy for automatic IP rotation and anti-bot bypass.

Step 3 — Run & Export

Click Start and export your structured dataset in JSON, CSV, Excel, or JSONL.

---

Input Reference

{
  "usernames": [
    "focus.on.form",
    "betamatkarmemes"
  ],
  "maxItems": 100,
  "scrapeProfiles": true,
  "scrapePosts": true,
  "scrapeReels": true,
  "searchQueries": [
    "fitness",
    "gym motivation"
  ],
  "hashtags": [
    "fitness",
    "bodybuilding"
  ],
  "maxItems": 100,
  "scrapeProfiles": true,
  "scrapePosts": true,
  "scrapeReels": true,
  "scrapeComments": false,
  "oldestPostDate": "2025-01-01",
  "newestPostDate": "2026-12-31",
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

---

Dataset Output Schemas

1. Profile Output Sample

{
  "scrapeType": "profile",
  "scrapedAt": "2026-07-22T12:00:00.000Z",
  "url": "https://www.instagram.com/nike/",
  "username": "nike",
  "fullName": "Nike",
  "biography": "Just Do It.",
  "isVerified": true,
  "isBusinessAccount": true,
  "isPrivate": false,
  "followersCount": 305000000,
  "followingCount": 150,
  "postsCount": 1200,
  "externalUrl": "https://www.nike.com",
  "profilePicUrl": "https://scontent.cdninstagram.com/v/t51.2885-19/nike.jpg",
  "highlightReelCount": 5,
  "category": "Clothing (Brand)",
  "businessAddress": null,
  "businessEmail": null,
  "businessPhone": null,
  "latestPosts": []
}

2. Post Output Sample

{
  "scrapeType": "post",
  "scrapedAt": "2026-07-22T12:00:00.000Z",
  "url": "https://www.instagram.com/p/C12345678/",
  "shortCode": "C12345678",
  "postId": "3210987654321",
  "caption": "Morning workout routine #fitness #gym",
  "hashtags": ["fitness", "gym"],
  "mentions": [],
  "likesCount": 12500,
  "commentsCount": 430,
  "videoViewCount": null,
  "timestamp": "2026-07-21T08:30:00.000Z",
  "ownerUsername": "fitnessguy",
  "ownerId": "987654321",
  "isVideo": false,
  "dimensions": { "width": 1080, "height": 1080 },
  "mediaUrls": ["https://scontent.cdninstagram.com/v/post1.jpg"],
  "locationName": "Venice Beach",
  "locationId": "123456"
}

3. Structured Error Sample

{
  "success": false,
  "errorCode": "PROFILE_PRIVATE",
  "message": "Profile is private",
  "url": "https://www.instagram.com/private_user/"
}

---

Anti-Bot & Evasion Mechanics

• Automatic Proxy Rotation: Uses Apify Residential/Datacenter proxy pools to bypass IP throttling.
• Request Retries & Backoff: Automatically retries 429 and 5xx response codes with exponential backoff delays.
• Header & Browser Randomization: Emulates genuine Chromium browser fingerprints.

---

Export & AI Pipeline Compatibility

Output dataset JSON structures strictly preserve object key schemas. Keys with missing data return null instead of being omitted, allowing seamless loading into PostgreSQL, BigQuery, Snowflake, Pandas, Excel, and LLM RAG pipelines.