Instagram Posts Scraper

Instagram Posts Scraper

The Instagram Posts Scraper is a fast, reliable Instagram post extractor that collects public posts from Instagram profiles at scale — including captions, media URLs, timestamps, and engagement metrics — and delivers them in structured datasets for analysis. It solves the pain of manual copy-paste by letting you scrape Instagram posts programmatically from profile URLs, usernames, and even post shortcodes, making it ideal for marketers, developers, data analysts, and researchers. With built-in sorting and limits, this Instagram posts scraping tool helps you automate social listening, competitor tracking, and content analysis with ease.

What data / output can you get?

Below are examples of real output fields as pushed to the Apify dataset. Results retain Instagram’s native structure with a few added metadata fields.

Data type	Description	Example value
id	Post identifier including owner ID	"3727992219681477950_173560420"
code	Shortcode used in post URLs	"DO8fSwLiNU-"
taken_at	Unix timestamp when the post was published	1758631325
like_count	Number of likes on the post	7141379
comment_count	Number of comments on the post	72516
media_type	Type of media (e.g., 1 photo, 8 carousel)	8
product_type	Post product type	"carousel_container"
caption.text	Full caption text	"Happy Saudi National Day to everyone in Saudi Arabia! 🇸🇦 ..."
user.username	Username of the post owner	"cristiano"
image_versions2.candidates[].url	Direct media URL (multiple resolutions)	"https://scontent-.../552825156_..._n.jpg"
carousel_media_count	Number of items in a carousel	3
post_url	Canonical URL to the post	"https://www.instagram.com/p/DO8fSwLiNU-/"

Notes:

• Bonus metadata includes nested objects like caption, user, owner, image_versions2, and (when present) carousel_media with per-item candidates.
• You can export results to JSON, CSV, or Excel from the Apify dataset.

Key features

• 🚀 Automatic input detection Detects and normalizes inputs as profile URLs, plain usernames, post URLs, or post shortcodes — then resolves to the correct username for scraping.

• 🔒 Residential proxy enforced Always uses a residential proxy automatically for higher reliability and fewer blocks (the actor enforces this regardless of your proxy selection).

• ⚙️ Scrape limits & sorting Control depth and ordering with maxPosts and sortOrder ("newest" or "oldest") for consistent, repeatable IG posts scraper runs.

• 🧠 Resilient request strategy Implements retries with exponential backoff for token extraction and feed requests to improve success rates during rate limiting.

• 🧾 Structured datasets & easy exports Results are pushed to an Apify dataset so you can download as JSON, CSV, or Excel — perfect for a bulk Instagram post downloader or Instagram posts to CSV scraper workflow.

• 💻 Developer-friendly automation Designed for integration into pipelines and “Instagram API scraping for posts” scenarios on Apify — ideal for analysts and engineers.

• 🔍 Scrape Instagram posts without login Works without storing login sessions; tokens are extracted from public pages to collect profile feed data programmatically.

How to use Instagram Posts Scraper - step by step

1. 🔑 Sign in to Apify Create a free Apify account or log in to your existing workspace.

2. 🔍 Open the actor Find “Instagram Posts Scraper” in the Apify Store and click Try for free.

3. 🧾 Add input data In “startUrls”, enter one or more items as:

   • Profile URL: https://www.instagram.com/username/
   • Username: username
   • Post URL: https://www.instagram.com/p/SHORTCODE/
   • Shortcode: SHORTCODE The actor will automatically detect the input type and extract the profile username.

4. ⚙️ Configure settings

   • maxPosts: limit posts per profile (1–1000)
   • sortOrder: choose "newest" or "oldest"
   • maxComments: cap comments per post (0–100)
   • proxyConfiguration: optional field, but note the actor always uses residential proxies internally

5. ▶️ Run the actor Click Start. The scraper will extract authentication tokens from the public profile page and fetch posts via Instagram web endpoints.

6. ⏱ Monitor progress Watch logs for page-by-page scraping status and rate-limit handling with retries.

7. 💾 Download results Open the dataset tab for the run and export your data as JSON, CSV, or Excel for use in analytics and reporting.

Pro Tip: Chain this IG posts scraper with your data stack or marketing tools to automate content tracking, or pull data programmatically from the Apify dataset API.

Use cases

Use case name	Description
Digital marketing competitor analysis	Track competitors’ posting cadence, captions, and engagement to inform content strategy and audience insights.
Social listening & brand monitoring	Monitor public posts from partner or brand profiles to analyze sentiment and creative direction over time.
Content planning for creators	Gather inspiration via an Instagram captions scraper and Instagram photo scraper to identify high-performing themes.
Analytics & reporting	Build a repeatable Instagram feed scraper that exports to CSV/JSON and powers dashboards and KPI tracking.
Research & academia	Collect public posts for longitudinal studies, audience behavior analysis, or media research.
Developer pipelines (API)	Use this Instagram web scraper for posts as part of a data ingestion pipeline for enrichment, ML training, or audits.

Why choose Instagram Posts Scraper?

Built for precision and automation, this IG posts scraper balances reliability with developer-ready workflows.

• ✅ Accurate profile targeting via automatic input detection (URLs, usernames, post URLs, or shortcodes)
• ✅ Enforced residential proxy for higher success rates without manual configuration
• ✅ Scalable scraping with maxPosts limits and time-ordered results
• ✅ Developer-friendly datasets for quick export to JSON/CSV/Excel and downstream automations
• ✅ Works without login, relying on public pages and web endpoints
• ✅ Cost-effective for ongoing monitoring and bulk Instagram post downloader needs
• ✅ More reliable than ad-hoc browser extensions or manual copy-paste alternatives

In short, it’s a production-ready Instagram posts scraping tool designed for teams that value reliability, scalability, and clean outputs.

Is it legal / ethical to use Instagram Posts Scraper?

Yes — when done responsibly. This actor targets publicly available data from public Instagram profiles and does not access private accounts or authenticated data.

Guidelines:

• Scrape only public content and respect platform terms.
• Comply with applicable data protection laws (e.g., GDPR, CCPA).
• Avoid misuse (e.g., do not resell scraped content in violation of rights).
• Consult your legal team for edge cases or regulated use.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://www.instagram.com/cristiano/",
    "neymarjr",
    "https://www.instagram.com/p/DO8fSwLiNU-/",
    "DO8fSwLiNU-"
  ],
  "maxPosts": 10,
  "sortOrder": "newest",
  "maxComments": 0,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Notes:

• The actor will automatically detect input types and extract usernames from profile URLs, post URLs, and shortcodes.
• Residential proxy use is always enforced by the actor, regardless of proxyConfiguration.

Parameter reference

Field	Type	Description	Default	Required
startUrls	array of strings	Instagram profile URLs (e.g., https://www.instagram.com/username), usernames (e.g., username), or post shortcodes (e.g., ABC123DEF). The actor auto-detects input type and extracts the profile username.	—	Yes
maxPosts	integer	Maximum number of posts to scrape per profile (1–1000).	10	No
sortOrder	string enum	Order in which to sort the posts. One of: "newest", "oldest".	"newest"	No
maxComments	integer	Maximum number of comments to extract per post (0–100).	0	No
proxyConfiguration	object	Proxy settings editor. Note: the actor always uses residential proxy regardless of your selection.	{"useApifyProxy": false}	No

Example JSON output

Each item in the dataset is an Instagram post object (original Instagram fields) with minimal additions: scraped_username, scraped_at, and post_url.

{
  "id": "3727992219681477950_173560420",
  "pk": "3727992219681477950",
  "code": "DO8fSwLiNU-",
  "media_type": 8,
  "product_type": "carousel_container",
  "taken_at": 1758631325,
  "like_count": 7141379,
  "comment_count": 72516,
  "caption": {
    "pk": "18057741581412011",
    "created_at": 1758631327,
    "text": "Happy Saudi National Day to everyone in Saudi Arabia! 🇸🇦 Wishing you a day filled with pride, unity, and celebration with your loved ones."
  },
  "user": {
    "id": "173560420",
    "username": "cristiano",
    "full_name": "Cristiano Ronaldo",
    "is_verified": true
  },
  "image_versions2": {
    "candidates": [
      {
        "url": "https://scontent-.../552825156_..._n.jpg",
        "width": 1080,
        "height": 1379
      },
      {
        "url": "https://scontent-.../552825156_..._s640x640.jpg",
        "width": 640,
        "height": 817
      }
    ]
  },
  "carousel_media_count": 3,
  "carousel_media": [
    {
      "id": "3727992208725918329_173560420",
      "media_type": 1,
      "image_versions2": {
        "candidates": [
          {
            "url": "https://scontent-.../552825156_..._n.jpg",
            "width": 1080,
            "height": 1379
          }
        ]
      }
    }
  ],
  "scraped_username": "cristiano",
  "scraped_at": 1758728197,
  "post_url": "https://www.instagram.com/p/DO8fSwLiNU-/"
}

Notes:

• Nested objects like image_versions2 and carousel_media include multiple media candidates at different resolutions.
• Additional Instagram-native fields (e.g., owner, display_uri, etc.) may be present depending on the post.

FAQ

Do I need to log in to scrape Instagram posts?

✅ No. This Instagram web scraper for posts works without login. It extracts tokens from public pages and uses web endpoints to scrape Instagram posts without login.

Can I input post URLs or shortcodes instead of usernames?

✅ Yes. You can paste post URLs or shortcodes, and the scraper will resolve the owner’s username automatically before scraping.

How many posts can I scrape per profile?

📈 You control this with maxPosts (1–1000). The actor paginates the profile feed and stops when the limit is reached or when no more posts are available.

What data fields are included in the output?

📦 The actor preserves Instagram’s native post structure (e.g., id, code, taken_at, media_type, product_type, like_count, comment_count, caption, user, image_versions2, carousel_media) and adds scraped_username, scraped_at, and post_url.

Can I export results to CSV or Excel?

💾 Yes. Open the run’s dataset in Apify and export your results in JSON, CSV, or Excel — perfect for an Instagram posts to CSV scraper workflow.

Does it use proxies?

🛡️ Yes. The actor always uses residential proxies automatically (enforced) to improve reliability, regardless of the proxyConfiguration you select.

Is scraping Instagram posts legal?

⚖️ Yes, when done responsibly. Only scrape public content, comply with platform terms, and follow applicable privacy laws. Consult your legal team for specific use cases.

Can developers integrate this into pipelines?

💻 Absolutely. Use Apify’s dataset API to pull results into your analytics stack or automation workflows for “Instagram API scraping for posts” scenarios.

Closing CTA / Final thoughts

The Instagram Posts Scraper is built to automate accurate, scalable extraction of public Instagram profile posts. With automatic input detection, enforced residential proxies, and structured outputs, it’s a reliable IG posts scraper for marketers, developers, data analysts, and researchers. Export clean datasets (JSON/CSV/Excel), sort results by time, and integrate with your data pipelines to move faster from collection to insight. Start scraping smarter and turn public Instagram feeds into actionable intelligence today.