Pricing

$40.00/month + usage

Instagram Profile & Post Scraper

A Python-based Instagram profile scraper that accepts a username or profile URL and extracts public profile details along with complete post information. The tool normalizes and outputs clean, post-level data ready for analysis, CSV/JSON export, or Apify dataset integration.

Pricing

$40.00/month + usage

Rating

0.0

(0)

Developer

Jamshaid Arif

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

Instagram Profile Scraper

This project scrapes public Instagram profiles using a username or profile URL and extracts complete post-level information in a structured format.

The scraper is designed for data analysis, research, and automation pipelines and outputs clean, flattened data ready for storage or further processing.

✨ Features

Scrape Instagram profiles using:
- ✅ Username (e.g. jamshaid_ds)
- ✅ Profile URL (e.g. https://www.instagram.com/jamshaid_ds)
Extract profile-level data
Extract all available post information
Automatically normalize nested data
Export results as:
- CSV
- JSON
- Apify Dataset (Actor.push_data)

📌 Extracted Profile Information

For each Instagram profile:

username
full_name
avatar_url
bio
website
followers
following
posts_count
is_private

📸 Extracted Post Information

For each post:

image_url
caption
download_link
posted_at
post_type (image / video / reel)

Each row in the final dataset represents one post.

🛠️ Tech Stack

Python 3.10+
Pandas
Async scraping
Apify Actor SDK (optional)
CSV / JSON data handling

🚀 Usage

1️⃣ Install Dependencies

$pip install -r requirements.txt

2️⃣ Provide Input

You can pass either:

Username

jamshaid_ds

Profile URL

https://www.instagram.com/jamshaid_ds/

The scraper automatically extracts the username from the URL if needed.

3️⃣ Run the Scraper

$python main.py

📤 Output Format

CSV Output

username,full_name,followers,following,image_url,caption,posted_at,post_type

JSON / Apify Dataset Output

{
  "username": "@jamshaid_ds",
  "full_name": "Jamshaid Arif",
  "image_url": "https://...",
  "caption": "CSLB SCRAPER...",
  "posted_at": "2025-10-22 08:07:48",
  "post_type": "image"
}

🔄 Data Normalization Logic

posts_data is converted from string → dictionary
Nested post data is flattened using pandas.json_normalize
Final dataset is post-level, not profile-level

This ensures compatibility with:

Databases (PostgreSQL, MySQL)
Analytics pipelines
Apify datasets

📦 Apify Integration (Optional)

If running as an Apify Actor:

await Actor.push_data(df_final.to_dict(orient="records"))

Each post is pushed as a separate dataset item.

⚠️ Limitations

Only public profiles are supported
Private accounts cannot be scraped
Instagram rate limits may apply
This tool does not bypass authentication

📄 Disclaimer

This project is for educational and research purposes only. Users are responsible for complying with Instagram’s Terms of Service and applicable laws.

Instagram Profile Post Scraper

simpleapi/instagram-profile-post-scraper

Instagram Profile Post Scraper extracts posts from any public Instagram profile, including captions, image/video URLs, hashtags, timestamps, and engagement metrics. Ideal for content analysis, influencer research, trend tracking, and automating structured Instagram post data collection

SimpleAPI

Instagram Profile Scraper

codenest/instagram-profile-scraper

Extract complete Instagram profile data including follower counts, business details, verification status, profile pictures, and engagement metrics in structured JSON format for analysis and integration. ✨Instagram Profile Scraper.

CodeNest

Instagram Profile Scraper

simpleapi/instagram-profile-scraper

Instagram Profile Scraper extracts data from any public Instagram profile, including username, bio, followers, following, posts, profile picture, and engagement insights. Ideal for influencer research, competitor analysis, marketing, and automating structured Instagram profile data collection

SimpleAPI

Instagram Profile Post Scraper

scraper-engine/instagram-profile-post-scraper

The Instagram Profile Post Scraper collects posts from any public Instagram profile with speed and precision. It extracts captions, images, videos, timestamps, hashtags, and engagement metrics. Use it for research, analytics, content monitoring, or tracking competitor activity.

Scraper Engine

Instagram Profile Post Scraper

scrapio/instagram-profile-post-scraper

Scrapes posts from any public Instagram profile, capturing captions, images, videos, timestamps, likes, comments, hashtags, and post URLs. Ideal for content research, competitor tracking, influencer analysis, and automated extraction of Instagram profile posts at scale

Scrapio

Instagram Profile Post Scraper

scrapier/instagram-profile-post-scraper

Scrape posts from individual Instagram profiles with the Instagram Profile Post Scraper. Extract images, videos, captions, hashtags, likes, comments, and timestamps. Perfect for content analysis, engagement tracking, and social media research.

Scrapier

Instagram Post Scraper

scraper-engine/instagram-post-scraper

Instagram Profile Post Scraper lets you collect structured post data from any public profile. Get captions, hashtags, media links, engagement stats, and publish times. Ideal for marketers, researchers, and developers needing fresh Instagram content insights in a usable format.

Scraper Engine

Instagram Profile Scraper

api-empire/instagram-profile-scraper

Instagram Profile Scraper extracts complete data from any public Instagram profile. Capture bios, posts, Reels, followers, following, hashtags, engagement metrics, and metadata. Ideal for research, influencer analysis, audits, and workflows needing structured Instagram profile insights.

API Empire

Instagram Complete Profile Scraper PPR

devil_port369-owner/instagram-complete-profile-scraper-ppr

Scrape Instagram profile details. Email and Phone also available if mentioned in bio profile and post caption or if it is a public account.

DataFusionX

557

4.2

Instagram Profile Scraper

scraper-engine/instagram-profile-scraper

Extract public Instagram profile data quickly and efficiently. The Instagram Profile Scraper actor collects usernames, bios, follower counts, post stats, and more. Perfect for research, analytics, or influencer discovery. Simple to use, fast, and reliable for automation workflows.

Scraper Engine

5.0