Apify Instagram Profile Scraper

Unlock the power of Instagram data with our comprehensive Profile Scraper. Extract detailed user information, engagement metrics, and post data to fuel your social media analysis and marketing strategies.

Overview

This Apify actor allows you to scrape detailed information from Instagram profiles, including user details, post data, and engagement metrics. It's perfect for social media marketers, researchers, and analysts looking to gather insights from Instagram profiles.

Features

• Profile Details: Extract comprehensive information about Instagram users.
• Post Data: Gather details about recent posts, including engagement metrics.
• Flexible Input: Accept both Instagram profile URLs and usernames.
• Customizable Depth: Option to include or exclude detailed post data.
• Proxy Support: Built-in proxy configuration to enhance scraping reliability and avoid blocks.
• Concurrent Scraping: Efficiently scrape multiple profiles with adjustable concurrency.

How to Use

1. Set Up: Ensure you have an Apify account and access to the Apify platform.
2. Configure Input: Set the Instagram profile URL(s) or username(s) you want to scrape (see Input Configuration section).
3. Adjust Settings: Configure options like including posts, concurrency, and proxy settings as needed.
4. Run the Scraper: Execute the scraper on the Apify platform.
5. Data Collection: The scraper will output detailed data about the specified Instagram profile(s).

Input Configuration

Here's an example of how to set up the input for the Apify Instagram Profile Scraper:

1{
2    "startUrls": [
3        {
4            "url": "https://www.instagram.com/9gag/"
5        }
6    ],
7    "includePosts": true,
8    "maxConcurrency": 10,
9    "minConcurrency": 1,
10    "maxRequestRetries": 100,
11    "proxyConfiguration": {
12        "useApifyProxy": true
13    }
14}

Input Fields Explanation

• startUrls: Array containing Instagram profile URLs or usernames to scrape.
• includePosts: Boolean to determine whether to scrape detailed post data (default: true).
• maxConcurrency: Maximum number of pages processed simultaneously (default: 10).
• minConcurrency: Minimum number of pages processed simultaneously (default: 1).
• maxRequestRetries: Number of retries for failed requests (default: 100).
• proxyConfiguration: Proxy settings for enhanced scraping reliability.

Main Profile Output Structure

The scraper provides comprehensive information about the Instagram profile. Here's a detailed breakdown of the main profile data structure:

1{
2    "username": "9gag",
3    "ai_agent_type": null,
4    "biography": "Building @memeland, one meme at a time.",
5    "bio_links": [],
6    "fb_profile_biolink": null,
7    "biography_with_entities": {
8        "raw_text": "Building @memeland, one meme at a time.",
9        "entities": [
10            {
11                "user": {
12                    "username": "memeland"
13                },
14                "hashtag": null
15            }
16        ]
17    },
18    "blocked_by_viewer": false,
19    "restricted_by_viewer": null,
20    "country_block": false,
21    "eimu_id": "113920296666051",
22    "external_url": null,
23    "external_url_linkshimmed": null,
24    "fbid": "17841400624184050",
25    "followed_by_viewer": false,
26    "follows_viewer": false,
27    "full_name": "9GAG: Go Fun The World",
28    "group_metadata": null,
29    "has_ar_effects": false,
30    "has_clips": true,
31    "has_guides": false,
32    "has_channel": false,
33    "has_blocked_viewer": false,
34    "highlight_reel_count": 189,
35    "has_requested_viewer": false,
36    "hide_like_and_view_counts": false,
37    "id": "259220806",
38    "is_business_account": false,
39    "is_professional_account": true,
40    "is_supervision_enabled": false,
41    "is_guardian_of_viewer": false,
42    "is_supervised_by_viewer": false,
43    "is_supervised_user": false,
44    "is_embeds_disabled": false,
45    "is_joined_recently": false,
46    "guardian_id": null,
47    "business_address_json": null,
48    "business_contact_method": "UNKNOWN",
49    "business_email": null,
50    "business_phone_number": null,
51    "business_category_name": null,
52    "overall_category_name": null,
53    "category_enum": null,
54    "category_name": "Community",
55    "is_private": false,
56    "is_verified": true,
57    "is_verified_by_mv4b": false,
58    "is_regulated_c18": false,
59    "pinned_channels_list_count": 0,
60    "profile_pic_url": "https://scontent-hel3-1.cdninstagram.com/v/t51.2885-19/370567515_318435303994381_993276187258308098_n.jpg?stp=dst-jpg_e0_s150x150&_nc_ht=scontent-hel3-1.cdninstagram.com&_nc_cat=1&_nc_ohc=UvA15REi1WAQ7kNvgGJXobM&_nc_gid=e9c28cbb6f984a63bf68b31e55da67c4&edm=AOQ1c0wBAAAA&ccb=7-5&oh=00_AYB816_klJQh6N6LYFqgS-CWgFqtD7HZTWiSbPXhqSaVcA&oe=670583BC&_nc_sid=8b3546",
61    "profile_pic_url_hd": "https://scontent-hel3-1.cdninstagram.com/v/t51.2885-19/370567515_318435303994381_993276187258308098_n.jpg?stp=dst-jpg_s320x320&_nc_ht=scontent-hel3-1.cdninstagram.com&_nc_cat=1&_nc_ohc=UvA15REi1WAQ7kNvgGJXobM&_nc_gid=e9c28cbb6f984a63bf68b31e55da67c4&edm=AOQ1c0wBAAAA&ccb=7-5&oh=00_AYDenYKJnX60IiaweO1g4X4UtrRCgexfJSWBdoicx03jBQ&oe=670583BC&_nc_sid=8b3546",
62    "requested_by_viewer": false,
63    "should_show_category": false,
64    "should_show_public_contacts": false,
65    "show_account_transparency_details": true,
66    "transparency_label": null,
67    "transparency_product": null,
68    "connected_fb_page": null,
69    "pronouns": []
70}

Detailed Field Explanations

• username: The account's unique username on Instagram.
• biography: The user's bio text as displayed on their profile.
• biography_with_entities: Parsed version of the bio, including any mentions or hashtags.
  • raw_text: The unprocessed bio text.
  • entities: Array of parsed entities (e.g., mentioned users, hashtags) in the bio.
• bio_links: Array of links included in the user's bio (empty in this example).
• fb_profile_biolink: Facebook profile link, if connected (null in this example).
• blocked_by_viewer, restricted_by_viewer: Indicates the viewer's relationship to the account.
• country_block: Whether the account is blocked in certain countries.
• eimu_id, fbid: Unique identifiers associated with the account.
• external_url, external_url_linkshimmed: Website link in the profile, if any.
• followed_by_viewer, follows_viewer: Indicates the viewer's follow relationship with the account.
• full_name: The account's displayed full name.
• has_ar_effects, has_clips, has_guides, has_channel: Flags for various Instagram features.
• highlight_reel_count: Number of story highlights.
• id: Instagram's internal ID for the account.
• is_business_account, is_professional_account: Account type indicators.
• is_private: Whether the account is set to private.
• is_verified: Whether the account is verified by Instagram.
• category_name: The category of the account (e.g., "Community").
• profile_pic_url, profile_pic_url_hd: URLs for the profile picture in different resolutions.
• show_account_transparency_details: Whether the account shows additional transparency information.
• pronouns: Array of pronouns specified by the user (empty in this example).

Business Account Specific Fields

(These fields may be null for non-business accounts)

• business_address_json: JSON string of the business address.
• business_contact_method: Preferred contact method for the business.
• business_email, business_phone_number: Contact information for the business.
• business_category_name, overall_category_name: Categorization of the business account.

Privacy and Interaction Fields

• hide_like_and_view_counts: Whether the account hides like and view counts.
• is_supervised_user, is_supervision_enabled, is_guardian_of_viewer, is_supervised_by_viewer: Related to Instagram's supervision features for younger users.
• requested_by_viewer: Whether the viewer has sent a follow request to this account.

This comprehensive profile data structure provides a detailed view of an Instagram account, including its characteristics, features, and relationship to the viewer. It's particularly useful for analyzing account types, engagement potential, and overall Instagram presence.

Post Output Structure

When includePosts is set to true, the scraper will also collect detailed information about the profile's posts. Here's a sample of the structure for an individual post:

1{
2    "__typename": "GraphSidecar",
3    "id": "3469075288652210520",
4    "shortcode": "DAkoZhXM2FY",
5    "dimensions": {
6        "height": 1080,
7        "width": 1080
8    },
9    "display_url": "https://scontent-hel3-1.cdninstagram.com/v/t39.30808-6/461629529_971130758386291_5420258254654430438_n.jpg?stp=dst-jpg_e15_fr_s1080x1080&_nc_ht=scontent-hel3-1.cdninstagram.com&_nc_cat=1&_nc_ohc=OdRBnB7RMscQ7kNvgFSRK9P&_nc_gid=e9c28cbb6f984a63bf68b31e55da67c4&edm=AOQ1c0wAAAAA&ccb=7-5&ig_cache_key=MzQ2OTA3NTI2OTcxMDY1MzQxNw%3D%3D.3-ccb7-5&oh=00_AYDRAbNYWS_y49ETPRcw8cHUB__DiMp9rOlai9F9OR8NQQ&oe=67058D55&_nc_sid=8b3546",
10    "edge_media_to_tagged_user": {
11        "edges": []
12    },
13    "fact_check_overall_rating": null,
14    "fact_check_information": null,
15    "gating_info": null,
16    "sharing_friction_info": {
17        "should_have_sharing_friction": false,
18        "bloks_app_url": null
19    },
20    "media_overlay_info": null,
21    "media_preview": null,
22    "owner": {
23        "id": "259220806",
24        "username": "9gag"
25    },
26    "is_video": false,
27    "has_upcoming_event": false,
28    "accessibility_caption": "Photo by 9GAG: Go Fun The World on October 01, 2024. May be a cartoon of 1 person, costume, poster, sports equipment, pumpkin and text.",
29    "edge_media_to_caption": {
30        "edges": [
31            {
32                "node": {
33                    "text": "It's officially Halloween season🎃👻\n-\n#halloween #halloweencostume #october #cosplay #memes #9gag"
34                }
35            }
36        ]
37    },
38    "edge_media_to_comment": {
39        "count": 666
40    },
41    "comments_disabled": false,
42    "taken_at_timestamp": 1727766022,
43    "edge_liked_by": {
44        "count": 125442
45    },
46    "edge_media_preview_like": {
47        "count": 125442
48    },
49    "location": null,
50    "nft_asset_info": null,
51    "thumbnail_src": "https://scontent-hel3-1.cdninstagram.com/v/t39.30808-6/461629529_971130758386291_5420258254654430438_n.jpg?stp=dst-jpg_e35_s640x640_sh0.08&_nc_ht=scontent-hel3-1.cdninstagram.com&_nc_cat=1&_nc_ohc=OdRBnB7RMscQ7kNvgFSRK9P&_nc_gid=e9c28cbb6f984a63bf68b31e55da67c4&edm=AOQ1c0wAAAAA&ccb=7-5&ig_cache_key=MzQ2OTA3NTI2OTcxMDY1MzQxNw%3D%3D.3-ccb7-5&oh=00_AYDP0U8fg7RkSr5Omc_9SZlcEvh7ipAkfu3EhuNMkJCSWw&oe=67058D55&_nc_sid=8b3546",
52    "thumbnail_resources": [
53        // Array of thumbnail objects with different sizes
54    ],
55    "coauthor_producers": [],
56    "pinned_for_users": [
57        {
58            "id": "259220806",
59            "is_verified": true,
60            "profile_pic_url": "https://scontent-hel3-1.cdninstagram.com/v/t51.2885-19/370567515_318435303994381_993276187258308098_n.jpg?stp=dst-jpg_e0_s150x150&_nc_ht=scontent-hel3-1.cdninstagram.com&_nc_cat=1&_nc_ohc=UvA15REi1WAQ7kNvgGJXobM&_nc_gid=e9c28cbb6f984a63bf68b31e55da67c4&edm=AOQ1c0wBAAAA&ccb=7-5&oh=00_AYB816_klJQh6N6LYFqgS-CWgFqtD7HZTWiSbPXhqSaVcA&oe=670583BC&_nc_sid=8b3546",
61            "username": "9gag"
62        }
63    ],
64    "viewer_can_reshare": true,
65    "like_and_view_counts_disabled": false,
66    "edge_sidecar_to_children": {
67        "edges": [
68            // Array of child media objects for carousel posts
69        ]
70    }
71}

Post Fields Explanation

• __typename: Type of the post (e.g., "GraphSidecar" for carousel posts, "GraphImage" for single image posts, "GraphVideo" for video posts).
• id: Unique identifier for the post.
• shortcode: Short code used in the post's URL.
• dimensions: Height and width of the post media.
• display_url: URL of the full-size image.
• edge_media_to_tagged_user: Information about users tagged in the post.
• owner: Basic information about the post owner.
• is_video: Boolean indicating if the post is a video.
• accessibility_caption: Auto-generated caption for accessibility purposes.
• edge_media_to_caption: The post's caption text.
• edge_media_to_comment: Comment count on the post.
• comments_disabled: Boolean indicating if comments are disabled.
• taken_at_timestamp: Unix timestamp of when the post was created.
• edge_liked_by: Like count on the post.
• location: Location information (if available).
• thumbnail_src: URL of the post thumbnail.
• thumbnail_resources: Array of thumbnail URLs in different sizes.
• coauthor_producers: Information about co-authors (if any).
• pinned_for_users: Information about users for whom this post is pinned.
• edge_sidecar_to_children: For carousel posts, contains information about each item in the carousel.

Additional Notes

• Video posts will have additional fields like video_url and video_view_count.
• Carousel posts will have multiple child media objects in the edge_sidecar_to_children.edges array.
• The actual content of some fields (like edge_media_to_tagged_user or location) may vary depending on the specific post.

This detailed post structure allows for comprehensive analysis of Instagram content, including engagement metrics, media details, and associated metadata.

Explore More Scrapers

If you found this Apify Smartbuyglasses Scraper useful, be sure to check out our other powerful scrapers and actors at memo23's Apify profile. We offer a wide range of tools to enhance your web scraping and automation needs across various platforms and use cases.

Support

• For issues or feature requests, please use the Issues section of this actor.
• If you need customization or have questions, feel free to contact the author:
  • Author's website: https://muhamed-didovic.github.io/
  • Email: muhamed.didovic@gmail.com

Additional Services

• Request customization or whole dataset: muhamed.didovic@gmail.com
• If you need anything else scraped, or this actor customized, email: muhamed.didovic@gmail.com
• For API services of this scraper (no Apify fee, just usage fee for the API), contact: muhamed.didovic@gmail.com
• Email: muhamed.didovic@gmail.com