Instagram Full Profile Scraper

Welcome to the Instagram Full Profile Scraper! This project utilizes the power of Crawlee and Puppeteer to scrape Instagram user data, specifically focusing on follower counts and following counts. This tool is designed for developers and data enthusiasts who want to gather insights from Instagram profiles efficiently.

Table of Contents

• Features
• Getting Started
• Input Schema
• How It Works
• Usage
• Contributing
• License

Features

• Scrapes follower and following counts for specified Instagram usernames.
• Utilizes a headless browser to mimic real user behavior, reducing the risk of detection.
• Supports proxy configurations to manage requests effectively.
• Easy to set up and use with customizable input options.

Getting Started

To get started with the Instagram Full Profile Scraper, follow these steps:

1. Clone the repository:

   git clone https://github.com/yourusername/instagram-full-profile-scraper.git
   cd instagram-full-profile-scraper
   

2. Install dependencies: Make sure you have Node.js installed, then run:

   $npm install
   

3. Set up your Apify account: Create an account on Apify if you haven't already. You'll need your API token for authentication.

4. Configure your input: Update the input_schema.json file to include the Instagram usernames you want to scrape.

Input Schema

The input schema defines the structure of the input data for the scraper. It expects an array of Instagram usernames:

{
    "title": "PuppeteerCrawler Template",
    "type": "object",
    "schemaVersion": 1,
    "properties": {
        "instagramUsernames": {
            "title": "Instagram Usernames",
            "type": "array",
            "editor": "stringList",
            "description": "Array of Instagram account usernames.",
            "prefill": ["mohamedgbelhadi"]
        }
    }
}

How It Works

The scraper uses Puppeteer to launch a headless browser that navigates to each specified Instagram profile. It intercepts network requests to gather follower and following counts from the Instagram GraphQL API. The data is then stored in a dataset for easy access and analysis.

Usage

To run the scraper, use the following command:

$apify run

You can also run it directly from the Apify platform by creating a new actor and uploading the project files.

Contributing

Contributions are welcome! If you have suggestions for improvements or new features, feel free to open an issue or submit a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Thank you for using the Instagram Full Profile Scraper! We hope it helps you gather valuable insights from Instagram profiles. If you have any questions or need support, please reach out to us on the Apify community forums.