BigCommerce Appstore Scraper

A powerful Apify Actor designed to extract comprehensive data from the BigCommerce App Marketplace. This scraper can discover all available apps, collect detailed application information, and extract user reviews from any BigCommerce app, making it perfect for market research, competitor analysis, and app performance monitoring.

Use Cases

• Complete App Store Discovery: Get a comprehensive list of all available BigCommerce apps for market analysis
• Market Research: Analyze competitors' app features, pricing, and user feedback
• App Performance Monitoring: Track your own app's reviews and ratings over time
• Pricing Analysis: Compare pricing strategies across similar apps
• Feature Comparison: Understand what features successful apps offer
• Review Sentiment Analysis: Process user reviews for insights and trends
• Developer Research: Identify top app developers and their portfolios
• Data Pipeline Creation: Use listing mode to discover apps, then batch process them for detailed analysis

Features

• Triple Scraping Modes: Discover all app URLs, extract detailed app information, or collect user reviews with simple configuration
• Bulk Processing: Process multiple BigCommerce app URLs in a single run
• Automatic Pagination: Seamlessly handle multi-page review scraping
• Rich Data Extraction: Capture comprehensive app metadata and detailed review information
• Proxy Support: Built-in proxy rotation for reliable scraping
• TypeScript Support: Fully typed for better development experience

Data Types

Listing Mode

Discovers and extracts all available BigCommerce app URLs from the app store including:

• Complete app URL catalog
• App handles/identifiers
• Total app count
• Filtered results (excludes non-app pages)

App Information Mode

Extracts comprehensive application details including:

• Basic app information (title, description, logo, rating)
• Developer information (name, website, email)
• Pricing plans and features
• App categories and tags
• Screenshots and compatibility
• And much more...

Review Mode

Captures detailed user review data including:

• Review content and ratings
• Review dates and metadata
• Reviewer information
• Pagination metadata

Input Parameters

type (Required)

Specifies the type of data to scrape.

Options:

• "listing" - Discover and extract all BigCommerce app URLs from the app store
• "app" - Extract detailed app information
• "review" - Extract user reviews and ratings

Default: "listing"

appUrls (Array, Required for app/review modes)

List of BigCommerce app URLs to scrape. Each URL should point to a valid BigCommerce app page.

Note: This parameter is not needed when type is set to "listing", as the scraper will automatically discover all app URLs from the BigCommerce App Store.

Example:

[
  {
    "url": "https://www.bigcommerce.com/apps/quote-ninja"
  },
  {
    "url": "https://www.bigcommerce.com/apps/mailchimp"
  }
]

maxPages (Number, Optional)

Maximum number of pages to scrape when using listing or review modes. Controls the depth of extraction.

Default: 10 Range: 1-50 (recommended)

startPage (Number, Optional)

Starting page number for listing or review modes.

Default: 1

Output Data

Listing Output

When type is set to "listing", the scraper returns a comprehensive list of all BigCommerce app URLs:

[
    {
      "url": "https://www.bigcommerce.com/apps/quote-ninja",
      "currentPage": 1,
      "totalApps": 25,
      "apps": [
        {
          "url": "https://www.bigcommerce.com/apps/quote-ninja",
          "handle": "quote-ninja",
          "title": "B2B Ninja Quote Request & Management",
          "description": "Create professional quotes and estimates for your B2B customers",
          "category": "Quoting",
          "rating": "4.65",
          "developer": "B2B Ninja",
          "logo": "https://example.com/logo.png"
        }
      ]
    }
]

Listing Field Descriptions:

• url: URL of the category page that was scraped
• currentPage: Current page number in pagination
• totalApps: Total number of apps found on this page
• apps: Array of app objects, each containing:
  • url: Complete URL to the app's page on BigCommerce App Store
  • handle: Unique identifier/slug for the app (extracted from URL)
  • title: App name
  • description: Brief app description
  • category: Primary app category
  • rating: Average user rating
  • developer: Developer name
  • logo: App logo URL

App Information Output

When type is set to "app", the scraper returns comprehensive app data:

{
  "url": "https://www.bigcommerce.com/apps/quote-ninja",
  "handle": "quote-ninja",
  "title": "B2B Ninja Quote Request & Management",
  "description": "Create and manage professional quotes and estimates for your BigCommerce store. The best quoting app on BC with unmatched support and comprehensive features.",
  "logo": "https://example.com/logo.png",
  "rating": "4.65",
  "developer": {
    "name": "B2B Ninja",
    "website": "https://www.b2bninja.com/contact?referral=bigcommerce-app-listing",
    "email": ""
  },
  "categories": ["Quoting", "B2B", "Estimates"],
  "pricing": "Custom Pricing: Plans Starting at $75/ month",
  "pricings": [
    {
      "planName": "Custom Pricing",
      "planPrice": "$75/ month",
      "planDescription": "Plans Starting at $75/ month"
    }
  ],
  "screenshots": ["https://example.com/screenshot1.png", "https://example.com/screenshot2.png"],
  "features": ["Custom quote templates", "Professional quotes", "PDF quotes", "Customer management"],
  "tags": ["quoting", "b2b", "estimates"],
  "compatibility": ["BigCommerce Commerce", "All themes"],
  "reviews": {
    "averageRating": 4.65,
    "totalReviews": 49
  }
}

App Information Field Descriptions:

• url: Original app URL that was scraped
• handle: Unique app identifier
• title: Official app name as displayed on the store
• description: Complete app description including features and benefits
• logo: Direct URL to the app's logo image
• rating: Average user rating
• developer: Object containing developer information
  • name: Developer or company name
  • website: Developer's contact website
  • email: Developer's email (if available)
• categories: Array of app categories the app belongs to
• pricing: General pricing information summary
• pricings: Detailed array of all available pricing plans
• screenshots: Array of app screenshot URLs
• features: List of key app features
• tags: App tags for classification
• compatibility: Platform compatibility information
• reviews: Review summary with average rating and total count

Review Output

When type is set to "review", the scraper returns detailed review data:

{
  "url": "https://www.bigcommerce.com/apps/quote-ninja",
  "currentPage": 1,
  "totalReviews": 3,
  "reviews": [
    {
      "app_url": "https://www.bigcommerce.com/apps/quote-ninja",
      "app_name": "B2B Ninja Quote Request & Management",
      "reviewer": "Anonymous Reviewer",
      "review_created_date": "May 5, 2021",
      "reviewer_location": "",
      "rating": 5,
      "reviewer_latest_used_date": "",
      "review_content": "The features of this app have been a huge help for us quoting and selling our B2B customers. The quotes are professional look and give lots of room for customization. Our customers appreciate the ease of use, and we've appreciated the additional sales."
    },
    {
      "app_url": "https://www.bigcommerce.com/apps/quote-ninja",
      "app_name": "B2B Ninja Quote Request & Management",
      "reviewer": "Anonymous Reviewer",
      "review_created_date": "Apr 29, 2021",
      "reviewer_location": "",
      "rating": 5,
      "reviewer_latest_used_date": "",
      "review_content": "First - Thank you so much John for all your support. Second - If you are looking for a B2B solution for Big Commerce this is the ONLY company to go with. They have repeatedly gone above and beyond to help us get set up and going with their product."
    }
  ]
}

Review Field Descriptions:

• url: URL of the review page that was scraped
• currentPage: Current page number in review pagination
• totalReviews: Number of reviews found on this page
• reviews: Array of review objects, each containing:
  • app_url: URL of the app being reviewed
  • app_name: Name of the app
  • reviewer: Name of the person who left the review
  • review_created_date: Date when the review was posted
  • reviewer_location: Geographic location of the reviewer
  • rating: Individual review rating (1-5 scale)
  • reviewer_latest_used_date: How long the reviewer has been using the app
  • review_content: Complete text content of the review

🛠️ Usage Examples

Example 1: Discover All App URLs

{
  "type": "listing"
}

Note: No appUrls parameter needed for listing mode. This will automatically discover all apps in the BigCommerce App Store.

Example 2: Scrape App Information

{
  "appUrls": [
    {"url": "https://www.bigcommerce.com/apps/quote-ninja"},
    {"url": "https://www.bigcommerce.com/apps/mailchimp"}
  ],
  "type": "app"
}

Example 3: Scrape Reviews with Pagination

{
  "appUrls": [
    {"url": "https://www.bigcommerce.com/apps/quote-ninja"}
  ],
  "type": "review",
  "maxPages": 10
}

Example 4: Bulk App Analysis

{
  "appUrls": [
    {"url": "https://www.bigcommerce.com/apps/mailchimp"},
    {"url": "https://www.bigcommerce.com/apps/klaviyo"},
    {"url": "https://www.bigcommerce.com/apps/product-reviews"},
    {"url": "https://www.bigcommerce.com/apps/smile-loyalty"}
  ],
  "type": "app"
}

Example 5: Complete Data Pipeline

Step 1 - Discover all apps:

{
  "type": "listing",
  "maxPages": 20
}

Step 2 - Use the discovered URLs to get detailed app information:

{
  "appUrls": [
    {"url": "https://www.bigcommerce.com/apps/quote-ninja"},
    {"url": "https://www.bigcommerce.com/apps/mailchimp"},
    "...all other URLs from step 1..."
  ],
  "type": "app"
}

Step 3 - Collect reviews for top apps:

{
  "appUrls": [
    {"url": "https://www.bigcommerce.com/apps/quote-ninja"}
  ],
  "type": "review",
  "maxPages": 5
}

💡 Best Practices

For Market Research

1. Start with listing mode to discover all apps in your target categories
2. Use app mode to extract detailed information about competitors
3. Combine with review mode to understand customer sentiment

For App Developers

1. Monitor your app's reviews regularly with review mode
2. Track competitor updates and pricing changes with app mode
3. Use review data to identify improvement opportunities

For Business Intelligence

1. Set up regular scraping schedules to monitor market changes
2. Use pagination controls to manage large datasets
3. Combine multiple modes for comprehensive market analysis

🚀 Getting Started

1. Choose your scraping mode based on what data you need
2. Configure your input with the appropriate parameters
3. Run the scraper and collect your data
4. Analyze the results using your preferred tools

📞 Support

• BigCommerce App Marketplace - Target website
• Apify Platform - Where you can run this scraper
• Apify Documentation - Platform documentation