# BigCommerce App Marketplace Scraper (`automation-lab/bigcommerce-app-marketplace-scraper`) Actor Export BigCommerce app listings with ratings, pricing, categories, feature bullets, logos, support links, and app detail metadata. - **URL**: https://apify.com/automation-lab/bigcommerce-app-marketplace-scraper.md - **Developed by:** [Stas Persiianenko](https://apify.com/automation-lab) (community) - **Categories:** E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## BigCommerce App Marketplace Scraper Export BigCommerce App Marketplace listings into a clean dataset. This actor collects app names, marketplace URLs, categories, pricing, ratings, reviews, feature bullets, partner tiers, logos, and compatibility flags. It can also enrich each app from its public detail page with screenshots, videos, support links, installation guides, user guides, terms, privacy policy URLs, and update timestamps. Use it to build partner lead lists, monitor competitor integrations, compare ecommerce tooling, or power internal BigCommerce ecosystem research. ### What does BigCommerce App Marketplace Scraper do? BigCommerce App Marketplace Scraper extracts structured app listing data from the public BigCommerce app marketplace. It queries the same public marketplace search data used by BigCommerce's app directory UI. It returns one dataset row per marketplace app. Each row includes commercial and operational fields that are useful for ecommerce research. Typical fields include app name, URL, categories, rating, reviews, pricing text, feature bullets, logos, app type, and compatibility badges. When detail enrichment is enabled, the actor fetches each app detail page and adds support resources and media links. ### Who is it for? Ecommerce agencies use it to find app partners for client stores. SaaS partnership teams use it to discover BigCommerce ecosystem vendors. Integration vendors use it to track competing apps and categories. Growth teams use it to build vendor or app lead lists. Marketplace analysts use it to monitor pricing and category coverage. Data teams use it to feed BI dashboards and repeatable monitoring jobs. ### Why use this actor? The BigCommerce marketplace is valuable but not convenient to export manually. This actor turns marketplace search pages into a typed Apify dataset. You can filter by keyword and category slug. You can choose fast listing-only exports or richer detail-page exports. You can schedule runs to monitor changes over time. You can connect the output to Google Sheets, Airtable, CRM enrichment, or a warehouse. ### What data can you extract? | Field group | Examples | | --- | --- | | Identity | appName, slug, appUrl, appRegistryId, objectId | | Positioning | summary, description, features, collections | | Category | categories, parentCategorySlugs, childCategorySlugs | | Trust | rating, reviewCount, tierName, featured | | Pricing | pricing, pricingType, monthlyPrice, upfrontPrice, isFree, hasFreeTrial | | Compatibility | multiStorefront, multiLocation, singleClick, unifiedBilling, catalystCompatible | | Media | logoUrl, logoIconUrl, screenshots, videos | | Support | supportUrl, installationGuideUrl, userGuideUrl, termsOfServiceUrl, privacyPolicyUrl | ### How much does it cost to scrape BigCommerce apps? This actor uses pay-per-event pricing. There is a small start fee per run. There is a per-app charge for each saved dataset item. The exact tiered price shown on Apify depends on your Apify plan. Use a small `maxItems` value for tests. Use listing-only mode when you only need app cards. Enable detail enrichment only when you need support links, screenshots, videos, and policy URLs. ### Input options `startUrls` accepts the marketplace root or category URLs. For example, use `https://www.bigcommerce.com/apps/` for all apps. Use `https://www.bigcommerce.com/apps/categories/marketing/` to infer the `marketing` category slug. `searchQuery` searches app keywords such as `shipping`, `reviews`, `B2B`, `loyalty`, or `accounting`. `categories` accepts parent category slugs such as `shipping-fulfillment`, `marketing`, `accounting-tax`, or `catalog-order-management`. `maxItems` limits the number of app records saved. `includeDetails` fetches each detail page for richer media and support URLs. `minRating` optionally filters low-rated apps after search. ### Example input ```json { "startUrls": [{ "url": "https://www.bigcommerce.com/apps/" }], "searchQuery": "shipping", "categories": ["shipping-fulfillment"], "maxItems": 100, "includeDetails": false, "minRating": 0 } ```` ### Detail enrichment input ```json { "startUrls": [{ "url": "https://www.bigcommerce.com/apps/categories/marketing/" }], "categories": ["marketing"], "maxItems": 150, "includeDetails": true, "minRating": 3 } ``` ### Output example ```json { "appName": "ShipperHQ", "slug": "shipperhq", "appUrl": "https://www.bigcommerce.com/apps/shipperhq/", "summary": "Increase sales at checkout with customized rates...", "categories": ["All", "Shipping & Fulfillment", "Shipping Rates"], "rating": 4.1404, "reviewCount": 114, "pricing": "$350 / month", "pricingType": "Monthly", "isFree": true, "hasFreeTrial": true, "features": ["Stop Losing Money on Shipping"], "supportUrl": "https://docs.shipperhq.com/", "scrapedAt": "2026-06-28T00:00:00.000Z" } ``` ### How to scrape BigCommerce app listings 1. Open the actor on Apify. 2. Keep the default marketplace start URL or paste a category URL. 3. Add a search query if you want a specific topic. 4. Add category slugs if you want a focused directory export. 5. Set `maxItems` to the number of apps you need. 6. Turn on `includeDetails` only when you need detail-page data. 7. Start the run. 8. Download the dataset as JSON, CSV, Excel, XML, or HTML. ### Tips for best results Use broad queries such as `shipping`, `reviews`, or `accounting` to discover app segments. Use category slugs for repeatable monitoring. Use `includeDetails: false` for faster large exports. Use `includeDetails: true` for vendor research, support-link collection, and media audits. Set `minRating` only when you are comfortable excluding unrated or new apps. Schedule the actor weekly or monthly to monitor marketplace changes. ### Integrations Send app records to Google Sheets for manual review. Push vendor leads into Airtable for enrichment. Load output into BigQuery or Snowflake for marketplace analytics. Trigger Slack alerts when scheduled runs find new apps in a category. Combine with website contact enrichment to research vendors outside BigCommerce. Use Apify webhooks to notify your CRM workflow when a run completes. ### API usage with Node.js ```js import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('automation-lab/bigcommerce-app-marketplace-scraper').call({ searchQuery: 'shipping', categories: ['shipping-fulfillment'], maxItems: 100, includeDetails: false }); console.log(run.defaultDatasetId); ``` ### API usage with Python ```python from apify_client import ApifyClient client = ApifyClient() run = client.actor('automation-lab/bigcommerce-app-marketplace-scraper').call(run_input={ 'searchQuery': 'shipping', 'categories': ['shipping-fulfillment'], 'maxItems': 100, 'includeDetails': False, }) print(run['defaultDatasetId']) ``` ### API usage with cURL ```bash curl -X POST "https://api.apify.com/v2/acts/automation-lab~bigcommerce-app-marketplace-scraper/runs?token=$APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"searchQuery":"shipping","categories":["shipping-fulfillment"],"maxItems":100,"includeDetails":false}' ``` ### MCP: use from Claude Code or Claude Desktop You can call this actor through the Apify MCP server. Use a scoped MCP URL so Claude sees this tool directly. ```bash npx -y @apify/actors-mcp-server --actors automation-lab/bigcommerce-app-marketplace-scraper ``` MCP server URL: ```text https://mcp.apify.com/?tools=automation-lab/bigcommerce-app-marketplace-scraper ``` Claude Desktop JSON configuration: ```json { "mcpServers": { "apify-bigcommerce-apps": { "command": "npx", "args": [ "-y", "@apify/actors-mcp-server", "--actors", "automation-lab/bigcommerce-app-marketplace-scraper" ], "env": { "APIFY_TOKEN": "YOUR_APIFY_TOKEN" } } } } ``` Example prompts: - "Scrape the BigCommerce shipping app category and summarize top-rated apps." - "Create a CSV of BigCommerce B2B apps with pricing and support URLs." - "Monitor BigCommerce marketing apps monthly and highlight new listings." ### Common use cases Build a BigCommerce app vendor database. Compare shipping and fulfillment apps by price and rating. Track new ecommerce AI apps entering the marketplace. Find support and documentation URLs for integration partners. Audit marketplace category coverage for a SaaS product team. Collect screenshots and media links for app research. ### Category examples `shipping-fulfillment` covers shipping and fulfillment tools. `marketing` covers email, ads, loyalty, and customer acquisition tools. `accounting-tax` covers finance and accounting integrations. `catalog-order-management` covers operations tools. `b2b-wholesale` covers B2B and wholesale workflows. `analytics-reporting` covers analytics and reporting tools. ### Limitations The actor depends on the public BigCommerce marketplace website and search data. If BigCommerce changes its frontend search index, selectors or field names may need an update. Some vendor contact details are not present in the marketplace and are not guessed. External vendor websites are not crawled by default. Detail enrichment is slower because it fetches one page per app. Ratings, pricing, and review counts reflect the marketplace data available at run time. ### Troubleshooting If you get fewer apps than expected, remove `minRating` or broaden the search query. If a category returns no records, verify the category slug from a BigCommerce marketplace category URL. If detail fields are empty, run with `includeDetails: true`. If a run times out, reduce `maxItems` or disable detail enrichment. If output costs matter, test with 10 to 25 items before running a large export. ### Data freshness Each row contains `scrapedAt` with the run timestamp. Use scheduled runs to create historical snapshots. Compare datasets by `slug` or `appRegistryId` to detect changes. Ratings and pricing can change independently between runs. ### Legality This actor extracts publicly available marketplace information. You are responsible for using the data lawfully. Respect BigCommerce terms and applicable privacy regulations. Do not use scraped data for spam or abusive outreach. Avoid collecting personal data unless you have a lawful basis. ### Related scrapers Explore related Automation Labs actors for ecommerce, lead generation, and website research. Use website contact enrichment actors when you need vendor websites or public contact pages. Use general ecommerce scrapers when you need product catalog data instead of app marketplace data. Use review or social listening actors when you need customer sentiment outside the marketplace. ### FAQ #### Can it scrape all BigCommerce apps? Yes, set the marketplace root as `startUrls`, leave `searchQuery` blank, and raise `maxItems`. #### Can it scrape one category? Yes, pass a category URL or add a parent category slug such as `shipping-fulfillment`. #### Does it need a BigCommerce account? No. The actor uses public marketplace pages and public marketplace search data. #### Does it visit vendor websites? No. It only extracts marketplace app pages. Use a separate enrichment actor for vendor websites. #### Why are screenshots empty? Screenshots require `includeDetails: true` because they come from individual app pages. #### Can I monitor new apps? Yes. Schedule the actor and compare datasets by `slug`, `createdAt`, or `appRegistryId`. # Actor input Schema ## `startUrls` (type: `array`): BigCommerce marketplace root or category URLs. Category slugs are inferred from /apps/categories// URLs. ## `searchQuery` (type: `string`): Optional keyword to search apps, for example shipping, reviews, B2B, loyalty, email, or accounting. ## `categories` (type: `array`): Optional BigCommerce parent category slugs such as shipping-fulfillment, marketing, accounting-tax, or catalog-order-management. ## `maxItems` (type: `integer`): Maximum number of marketplace app records to save. ## `includeDetails` (type: `boolean`): Fetch each public app detail page to add screenshots, videos, support URLs, policy URLs, and update timestamps. Disable for fastest listing exports. ## `minRating` (type: `number`): Optional client-side minimum rating filter. Use 0 to keep unrated apps and all ratings. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.bigcommerce.com/apps/" } ], "searchQuery": "shipping", "categories": [ "shipping-fulfillment" ], "maxItems": 20, "includeDetails": false, "minRating": 0 } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.bigcommerce.com/apps/" } ], "searchQuery": "shipping", "categories": [ "shipping-fulfillment" ], "maxItems": 20, "includeDetails": false, "minRating": 0 }; // Run the Actor and wait for it to finish const run = await client.actor("automation-lab/bigcommerce-app-marketplace-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.bigcommerce.com/apps/" }], "searchQuery": "shipping", "categories": ["shipping-fulfillment"], "maxItems": 20, "includeDetails": False, "minRating": 0, } # Run the Actor and wait for it to finish run = client.actor("automation-lab/bigcommerce-app-marketplace-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.bigcommerce.com/apps/" } ], "searchQuery": "shipping", "categories": [ "shipping-fulfillment" ], "maxItems": 20, "includeDetails": false, "minRating": 0 }' | apify call automation-lab/bigcommerce-app-marketplace-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=automation-lab/bigcommerce-app-marketplace-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "BigCommerce App Marketplace Scraper", "description": "Export BigCommerce app listings with ratings, pricing, categories, feature bullets, logos, support links, and app detail metadata.", "version": "0.1", "x-build-id": "r0tZltxnf4NrIXFV2" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/automation-lab~bigcommerce-app-marketplace-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-automation-lab-bigcommerce-app-marketplace-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/automation-lab~bigcommerce-app-marketplace-scraper/runs": { "post": { "operationId": "runs-sync-automation-lab-bigcommerce-app-marketplace-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/automation-lab~bigcommerce-app-marketplace-scraper/run-sync": { "post": { "operationId": "run-sync-automation-lab-bigcommerce-app-marketplace-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "BigCommerce marketplace root or category URLs. Category slugs are inferred from /apps/categories// URLs.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "searchQuery": { "title": "Search query", "type": "string", "description": "Optional keyword to search apps, for example shipping, reviews, B2B, loyalty, email, or accounting." }, "categories": { "title": "Category slugs", "type": "array", "description": "Optional BigCommerce parent category slugs such as shipping-fulfillment, marketing, accounting-tax, or catalog-order-management.", "items": { "type": "string" } }, "maxItems": { "title": "Maximum apps", "minimum": 1, "maximum": 5000, "type": "integer", "description": "Maximum number of marketplace app records to save.", "default": 20 }, "includeDetails": { "title": "Include app detail pages", "type": "boolean", "description": "Fetch each public app detail page to add screenshots, videos, support URLs, policy URLs, and update timestamps. Disable for fastest listing exports.", "default": false }, "minRating": { "title": "Minimum rating", "minimum": 0, "maximum": 5, "type": "number", "description": "Optional client-side minimum rating filter. Use 0 to keep unrated apps and all ratings.", "default": 0 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```