# Apify Store Scraper (`scoutlayer/apify-store-scraper`) Actor A powerful Apify Actor designed to extract comprehensive data from the Apify Store. This scraper can discover available Actors, collect detailed Actor information, and extract key metadata, making it perfect for market research and competitor analysis. - **URL**: https://apify.com/scoutlayer/apify-store-scraper.md - **Developed by:** [ScoutLayer](https://apify.com/scoutlayer) (community) - **Categories:** Agents, Developer tools, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $3.90 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README Scrape data from the [Apify Store](https://apify.com/store) including actor details, reviews, pricing, issues, and organization profiles. Powered by [ScoutLayer](https://scoutlayer.io). ### Features - **Seed**: Discover all actor slugs from Apify's sitemaps - **Actor Detail**: Get full metadata for specific actors (description, stats, pricing, categories, developer info) - **Actor Reviews**: Extract reviews with ratings and content - **Actor Issues**: Fetch issue threads with full body and comments - **Org Profile**: Get organization profiles with their published actors ### Input #### Scrape Type Select the type of data to scrape using the `scrapeType` field: | Value | Description | | ---------------- | ------------------------------------------------------------- | | `seed` | Discover all actor slugs from Apify sitemaps (no `slugs` needed) | | `actor` | Fetch full detail + pricing for one or more actors | | `actor-reviews` | Extract reviews for one or more actors | | `actor-issues` | Fetch issue threads (with body and comments) for one or more actors | | `org` | Fetch organization profile and their published actors | #### All Input Fields | Field | Type | Required for | Description | | ------------ | ------ | ----------------------------------------- | ----------- | | `scrapeType` | string | Always | Scrape type (see table above) | | `slugs` | array | `actor`, `actor-reviews`, `actor-issues`, `org` | Actor or org slugs, e.g. `["apify/web-scraper"]` or `["apify"]` | ### Output Results are stored in the **dataset** under the key `results`. The shape varies by scrape type. #### Seed Each result is a discovered actor slug. ```json { "slug": "apify/web-scraper" } ```` #### Actor Detail ```json { "name": "Web Scraper", "slug": "apify/web-scraper", "description": "Crawls arbitrary websites using the Chrome browser...", "avatarUrl": "https://apify.com/...", "actorId": "moJRLRc85AitArpNN", "pricingSummary": "Free, $49/month", "rating": 4.7, "reviewCount": 312, "developer": { "name": "Apify", "url": "https://apify.com/apify", "maintainedBy": "Apify" }, "stats": { "bookmarked": "2.5k", "totalUsers": "180k", "monthlyUsers": "12k", "issuesResponse": "< 1 day", "lastModified": "2 days ago" }, "categories": [ { "name": "Scraping", "handle": "scraping", "url": "https://apify.com/store/categories/scraping" } ], "pricing": { "plans": ["Free", "Scale"], "items": [ { "name": "Actor compute units", "isPrimary": true, "prices": { "Free": "$0.30/CU", "Scale": "$0.25/CU" } } ] } } ``` #### Actor Reviews ```json { "slug": "apify/web-scraper", "avgRating": 4.7, "totalReviews": 312, "reviews": [ { "username": "john_doe", "timestamp": "3 months ago", "stars": 5, "content": "Works great for large-scale crawls." } ] } ``` #### Actor Issues ```json { "slug": "apify/web-scraper", "issues": [ { "id": "abc123", "title": "Memory limit exceeded on large datasets", "url": "https://apify.com/apify/web-scraper/issues/abc123", "author": "jane_smith", "createdAt": "2024-05-10", "status": "open", "commentCount": 3, "body": "When processing more than 10k URLs the actor crashes with OOM...", "comments": [ { "author": "apify_support", "createdAt": "2024-05-11", "content": "Thank you for reporting this. We are investigating..." } ] } ] } ``` #### Org Profile ```json { "name": "Apify", "username": "apify", "avatarUrl": "https://apify.com/...", "bio": "The full-stack web scraping and data extraction platform.", "joinDate": "January 2018", "metrics": { "Actors": "120", "Runs": "50M+" }, "actors": [ { "name": "Web Scraper", "slug": "apify/web-scraper", "url": "https://apify.com/apify/web-scraper", "description": "Crawls arbitrary websites using the Chrome browser...", "authorFullName": "Apify", "totalUsers": "180k", "rating": "4.7", "ratingCount": "312" } ] } ``` ### Usage Examples #### Discover All Actors (Seed) ```json { "scrapeType": "seed" } ``` #### Scrape Actor Detail ```json { "scrapeType": "actor", "slugs": ["apify/web-scraper", "apify/cheerio-scraper"] } ``` #### Scrape Actor Reviews ```json { "scrapeType": "actor-reviews", "slugs": ["apify/web-scraper"] } ``` #### Scrape Actor Issues ```json { "scrapeType": "actor-issues", "slugs": ["apify/web-scraper"] } ``` #### Scrape Org Profile ```json { "scrapeType": "org", "slugs": ["apify"] } ``` ### Support For issues or questions, visit [scoutlayer.io](https://scoutlayer.io). # Actor input Schema ## `scrapeType` (type: `string`): What to scrape. Choose one of the available modes. ## `slugs` (type: `array`): One or more slugs in {org}/{actor\_name} format (e.g. compass/crawler-google-places). Used for all scrape types. ## `maxReviewPages` (type: `integer`): Maximum number of review pages to fetch per actor. Each page contains multiple reviews. Defaults to 3. ## `maxIssuePages` (type: `integer`): Maximum number of issue list pages to fetch per actor. Defaults to 3. ## Actor input object example ```json { "scrapeType": "actor", "slugs": [ "compass/crawler-google-places", "apify/web-scraper" ], "maxReviewPages": 3, "maxIssuePages": 3 } ``` # Actor output Schema ## `results` (type: `string`): URL of the dataset with the results ## `crawlStats` (type: `string`): Statistics about the crawl process # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "slugs": [ "compass/crawler-google-places", "apify/web-scraper" ] }; // Run the Actor and wait for it to finish const run = await client.actor("scoutlayer/apify-store-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "slugs": [ "compass/crawler-google-places", "apify/web-scraper", ] } # Run the Actor and wait for it to finish run = client.actor("scoutlayer/apify-store-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "slugs": [ "compass/crawler-google-places", "apify/web-scraper" ] }' | apify call scoutlayer/apify-store-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scoutlayer/apify-store-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Apify Store Scraper", "description": "A powerful Apify Actor designed to extract comprehensive data from the Apify Store. This scraper can discover available Actors, collect detailed Actor information, and extract key metadata, making it perfect for market research and competitor analysis.", "version": "0.0", "x-build-id": "6VkuJnwlvEPa59YvS" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scoutlayer~apify-store-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scoutlayer-apify-store-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scoutlayer~apify-store-scraper/runs": { "post": { "operationId": "runs-sync-scoutlayer-apify-store-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scoutlayer~apify-store-scraper/run-sync": { "post": { "operationId": "run-sync-scoutlayer-apify-store-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "scrapeType" ], "properties": { "scrapeType": { "title": "Scrape Type", "enum": [ "seed", "actor", "actor-reviews", "actor-issues", "org" ], "type": "string", "description": "What to scrape. Choose one of the available modes.", "default": "actor" }, "slugs": { "title": "Actor / Org Slugs", "type": "array", "description": "One or more slugs in {org}/{actor_name} format (e.g. compass/crawler-google-places). Used for all scrape types.", "items": { "type": "string" } }, "maxReviewPages": { "title": "Max Review Pages", "minimum": 1, "type": "integer", "description": "Maximum number of review pages to fetch per actor. Each page contains multiple reviews. Defaults to 3.", "default": 3 }, "maxIssuePages": { "title": "Max Issue Pages", "minimum": 1, "type": "integer", "description": "Maximum number of issue list pages to fetch per actor. Defaults to 3.", "default": 3 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```