# AWS Marketplace Listings Scraper (`automation-lab/aws-marketplace-listings-scraper`) Actor Extract AWS Marketplace product listings, vendors, pricing models, delivery methods, ratings, badges, categories, descriptions, and URLs. - **URL**: https://apify.com/automation-lab/aws-marketplace-listings-scraper.md - **Developed by:** [Stas Persiianenko](https://apify.com/automation-lab) (community) - **Categories:** E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## AWS Marketplace Listings Scraper Extract public AWS Marketplace listings for cloud software competitive intelligence, vendor research, partner-channel discovery, and sales lead generation. The actor searches AWS Marketplace the same way a buyer would, then returns structured listing data such as title, vendor, category, delivery method, pricing model, badges, ratings, logo URL, product URL, and descriptions. ### What does AWS Marketplace Listings Scraper do? AWS Marketplace Listings Scraper turns AWS Marketplace search results into a clean dataset. It is built for public listing intelligence. It does not require an AWS account. It does not subscribe to products. It does not access private buyer data. It uses the public AWS Marketplace discovery endpoint behind the search page. It saves one dataset item per marketplace listing. Each item includes product and vendor fields that are useful for analysis. ### Who is it for? ๐Ÿงญ SaaS competitive intelligence teams can monitor vendors in a cloud category. ๐Ÿค Channel and partnership teams can discover AWS Marketplace sellers. ๐Ÿ“ˆ Sales and BD teams can build account lists from software categories. ๐Ÿ›’ Procurement teams can compare products available through AWS Marketplace. ๐Ÿงช Product marketers can study descriptions, badges, delivery methods, and positioning. ๐Ÿงฐ Data teams can feed listing data into BI, CRM enrichment, or internal dashboards. ### Why use this actor? AWS Marketplace is a high-intent catalog for cloud buyers. Manual browsing is slow when you need hundreds of listings. Search result pages mix products, vendors, categories, and badges in a format that is hard to export. This actor gives you a repeatable export with stable field names. You can run the same query every week and compare what changed. You can combine multiple search terms in one run. You can deduplicate by `listingId` or `productId`. ### Data you can extract | Field | Description | | --- | --- | | `searchTerm` | Keyword that produced the listing | | `rank` | Rank within that search result | | `listingId` | AWS Marketplace listing identifier | | `productId` | Product/base product identifier when available | | `title` | Listing title | | `vendorName` | Seller or listing creator name | | `vendorUrl` | AWS Marketplace seller profile URL | | `listingUrl` | Product listing URL | | `categories` | Category labels returned by AWS | | `deliveryMethods` | SaaS, AMI, Professional Services, Data, etc. | | `pricingModels` | Pricing model labels exposed in search results | | `pricingUnits` | Pricing units when present | | `purchasePaths` | Purchase path labels when present | | `badges` | AWS badges such as AWS Specializations | | `rating` | Average rating when present | | `reviewCount` | Review count when present | | `logoUrl` | Product/vendor logo thumbnail | | `shortDescription` | Short marketplace description | | `longDescription` | Long marketplace description when enabled | | `scrapedAt` | Extraction timestamp | ### How much does it cost to scrape AWS Marketplace listings? The actor uses pay-per-event pricing. There is a small start charge per run. There is one item charge per listing saved. The default run is intentionally small so you can test cheaply. Current live pricing uses a $0.005 start event plus tiered per-listing pricing. The BRONZE per-listing price is $0.000028229, with lower unit prices for higher tiers. See the Apify run pricing panel for the exact live price shown for your plan. ### How to use 1. Open the actor on Apify. 2. Enter one or more AWS Marketplace search terms. 3. Set the maximum number of listings. 4. Choose whether to include long descriptions. 5. Run the actor. 6. Export the dataset as JSON, CSV, Excel, or via API. ### Input options `searchTerms` is the primary input. Example terms include `security`, `observability`, `data warehouse`, `mcp server`, `finops`, and `backup`. `startUrls` accepts AWS Marketplace search URLs. The actor reads the `searchTerms` query parameter from each URL. `maxItems` limits the total number of listings saved across all terms. `includeLongDescription` controls whether longer product descriptions are saved. ### Example input ```json { "searchTerms": ["security", "observability"], "maxItems": 100, "includeLongDescription": true } ```` ### Example output ```json { "searchTerm": "security", "rank": 1, "listingId": "prodview-zvowyvkqm56jw", "title": "Application Security Services", "vendorName": "GuidePoint Security LLC", "listingUrl": "https://aws.amazon.com/marketplace/pp/prodview-zvowyvkqm56jw", "categories": ["Assessments", "Professional Services"], "deliveryMethods": ["Professional Services"], "pricingModels": ["Upfront Commitment"], "badges": ["AWS Specializations"], "shortDescription": "To help the world in achieving their AppSec goals...", "scrapedAt": "2026-07-02T05:21:46.376Z" } ``` ### Tips for better results Use specific category terms for cleaner datasets. Use broad terms when you want market mapping. Run separate terms if you need rank by keyword. Keep `maxItems` low for initial tests. Use `listingId` for deduplication across repeated runs. Export CSV for sales operations workflows. Export JSON for enrichment pipelines. ### Integrations Send results to Google Sheets through Apify integrations. Sync vendors into a CRM as potential partner or sales accounts. Load listing data into a warehouse for category trend analysis. Schedule weekly runs and compare new listings by `listingId`. Use webhooks to notify a Slack channel when a category changes. Combine with enrichment actors for website, contact, or company data. ### API usage with Node.js ```js import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('automation-lab/aws-marketplace-listings-scraper').call({ searchTerms: ['security'], maxItems: 50 }); console.log(run.defaultDatasetId); ``` ### API usage with Python ```python from apify_client import ApifyClient client = ApifyClient('MY_APIFY_TOKEN') run = client.actor('automation-lab/aws-marketplace-listings-scraper').call(run_input={ 'searchTerms': ['observability'], 'maxItems': 50, }) print(run['defaultDatasetId']) ``` ### API usage with cURL ```bash curl -X POST "https://api.apify.com/v2/acts/automation-lab~aws-marketplace-listings-scraper/runs?token=$APIFY_TOKEN" \ -H 'Content-Type: application/json' \ -d '{"searchTerms":["security"],"maxItems":50}' ``` ### MCP integration Use this actor from Claude Desktop or Claude Code through Apify MCP. MCP URL: ```text https://mcp.apify.com/?tools=automation-lab/aws-marketplace-listings-scraper ``` Claude Code setup: ```bash claude mcp add apify-aws-marketplace --transport http "https://mcp.apify.com/?tools=automation-lab/aws-marketplace-listings-scraper" ``` Claude Desktop JSON configuration: ```json { "mcpServers": { "apify-aws-marketplace": { "url": "https://mcp.apify.com/?tools=automation-lab/aws-marketplace-listings-scraper" } } } ``` Example prompts: - "Scrape 100 AWS Marketplace listings for observability tools." - "Find vendors selling MCP servers on AWS Marketplace." - "Compare badges and pricing models for cloud security products." ### Scheduling and monitoring Schedule weekly runs for a keyword set. Store previous datasets and compare by `listingId`. Watch for new vendors, changed badges, or new category positioning. Use Apify webhooks for downstream alerts. ### Data quality notes AWS Marketplace may omit ratings or review counts for some products. Pricing details can be broad in search results. Exact offer-level prices may require product-detail enrichment. Category labels are returned by AWS and may vary by product. Long descriptions can be verbose. Disable long descriptions if you need compact exports. ### Limitations The actor extracts public search-result listing data. It does not log in to AWS. It does not purchase or subscribe to marketplace products. It does not scrape private offer terms. It does not guarantee complete coverage of every AWS Marketplace product. AWS can change the public discovery endpoint or result ranking. ### Legality and responsible use This actor collects publicly visible marketplace listing information. Use the data for legitimate research, analytics, procurement, or sales workflows. Respect AWS Marketplace terms and applicable laws. Do not use exported vendor information for spam. Do not attempt to bypass authentication or access private data. ### Related scrapers Related Automation Labs actors can help enrich marketplace leads after export. Use website/contact enrichment actors to find vendor domains and public contacts. Use company or software-directory actors when you need broader SaaS market coverage. Use cloud catalog actors when your workflow is focused on cloud product inventory. ### Troubleshooting If a run returns fewer items than expected, try a broader search term. If a field is missing, AWS likely did not expose it for that listing. If a run fails quickly, check that at least one `searchTerms` value or valid search URL was provided. If exports are large, turn off `includeLongDescription`. If duplicate vendors appear, deduplicate by `vendorProfileId` or `vendorName`. ### FAQ #### Does this require an AWS account? No. The actor uses public AWS Marketplace search data. #### Can it scrape product detail pages? The MVP focuses on search-result listing data. Product-detail enrichment can be added later if needed. #### Can I scrape more than one keyword? Yes. Add multiple values to `searchTerms`. #### How do I monitor a niche? Schedule the same search terms and compare new `listingId` values over time. #### Why are some ratings empty? AWS Marketplace does not show review data for every listing. ### Changelog Initial version extracts AWS Marketplace search listings, vendors, categories, pricing models, delivery methods, badges, logos, descriptions, ratings, review counts, and stable IDs. # Actor input Schema ## `searchTerms` (type: `array`): Keywords to search on AWS Marketplace, such as security, data warehouse, observability, or mcp server. ## `startUrls` (type: `array`): Optional AWS Marketplace search URLs. The actor reads the searchTerms parameter from each URL. ## `maxItems` (type: `integer`): Maximum listing records to save across all search terms. ## `sortBy` (type: `string`): AWS Marketplace search sorting. Public search API currently supports relevant results. ## `includeLongDescription` (type: `boolean`): Save AWS Marketplace long descriptions when available. Turn off for smaller datasets. ## Actor input object example ```json { "searchTerms": [ "security" ], "startUrls": [ { "url": "https://aws.amazon.com/marketplace/search/results?searchTerms=observability" } ], "maxItems": 20, "sortBy": "RELEVANT", "includeLongDescription": true } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchTerms": [ "security" ], "startUrls": [ { "url": "https://aws.amazon.com/marketplace/search/results?searchTerms=observability" } ], "maxItems": 20, "sortBy": "RELEVANT", "includeLongDescription": true }; // Run the Actor and wait for it to finish const run = await client.actor("automation-lab/aws-marketplace-listings-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchTerms": ["security"], "startUrls": [{ "url": "https://aws.amazon.com/marketplace/search/results?searchTerms=observability" }], "maxItems": 20, "sortBy": "RELEVANT", "includeLongDescription": True, } # Run the Actor and wait for it to finish run = client.actor("automation-lab/aws-marketplace-listings-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchTerms": [ "security" ], "startUrls": [ { "url": "https://aws.amazon.com/marketplace/search/results?searchTerms=observability" } ], "maxItems": 20, "sortBy": "RELEVANT", "includeLongDescription": true }' | apify call automation-lab/aws-marketplace-listings-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=automation-lab/aws-marketplace-listings-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "AWS Marketplace Listings Scraper", "description": "Extract AWS Marketplace product listings, vendors, pricing models, delivery methods, ratings, badges, categories, descriptions, and URLs.", "version": "0.1", "x-build-id": "BHfWwURn4rBf7mix3" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/automation-lab~aws-marketplace-listings-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-automation-lab-aws-marketplace-listings-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/automation-lab~aws-marketplace-listings-scraper/runs": { "post": { "operationId": "runs-sync-automation-lab-aws-marketplace-listings-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/automation-lab~aws-marketplace-listings-scraper/run-sync": { "post": { "operationId": "run-sync-automation-lab-aws-marketplace-listings-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchTerms" ], "properties": { "searchTerms": { "title": "Search terms", "type": "array", "description": "Keywords to search on AWS Marketplace, such as security, data warehouse, observability, or mcp server.", "items": { "type": "string" }, "default": [ "security" ] }, "startUrls": { "title": "AWS Marketplace search URLs", "type": "array", "description": "Optional AWS Marketplace search URLs. The actor reads the searchTerms parameter from each URL.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "title": "URL", "description": "AWS Marketplace search URL.", "type": "string" } } } }, "maxItems": { "title": "Maximum listings", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum listing records to save across all search terms.", "default": 20 }, "sortBy": { "title": "Sort by", "enum": [ "RELEVANT" ], "type": "string", "description": "AWS Marketplace search sorting. Public search API currently supports relevant results.", "default": "RELEVANT" }, "includeLongDescription": { "title": "Include long descriptions", "type": "boolean", "description": "Save AWS Marketplace long descriptions when available. Turn off for smaller datasets.", "default": true } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```