# Azure Marketplace Scraper (`crawlergang/azure-marketplace-scraper`) Actor Scrape Microsoft Azure Marketplace - search 10,000+ cloud solutions by keyword, category, or pricing type. Returns full metadata: publisher, ratings, pricing, deployment types, icons, screenshots. - **URL**: https://apify.com/crawlergang/azure-marketplace-scraper.md - **Developed by:** [Crawler Gang](https://apify.com/crawlergang) (community) - **Categories:** Automation, Developer tools, AI - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 11 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $3.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Azure Marketplace Scraper Scrape **Microsoft Azure Marketplace** — the cloud-solution catalog with 10,000+ listings from Microsoft and third-party publishers. Extract full metadata: name, publisher, description, categories, pricing model, ratings, icons, screenshots, and deployment plans. ### Data Source This actor scrapes the **Microsoft Azure Marketplace** via its public catalog REST API (`catalogapi.azure.com`). No API key, authentication, or proxy is required — the catalog is fully public and free to access. > **Note:** Oracle Cloud Marketplace (`cloudmarketplace.oracle.com`) requires Oracle Cloud authentication and returns gateway errors on all public endpoints. Azure Marketplace covers the same niche (enterprise cloud solutions) with a richer public API. ### Features - **3 scraping modes**: Search by keyword, Browse by category, or Fetch by offer ID - **Rich metadata**: publisher info, pricing type (Free/BYOL/PayG/Trial), ratings, icons, screenshots, plan IDs - **Category filtering**: 20 Azure Marketplace categories (AI/ML, Analytics, Databases, Security, etc.) - **Pricing filtering**: Filter by Free, BYOL, Pay-As-You-Go, or Free Trial - **Sort options**: By popularity or alphabetically by name - **No credentials required**: Zero configuration, works on Apify free plan ### Input | Field | Type | Description | |-------|------|-------------| | `mode` | `select` | **Required.** `search`, `browse`, or `getById` | | `query` | `string` | Keyword search (modes: search, browse) | | `category` | `select` | Filter by category (e.g. `databases`, `security`, `ai-plus-machine-learning`) | | `pricingType` | `select` | Filter by pricing: `free`, `byol`, `payg`, `trial` | | `sortBy` | `select` | Sort by `popularity` (default), `ratingAverage`, or `title` | | `ids` | `array` | Offer IDs for `getById` mode (e.g. `Microsoft.DocumentDB_MongoDB_Support`) | | `maxItems` | `integer` | Max records to return (1–10000, default: 100) | #### Example Inputs **Search for database solutions:** ```json { "mode": "search", "query": "database", "maxItems": 50 } ```` **Browse free security tools:** ```json { "mode": "browse", "category": "security", "pricingType": "free", "maxItems": 100 } ``` **Fetch specific offers by ID:** ```json { "mode": "getById", "ids": ["Microsoft.DocumentDB_MongoDB_Support", "Avensoft.nService"], "maxItems": 10 } ``` ### Output Each record contains: | Field | Type | Description | |-------|------|-------------| | `listingId` | `string` | Azure Marketplace offer ID (bigId) | | `name` | `string` | Display name of the listing | | `shortDescription` | `string` | Short summary / headline | | `description` | `string` | Full description | | `publisher` | `string` | Publisher display name | | `publisherId` | `string` | Publisher identifier | | `categories` | `array` | Category names (e.g. `["Databases", "Analytics"]`) | | `offerType` | `string` | Offer type (e.g. `SaaS`, `VirtualMachine`) | | `pricingType` | `string` | Pricing model (`Free`, `BYOL`, `PayG`, `FreeTrial`) | | `hasFreeTrials` | `boolean` | Whether a free trial is available | | `isByol` | `boolean` | Whether BYOL licensing is supported | | `hasFreePlans` | `boolean` | Whether free plans exist | | `hasPaygPlans` | `boolean` | Whether pay-as-you-go plans exist | | `ratingAverage` | `number` | Average star rating (0–5) | | `ratingCount` | `integer` | Number of ratings | | `popularity` | `number` | Azure Marketplace popularity score | | `version` | `string` | Listing version | | `keywords` | `array` | Associated keywords/tags | | `iconUrl` | `string` | URL to the listing icon | | `screenshotUrls` | `array` | URLs to screenshots | | `publisherUrl` | `string` | Publisher website | | `supportUrl` | `string` | Support URL | | `legalTermsUrl` | `string` | Legal terms URL | | `privacyPolicyUrl` | `string` | Privacy policy URL | | `planIds` | `array` | Available plan identifiers | | `listingUrl` | `string` | Direct Azure Marketplace listing URL | | `lastModified` | `string` | Last modified timestamp (ISO 8601) | | `recordType` | `string` | Always `"listing"` | | `scrapedAt` | `string` | Scrape timestamp (ISO 8601 UTC) | #### Sample Record ```json { "listingId": "Microsoft.DocumentDB_MongoDB_Support", "name": "Azure Cosmos DB for MongoDB", "shortDescription": "Globally-distributed, multi-model database service.", "publisher": "Microsoft", "categories": ["Databases", "Analytics"], "pricingType": "PayG", "hasPaygPlans": true, "ratingAverage": 3.702, "ratingCount": 754, "popularity": 14.92, "iconUrl": "https://catalogartifact.azureedge.net/...", "listingUrl": "https://azuremarketplace.microsoft.com/en-us/marketplace/apps/Microsoft.DocumentDB_MongoDB_Support", "recordType": "listing", "scrapedAt": "2026-05-30T12:00:00+00:00" } ``` ### Categories Available category values for the `category` input field: | Slug | Display Name | |------|-------------| | `ai-plus-machine-learning` | AI + Machine Learning | | `analytics` | Analytics | | `blockchain` | Blockchain | | `compute` | Compute | | `containers` | Containers | | `databases` | Databases | | `developer-tools` | Developer Tools | | `devops` | DevOps | | `identity` | Identity | | `integration` | Integration | | `internet-of-things` | Internet of Things | | `management-tools` | Management Tools | | `media` | Media | | `migration` | Migration | | `mixed-reality` | Mixed Reality | | `monitoring-and-diagnostics` | Monitoring & Diagnostics | | `networking` | Networking | | `security` | Security | | `storage` | Storage | | `web` | Web | ### FAQs **Q: Do I need an Azure account or API key?** A: No. The Azure Marketplace catalog API is fully public and requires no authentication. **Q: How many listings does Azure Marketplace have?** A: As of 2026, Azure Marketplace has over 10,000 listings from Microsoft and thousands of third-party publishers. **Q: Can I filter by multiple categories at once?** A: The current version supports single-category filtering per run. Use multiple runs with different `category` values and combine results. **Q: What is the difference between `search` and `browse` modes?** A: `search` mode uses the Azure full-text search on your `query`. `browse` mode lets you filter by `category` and `pricingType` with optional keyword filtering. `getById` fetches specific listings by their offer ID. **Q: How are offer IDs structured?** A: Azure offer IDs follow the pattern `PublisherId.OfferId`, e.g. `Microsoft.DocumentDB_MongoDB_Support` or `Avensoft.nService`. **Q: Is the data real-time?** A: The actor fetches live data from the Azure Marketplace catalog API on each run. # Actor input Schema ## `mode` (type: `string`): What to fetch from Azure Marketplace. ## `query` (type: `string`): Keyword(s) to search for in listing name, summary and description (modes: search, browse). ## `category` (type: `string`): Filter by Azure Marketplace category (mode: browse). Leave empty to browse all. ## `pricingType` (type: `string`): Filter listings by pricing model. ## `sortBy` (type: `string`): Sort order for results. ## `ids` (type: `array`): Azure Marketplace offer IDs (bigId) to fetch directly, e.g. `Microsoft.DocumentDB_MongoDB_Support`. One record per ID. ## `maxItems` (type: `integer`): Maximum number of listings to return. ## Actor input object example ```json { "mode": "search", "query": "database", "category": "", "pricingType": "", "sortBy": "popularity", "ids": [], "maxItems": 100 } ``` # Actor output Schema ## `listings` (type: `string`): Dataset containing all scraped Azure Marketplace listings. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "search", "query": "database", "category": "", "pricingType": "", "sortBy": "popularity", "ids": [], "maxItems": 100 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlergang/azure-marketplace-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "search", "query": "database", "category": "", "pricingType": "", "sortBy": "popularity", "ids": [], "maxItems": 100, } # Run the Actor and wait for it to finish run = client.actor("crawlergang/azure-marketplace-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "search", "query": "database", "category": "", "pricingType": "", "sortBy": "popularity", "ids": [], "maxItems": 100 }' | apify call crawlergang/azure-marketplace-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlergang/azure-marketplace-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Azure Marketplace Scraper", "description": "Scrape Microsoft Azure Marketplace - search 10,000+ cloud solutions by keyword, category, or pricing type. Returns full metadata: publisher, ratings, pricing, deployment types, icons, screenshots.", "version": "1.0", "x-build-id": "WnA833Iuavg8N0pW1" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlergang~azure-marketplace-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlergang-azure-marketplace-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlergang~azure-marketplace-scraper/runs": { "post": { "operationId": "runs-sync-crawlergang-azure-marketplace-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlergang~azure-marketplace-scraper/run-sync": { "post": { "operationId": "run-sync-crawlergang-azure-marketplace-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "search", "browse", "getById" ], "type": "string", "description": "What to fetch from Azure Marketplace.", "default": "search" }, "query": { "title": "Search query", "type": "string", "description": "Keyword(s) to search for in listing name, summary and description (modes: search, browse)." }, "category": { "title": "Category", "enum": [ "", "ai-plus-machine-learning", "analytics", "blockchain", "compute", "containers", "databases", "developer-tools", "devops", "identity", "integration", "internet-of-things", "management-tools", "media", "migration", "mixed-reality", "monitoring-and-diagnostics", "networking", "security", "storage", "web" ], "type": "string", "description": "Filter by Azure Marketplace category (mode: browse). Leave empty to browse all.", "default": "" }, "pricingType": { "title": "Pricing type", "enum": [ "", "free", "byol", "payg", "trial" ], "type": "string", "description": "Filter listings by pricing model.", "default": "" }, "sortBy": { "title": "Sort by", "enum": [ "popularity", "ratingAverage", "title" ], "type": "string", "description": "Sort order for results.", "default": "popularity" }, "ids": { "title": "Offer IDs (mode=getById)", "type": "array", "description": "Azure Marketplace offer IDs (bigId) to fetch directly, e.g. `Microsoft.DocumentDB_MongoDB_Support`. One record per ID.", "items": { "type": "string" } }, "maxItems": { "title": "Max items", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum number of listings to return.", "default": 100 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```