Microsoft Marketplace Scraper | Fast & Reliable

Slug: fatihtahta/microsoft-marketplace-scraper

Overview

Microsoft Marketplace Scraper collects structured listings from Microsoft Marketplace, including key attributes like title, publisher, categories, ratings, pricing indicators, and listing URLs. It helps teams turn Marketplace discovery into consistent datasets for analysis, enrichment, and reporting. {{TARGET_SITE}} (https://marketplace.microsoft.com/) is a primary source for app and solution visibility, making its data valuable for market intelligence and vendor benchmarking. Runs are automated and consistent, saving hours of manual research while delivering reliable, repeatable results.

Why Use This Actor

• Market research & analytics: Track catalog trends, category saturation, and rating distributions for competitive insights.
• Product & content teams: Identify relevant solutions, spot gaps, and validate positioning with real Marketplace listings.
• Developers & data engineering: Feed dashboards, catalogs, or ETL pipelines with ready-to-use, structured records.
• Lead generation & enrichment: Build prospect lists with publisher and listing metadata for outreach and enrichment.
• Monitoring & competitive tracking: Keep watch on new entrants and shifts in key segments over time.

Input Parameters

Provide any combination of URLs, queries, and filters…

Parameter	Type	Description	Default
queries	string[]	Search keywords to discover listings (e.g., app name, publisher, industry, or category).	–
products	string	Filter by Microsoft Marketplace product category. Allowed values: azure-applications, azure-services, containers, entra-id-apps, managed-services, virtual-machines, dynamics-365-business-central, dynamics-365-commerce, dynamics-365-for-customer-services, dynamics-365-customer-voice, dynamics-365-for-field-services, dynamics-365-for-finance-and-operations, dynamics-365-human-resources, dynamics-365-marketing, dynamics-365-mixed-reality, dynamics-365-project-operations, dynamics-365-for-project-service-automation, dynamics-365-for-sales, dynamics-365-supply-chain-management, excel, officemetaos, onenote, outlook, powerpoint, project, sharepoint, teams, viva, word, powerapps, power-automate, power-bi, power-bi-visuals, powerpages, power-virtual-agents, saas.	–
categories	string	Filter by Marketplace category. Allowed values: ai-apps-and-agents, analytics, blockchain, collaboration, commerce, compliance-legals, customer-service, databases, developer-tools, devops, finance, geolocation, human-resources, identity, infrastructure-services, integration, internet-of-things, management-tools, ai-plus-machine-learning, marketing, media, microsoft-entra-id, migration, mixed-reality, monitoring-and-diagnostics, operations, productivity, project-management, sales, security, web.	–
industries	string	Filter by industry. Allowed values: defense-and-intelligence, distribution, education, energy, financial-services, government, healthcare, hospitality-and-travel, manufacturing-resources, nonprofit, professional-services, retail-and-consumer-goods, sustainability, media-communications.	–
pricingType	string[]	Filter by pricing model. Allowed values: byol, free, pay-as-you-go, free-trial.	–
minimumRating	string	Minimum average rating. Allowed values: one-up, two-up, three-up, four-up.	–
operatingSystem	string[]	Filter by supported operating system. Allowed values: windows, linux.	–
publisherCompliance	string[]	Filter by publisher type. Allowed values: partners, microsoft.	–
limit	integer	Maximum listings to save per query. Minimum: 10.	50000
proxyConfiguration	object	Optional connection settings. Recommended for larger runs.	Apify proxy with RESIDENTIAL group

Example Input

{
  "queries": ["Slack App", "security monitoring"],
  "products": "azure-applications",
  "categories": "ai-apps-and-agents",
  "pricingType": ["pay-as-you-go", "free"],
  "minimumRating": "three-up",
  "limit": 2000
}

Output

6.1 Output destination

The actor writes results to an Apify dataset as JSON records. And the dataset is designed for direct consumption by analytics tools, ETL pipelines, and downstream APIs without post-processing.

6.2 Record envelope (all items)

Every record includes stable identifiers:

• type (string, required)
• id (number, required)
• url (string, required)

Recommended idempotency key: type + ":" + id. Use this key for deduplication and upserts when the same listing appears across multiple inputs.

6.3 Examples

Example: listing (type = "listing")

{
  "type": "listing",
  "id": 1586529844787,
  "url": "https://marketplace.microsoft.com/en-us/marketplace/apps/neudesic1586529844787.document-intelligence-platform-ma",
  "title": "Document Intelligence Platform",
  "source_url": "https://marketplace.microsoft.com/view/tiledata?ReviewsMyCommentsFilter=true&category=ai-apps-and-agents&country=US&entityType=App&filters=three-up&isConverged=true&page=1&product=azure-applications&region=ALL",
  "seed_type": "default",
  "seed_value": "input-filters",
  "popularity": 1.0065499999999998,
  "pricing_model": 8,
  "handoff_url": "https://portal.azure.com/#create/neudesic1586529844787.document-intelligence-platform-ma",
  "certification_state": "None",
  "has_prices": true,
  "short_description": "Powerful and flexible enough to automate any type of document process from input to actionable data",
  "has_free_trials": false,
  "is_appsource_offer": false,
  "rating_summaries": [
    {
      "TotalRatings": 1,
      "AverageRating": 5,
      "StarsDistribution": {
        "OneStars": 0,
        "TwoStars": 0,
        "ThreeStars": 0,
        "FourStars": 0,
        "FiveStars": 1
      },
      "Source": "Ibiza",
      "OfferId": "neudesic1586529844787.document-intelligence-platform-ma",
      "CreatedAt": "2025-12-27T15:58:45.7518916Z"
    },
    {
      "TotalRatings": 1,
      "AverageRating": 5,
      "StarsDistribution": {
        "OneStars": 0,
        "TwoStars": 0,
        "ThreeStars": 0,
        "FourStars": 0,
        "FiveStars": 1
      },
      "Source": "All",
      "OfferId": "neudesic1586529844787.document-intelligence-platform-ma",
      "CreatedAt": "2025-12-27T16:06:35.6009786+00:00"
    }
  ],
  "icon_url": "https://store-images.s-microsoft.com/image/apps.5325.83aa3159-4e9b-42c0-a43f-1410cd90ef1e.64b4e7f5-0d86-40f1-9a60-dd4e2ac575bc.377d3f9d-4769-4546-bda1-87b74f98e42a",
  "product_type": 16,
  "pricing_types": [
    "Payg",
    "Free"
  ],
  "built_for": "Azure Applications",
  "publisher": "Neudesic",
  "offer_type": 0,
  "license_terms_url": "https://go.microsoft.com/fwlink/?linkid=2041178",
  "catalog_offer_type": "AzureApplication",
  "operating_system": 0,
  "number_of_ratings": 1,
  "license_management": {
    "isMicrosoftManaged": false,
    "isFreemium": false
  },
  "rating_summary": {
    "TotalRatings": 1,
    "AverageRating": 5,
    "StarsDistribution": {
      "OneStars": 0,
      "TwoStars": 0,
      "ThreeStars": 0,
      "FourStars": 0,
      "FiveStars": 1
    },
    "Source": "Internal",
    "OfferId": "neudesic1586529844787.document-intelligence-platform-ma",
    "CreatedAt": "2025-12-27T16:06:35.6009838+00:00"
  },
  "publisher_id": "neudesic1586529844787",
  "categories": [
    {
      "longTitle": "Machine Learning",
      "locKey": "Filter_MachineLearning",
      "urlKey": "ai-plus-machine-learning"
    },
    {
      "longTitle": "AI Apps and Agents",
      "locKey": "Filter_AIAppsAndAgents",
      "urlKey": "ai-apps-and-agents"
    },
    {
      "longTitle": "Infrastructure Services",
      "locKey": "Filter_infrastructure-services",
      "urlKey": "infrastructure-services"
    }
  ],
  "average_rating": 5
}

Example: listing (type = "listing")

{
  "type": "listing",
  "id": 1606829442191,
  "url": "https://marketplace.microsoft.com/en-us/marketplace/apps/nlsql1606829442191.ai-agent",
  "title": "AI agent",
  "source_url": "https://marketplace.microsoft.com/view/tiledata?ReviewsMyCommentsFilter=true&category=ai-apps-and-agents&country=US&entityType=App&filters=three-up&isConverged=true&page=1&product=azure-applications&region=ALL",
  "seed_type": "default",
  "seed_value": "input-filters",
  "popularity": 0.9809249999999998,
  "pricing_model": 8,
  "handoff_url": "https://portal.azure.com/#create/nlsql1606829442191.ai-agent",
  "certification_state": "None",
  "has_prices": true,
  "short_description": "AI agent, which works as Intelligent consultant for your company data",
  "has_free_trials": false,
  "is_appsource_offer": false,
  "rating_summaries": [
    {
      "TotalRatings": 1,
      "AverageRating": 5,
      "StarsDistribution": {
        "OneStars": 0,
        "TwoStars": 0,
        "ThreeStars": 0,
        "FourStars": 0,
        "FiveStars": 1
      },
      "Source": "Ibiza",
      "OfferId": "nlsql1606829442191.ai-agent",
      "CreatedAt": "2025-10-07T12:40:35.1425117Z"
    },
    {
      "TotalRatings": 1,
      "AverageRating": 5,
      "StarsDistribution": {
        "OneStars": 0,
        "TwoStars": 0,
        "ThreeStars": 0,
        "FourStars": 0,
        "FiveStars": 1
      },
      "Source": "All",
      "OfferId": "nlsql1606829442191.ai-agent",
      "CreatedAt": "2025-12-23T16:08:33.6050368+00:00"
    }
  ],
  "icon_url": "https://store-images.s-microsoft.com/image/apps.43341.205eeaba-8bc1-4bc1-8c42-b79db7f2ef30.67536741-016f-4e3e-a70d-dbab2dede870.c0eb0daf-c4ff-4c4f-9925-873b72cf9b35",
  "product_type": 16,
  "pricing_types": [
    "Payg"
  ],
  "built_for": "Azure Applications",
  "publisher": "NLSQL",
  "offer_type": 0,
  "license_terms_url": "https://go.microsoft.com/fwlink/?linkid=2041178",
  "catalog_offer_type": "AzureApplication",
  "operating_system": 0,
  "number_of_ratings": 1,
  "license_management": {
    "isMicrosoftManaged": false,
    "isFreemium": false
  },
  "rating_summary": {
    "TotalRatings": 1,
    "AverageRating": 5,
    "StarsDistribution": {
      "OneStars": 0,
      "TwoStars": 0,
      "ThreeStars": 0,
      "FourStars": 0,
      "FiveStars": 1
    },
    "Source": "Internal",
    "OfferId": "nlsql1606829442191.ai-agent",
    "CreatedAt": "2025-12-23T16:08:33.6050412+00:00"
  },
  "publisher_id": "nlsql1606829442191",
  "categories": [
    {
      "longTitle": "AI Apps and Agents",
      "locKey": "Filter_AIAppsAndAgents",
      "urlKey": "ai-apps-and-agents"
    },
    {
      "longTitle": "Analytics",
      "locKey": "Filter_Analytics",
      "urlKey": "analytics"
    },
    {
      "longTitle": "Machine Learning",
      "locKey": "Filter_MachineLearning",
      "urlKey": "ai-plus-machine-learning"
    }
  ],
  "average_rating": 5
}

Field reference

Listing fields (type = "listing")

• title (string, required): Listing title.
• source_url (string, optional): Source page URL used for discovery.
• seed_type (string, optional): Origin type for the seed (e.g., query or filter).
• seed_value (string, optional): Seed value associated with discovery.
• popularity (number, optional): Popularity score when available.
• pricing_model (number, optional): Pricing model indicator.
• handoff_url (string, optional): Marketplace handoff URL when provided.
• certification_state (string, optional): Certification state label.
• has_prices (boolean, optional): Whether pricing is present.
• short_description (string, optional): Listing summary text.
• has_free_trials (boolean, optional): Free trial availability.
• is_appsource_offer (boolean, optional): AppSource offer flag.
• rating_summaries (array, optional): Rating summaries (multiple sources possible).
• rating_summaries.TotalRatings (number, optional): Total rating count per source.
• rating_summaries.AverageRating (number, optional): Average rating per source.
• rating_summaries.StarsDistribution.OneStars (number, optional)
• rating_summaries.StarsDistribution.TwoStars (number, optional)
• rating_summaries.StarsDistribution.ThreeStars (number, optional)
• rating_summaries.StarsDistribution.FourStars (number, optional)
• rating_summaries.StarsDistribution.FiveStars (number, optional)
• rating_summaries.Source (string, optional): Rating source label.
• rating_summaries.OfferId (string, optional): Offer identifier associated with the rating.
• rating_summaries.CreatedAt (string, optional): Rating timestamp.
• icon_url (string, optional): Listing icon URL.
• product_type (number, optional): Product type indicator.
• pricing_types (array[string], optional): Pricing types.
• built_for (string, optional): Product family label.
• publisher (string, optional): Publisher name.
• offer_type (number, optional): Offer type indicator.
• license_terms_url (string, optional): License terms URL.
• catalog_offer_type (string, optional): Catalog offer type.
• operating_system (number, optional): Operating system indicator.
• number_of_ratings (number, optional): Rating count.
• license_management.isMicrosoftManaged (boolean, optional)
• license_management.isFreemium (boolean, optional)
• rating_summary.TotalRatings (number, optional)
• rating_summary.AverageRating (number, optional)
• rating_summary.StarsDistribution.OneStars (number, optional)
• rating_summary.StarsDistribution.TwoStars (number, optional)
• rating_summary.StarsDistribution.ThreeStars (number, optional)
• rating_summary.StarsDistribution.FourStars (number, optional)
• rating_summary.StarsDistribution.FiveStars (number, optional)
• rating_summary.Source (string, optional)
• rating_summary.OfferId (string, optional)
• rating_summary.CreatedAt (string, optional)
• publisher_id (string, optional): Publisher identifier.
• categories (array, optional): Category metadata.
• categories.longTitle (string, optional)
• categories.locKey (string, optional)
• categories.urlKey (string, optional)
• average_rating (number, optional): Overall average rating.

Data guarantees & handling

• Best-effort extraction: fields may vary by region/session/availability/UI experiments.
• Optional fields: null-check in downstream code.
• Deduplication: recommend type + ":" + id.

Notes & Limitations

• Respect Microsoft Marketplace terms of service and applicable laws.
• Avoid excessive frequency to prevent disruption of normal site usage.
• Pricing and availability may vary by region, time, and session.
• Validate collected data against your compliance requirements.

Support

For help or questions, open an issue via the Issues tab on the actor page. Include the input used (redacted), the run ID, expected vs actual behavior, and a small output sample if possible.