Wix App Market Scraper

Overview

The Wix App Market Scraper is a powerful crawler and spider designed to extract detailed data about apps listed on the Wix App Market. This tool can collect information such as app titles, descriptions, developer information, categories, pricing plans (monthly and yearly), and more. It is ideal for market analysis, competitor research, or gathering insights for your Wix ecosystem projects.

Features

• Extract Comprehensive App Data: Scrapes titles, descriptions, app builder/developer info, categories, pricing plans (with monthly and yearly options), and app URLs.
• Supports Custom URLs: Specify custom start URLs to target specific sections of the Wix App Market.
• Advanced Filtering: Filter apps by category, search query, and price (free/paid/all).
• Concurrent Crawling: Handles multiple detail page requests simultaneously with adjustable concurrency limits (1-20).
• Dynamic Content Handling: Uses Playwright to handle JavaScript-rendered content and infinite scroll pagination.
• Customizable Limits: Specify the maximum number of apps or pages to scrape.
• Error Resilience: Robust error handling and retry mechanisms for reliable scraping.

Use Cases

• Competitive analysis in the Wix ecosystem
• Data aggregation for Wix app reviews and market trends
• Monitoring pricing and feature trends across apps
• Generating leads by collecting developer information
• Market research and app discovery

How It Works

This scraper uses the Apify SDK along with Crawlee and Playwright to process Wix App Market pages. The scraping process includes:

1. Input Parsing: Accepts user-provided start URL, filters, and scraping limits.
2. Web Crawling: The crawler visits app listing pages and extracts app links.
3. Detail Page Extraction: Optionally visits individual app detail pages to extract comprehensive data including pricing plans, categories, and developer information.
4. Data Output: Stores the extracted data in the default Apify dataset.

Input Schema

The scraper accepts the following input fields:

Field	Type	Default	Description
startUrl	String	https://www.wix.com/app-market	URL to start scraping from
category	String	""	Filter apps by category (optional)
searchQuery	String	""	Search for specific apps by keyword (optional)
priceFilter	String	"all"	Filter by price: "all", "free", or "paid"
visitDetailPages	Boolean	true	Visit individual app detail pages for more comprehensive data
maxApps	Integer	0	Maximum number of apps to scrape (0 = no limit)
maxPages	Integer	0	Maximum number of listing pages to scrape (0 = no limit)
maxConcurrency	Integer	5	Maximum concurrent requests for detail pages (1-20)

Example Input

{
  "startUrl": "https://www.wix.com/app-market",
  "category": "ecommerce",
  "searchQuery": "",
  "priceFilter": "free",
  "visitDetailPages": true,
  "maxApps": 100,
  "maxPages": 0,
  "maxConcurrency": 10
}

Output

The scraper outputs data in the following format:

Field	Type	Description
title	String	The name/title of the app
description	String	Full description of the app
appBuilder	String	Name of the developer/company who built the app
categories	Array	List of categories the app belongs to
pricingPlans	Array	List of pricing plans with monthly and/or yearly prices
url	String	URL of the app's detail page

Pricing Plans Structure

Each pricing plan in the pricingPlans array contains:

• name - Plan name (e.g., "Basic", "Pro", "Premium")
• monthly - Monthly price (if available)
• yearly - Yearly price (if available)
• price - Single price (if no monthly/yearly toggle exists)
• features - Array of plan features

Example Output

{
  "title": "Example App - Best App for Wix",
  "description": "This is an example app for Wix that helps you manage your online store with advanced features...",
  "appBuilder": "Example Developer Inc.",
  "categories": ["Ecommerce", "Marketing", "Sales"],
  "pricingPlans": [
    {
      "name": "Basic",
      "monthly": "Free",
      "yearly": "Free",
      "features": ["Feature 1", "Feature 2"]
    },
    {
      "name": "Pro",
      "monthly": "€9.99 /month",
      "yearly": "€99.99 /year",
      "features": ["All Basic features", "Advanced Feature 1", "Advanced Feature 2"]
    }
  ],
  "url": "https://www.wix.com/app-market/web-solution/example-app"
}

Need More Features?

If you'd like to add new data fields to this scraper or need a custom scraper for another purpose, feel free to file an issue or get in touch! We are open to customizing the scraper to suit your needs.