Shopify Store Products Scraper

Extract complete product catalogs from any Shopify store with full pricing, variant, and inventory data. Perfect for competitive intelligence, price monitoring, and market research.

What is Shopify Store Products Scraper?

Shopify Store Products Scraper is a specialized web scraping tool designed to extract comprehensive product information from Shopify-powered e-commerce stores. Whether you're monitoring competitor pricing, conducting market research, or building a product database, this scraper provides structured access to product catalogs, pricing data, variants, images, and inventory status across any Shopify store.

The scraper automatically detects Shopify stores, handles pagination across large catalogs, and combines multiple data sources to ensure complete product information. It supports collection filtering, allowing you to target specific product categories or scrape entire store inventories. With intelligent deduplication and parallel processing, the scraper efficiently handles stores with thousands of products while respecting rate limits.

Built on Apify's robust infrastructure, this tool is ideal for e-commerce professionals, market researchers, dropshippers, and data analysts who need reliable, structured product data from Shopify stores. The scraper outputs clean JSON data ready for analysis, price comparison tools, inventory management systems, or competitive intelligence dashboards.

Data Fields

The scraper extracts the following fields for each product:

Field	Type	Description
title	String	Product name as displayed on the store
price	Number	Minimum variant price (lowest available price)
compareAtPrice	Number	Original price before discount (null if no discount)
vendor	String	Brand or manufacturer name
productType	String	Product category or type
tags	Array	Product tags for categorization and filtering
images	Array	All product images with URLs and dimensions
variants	Array	All product variants with individual prices, SKUs, and availability
description	String	Full product description (HTML format)
handle	String	URL-friendly product identifier used in URLs
url	String	Full canonical URL to the product page
availability	Boolean	Whether any variant is currently in stock

Tutorial: How to Scrape Shopify Stores

Follow these steps to extract product data from Shopify stores:

Step 1: Add Store URLs Enter one or more Shopify store URLs in the input configuration. You can use custom domains (e.g., https://allbirds.com) or standard Shopify URLs (e.g., https://store.myshopify.com).

Step 2: Set Product Limit Specify the maximum number of products to extract across all stores. The default is 100 products, but you can increase this to scrape larger catalogs.

Step 3: Filter by Collection (Optional) If you only need products from a specific collection, enter the collection handle (e.g., new-arrivals, sale, apparel). Leave empty to scrape all products.

Step 4: Run the Scraper Click "Start" to begin extraction. The scraper will automatically detect Shopify stores, validate URLs, and begin collecting product data.

Step 5: Monitor Progress Track scraping progress in real-time through the Apify console. The scraper processes up to 10 concurrent requests for optimal speed.

Step 6: Download Results Once complete, download your data in JSON, CSV, or Excel format. All product information is structured and ready for analysis.

Step 7: Schedule Regular Runs (Optional) Set up scheduled runs to monitor price changes, track inventory updates, or maintain an up-to-date product database.

Input Parameters

Parameter	Type	Required	Default	Description
storeUrls	Array of Strings	Yes	-	One or more Shopify store base URLs (with or without https://)
maxProducts	Integer	No	100	Maximum number of products to extract across all stores (minimum: 1)
collection	String	No	null	Collection handle to filter products (e.g., summer-sale, bestsellers)

Example Input

{
  "storeUrls": [
    "https://allbirds.com",
    "https://shop.gymshark.com",
    "https://www.tentree.com"
  ],
  "maxProducts": 500,
  "collection": "apparel"
}

Example Output

{
  "title": "Wool Runners - Natural White (Women's)",
  "price": 98,
  "compareAtPrice": 115,
  "vendor": "Allbirds",
  "productType": "Shoes",
  "tags": [
    "bestseller",
    "sustainable",
    "wool",
    "women",
    "runners"
  ],
  "images": [
    {
      "id": 29457891234567,
      "product_id": 6789012345678,
      "position": 1,
      "created_at": "2024-08-15T10:30:00-07:00",
      "updated_at": "2024-08-15T10:30:00-07:00",
      "width": 2048,
      "height": 2048,
      "src": "https://cdn.shopify.com/s/files/1/0555/1234/products/wool-runners-white.jpg",
      "variant_ids": []
    },
    {
      "id": 29457891234568,
      "product_id": 6789012345678,
      "position": 2,
      "created_at": "2024-08-15T10:30:00-07:00",
      "updated_at": "2024-08-15T10:30:00-07:00",
      "width": 2048,
      "height": 2048,
      "src": "https://cdn.shopify.com/s/files/1/0555/1234/products/wool-runners-white-side.jpg",
      "variant_ids": []
    }
  ],
  "variants": [
    {
      "id": 40123456789012,
      "product_id": 6789012345678,
      "title": "8 / Natural White",
      "price": "98.00",
      "compare_at_price": "115.00",
      "sku": "WR-NW-W-08",
      "position": 1,
      "inventory_policy": "deny",
      "fulfillment_service": "manual",
      "inventory_management": "shopify",
      "option1": "8",
      "option2": "Natural White",
      "option3": null,
      "created_at": "2024-08-15T10:30:00-07:00",
      "updated_at": "2025-02-14T08:15:00-08:00",
      "taxable": true,
      "grams": 340,
      "weight": 0.75,
      "weight_unit": "lb",
      "inventory_quantity": 47,
      "available": true,
      "requires_shipping": true
    },
    {
      "id": 40123456789013,
      "product_id": 6789012345678,
      "title": "9 / Natural White",
      "price": "98.00",
      "compare_at_price": "115.00",
      "sku": "WR-NW-W-09",
      "position": 2,
      "inventory_policy": "deny",
      "fulfillment_service": "manual",
      "inventory_management": "shopify",
      "option1": "9",
      "option2": "Natural White",
      "option3": null,
      "created_at": "2024-08-15T10:30:00-07:00",
      "updated_at": "2025-02-14T08:15:00-08:00",
      "taxable": true,
      "grams": 340,
      "weight": 0.75,
      "weight_unit": "lb",
      "inventory_quantity": 52,
      "available": true,
      "requires_shipping": true
    }
  ],
  "description": "<p>Our original Wool Runner. Made with responsibly sourced merino wool, the Women's Wool Runners are incredibly soft, naturally breathable, and machine washable. Experience the comfort of our signature ZQ Merino wool upper and our sustainable SweetFoam midsole made with sugarcane.</p><h3>Features</h3><ul><li>ZQ-certified merino wool upper</li><li>Soft merino wool collar</li><li>SweetFoam midsole made with sugarcane</li><li>Machine washable</li><li>Carbon neutral product</li></ul>",
  "handle": "wool-runners-natural-white-womens",
  "url": "https://allbirds.com/products/wool-runners-natural-white-womens",
  "availability": true
}

Legal and Ethical Considerations

This scraper is designed to access publicly available product information from Shopify stores through standard HTTP requests. All data extracted is publicly accessible without authentication and is typically intended for public viewing. Users are responsible for ensuring their use of this tool complies with applicable laws, regulations, and the terms of service of the websites they scrape.

Before scraping any website, review the site's robots.txt file, terms of service, and privacy policy. Respect rate limits and avoid overwhelming target servers with excessive requests. This tool is intended for legitimate purposes such as market research, competitive analysis, and price monitoring. Users should not use scraped data in ways that violate intellectual property rights, unfair competition laws, or data protection regulations such as GDPR or CCPA.

Pricing

This actor charges based on compute usage. Each run consumes compute units proportional to the number of products scraped and processing time. Approximate costs:

• Small runs (1-100 products): $0.01 - $0.05
• Medium runs (100-1,000 products): $0.05 - $0.25
• Large runs (1,000-10,000 products): $0.25 - $2.00

Actual costs depend on store response times, number of variants per product, and network conditions. The scraper uses efficient parallel processing (10 concurrent requests) to minimize compute time. All Apify users receive free monthly compute credits. For high-volume scraping, consider Apify's subscription plans with increased compute allowances.

Frequently Asked Questions

How many products can I scrape from a single store?

The scraper can extract unlimited products from a store, subject to the maxProducts parameter you set. Shopify stores expose products through their public API in batches of 250. The scraper automatically handles pagination to collect all products up to your specified limit.

Can I scrape multiple stores in one run?

Yes, you can provide multiple store URLs in the storeUrls input parameter. The scraper will process all stores and combine results into a single dataset. The maxProducts limit applies across all stores combined.

What happens if a URL is not a Shopify store?

The scraper automatically detects whether a URL points to a Shopify store by checking for Shopify-specific indicators in the HTML and API responses. Non-Shopify stores are skipped with a warning message in the run log.

How do I scrape products from a specific collection?

Enter the collection handle in the collection input parameter. The collection handle is the URL-friendly identifier found in collection URLs (e.g., for https://store.com/collections/summer-sale, the handle is summer-sale). Leave this field empty to scrape all products regardless of collection.

Why are some variant fields null or missing?

Some Shopify stores may not populate all variant fields or may have different data structures based on their configuration. The scraper extracts all available data but cannot guarantee that every field will be present for every product. Fields like compare_at_price will be null if no discount is applied.

Related Scrapers

Explore other web scraping actors by lanky_quantifier:

• Amazon Product Scraper - Extract product details, prices, reviews, and ratings from Amazon listings across multiple marketplaces.
• Google Maps Scraper - Collect business information, reviews, photos, and contact details from Google Maps search results.
• Reddit Thread Scraper - Download posts, comments, and metadata from Reddit threads and subreddits for sentiment analysis and research.
• Instagram Profile Scraper - Gather posts, followers, engagement metrics, and profile information from Instagram accounts.
• LinkedIn Company Scraper - Extract company profiles, employee counts, job postings, and company updates from LinkedIn.

---

Built with Apify SDK v3 and Crawlee. For support or feature requests, contact the developer through the Apify platform.