Shopify Store Scraper

Shopify Store Scraper

Shopify Store Scraper is a production-ready Shopify store scraping tool that extracts structured store metadata, product catalogs, variants, prices, inventory metrics, collections, theme details, detected apps, and optional Yotpo reviews from public Shopify stores. It solves the pain of manual data collection by providing an automated Shopify product scraper and Shopify store data extractor that’s fast, scalable, and export-ready. Built for marketers, developers, data analysts, and researchers, it helps you scrape Shopify products, analyze pricing and stock health, and automate catalog enrichment at scale — all through the Apify platform.

What data / output can you get?

Below are examples of real output fields this Shopify product data scraper saves to the Apify dataset. Values are illustrative.

Data type	Description	Example value
store_domain	Store domain without protocol	www.allbirds.com
store_url	Full store URL	https://www.allbirds.com
shop_name	Shopify shop domain derived from meta	shop11044168.myshopify.com
country	Country code from meta.json	US
currency	Store currency code from meta.json	USD
locale	Content language (from meta or HTML)	en-US
theme_name	Active theme name parsed from HTML	rc-cm-2025-12-26_20-35 Update
total_products	Count of products from /products.json	681
total_variants	Sum of variants across products	7276
price_min	Minimum variant price across catalog	2.0
price_avg	Average variant price (2 decimals)	79.34
price_max	Maximum variant price across catalog	500.0

Bonus outputs include theme_id, theme_version, collections (titles), collections_count, categories (product types), vendors, total_variants_available, inventory_availability_pct, estimated_launch_date/newest_product_date, products_with_images, avg_images_per_product, products_with_description, detected apps (apps_installed, apps_by_category, apps_count), top_products, and optional detailed_reviews when review extraction is enabled. Export your data from the Apify dataset as JSON, CSV, or Excel — ideal for a Shopify product export scraper workflow.

Key features

• 🧠 Smart proxy fallback (when Apify Proxy is enabled)
  Automatically progresses from direct requests to datacenter, then to residential proxies with retries on 403/429/503. Once residential is used, it’s kept for subsequent requests — boosting reliability for your Shopify store crawler workflows.

• 📦 Comprehensive catalog coverage
  Uses Shopify’s public JSON endpoints (/products.json, /collections.json, /meta.json) to collect products, variants, prices, images, vendors, categories, and collections — a robust Shopify catalog scraper for structured data.

• ⭐ Optional Yotpo review extraction
  Toggle extractReviews to fetch review stats for the 10 newest products and return per-product counts, average scores, and sampled reviews in detailed_reviews.

• 💾 Live dataset saving
  Results are pushed to the Apify dataset as each store completes, so you can access partial data even if a long run stops — perfect for Shopify store data mining at scale.

• 🛡️ Resilient error handling
  Store-level failures are saved as dataset items with error details, while remaining stores continue processing — a dependable Shopify web scraper for unattended runs.

• 📈 Pricing and inventory analytics
  Computes price_min, price_avg, price_max, total_variants_available, and inventory_availability_pct out of the box — use it as a Shopify product price scraper and Shopify inventory scraper in one.

• 🔁 Batch store scraping
  Provide multiple startUrls to scrape many Shopify shops in a single run — ideal for a Shopify store crawler at scale.

• 👩‍💻 Developer-friendly
  Access all data via the Apify API or export to CSV/JSON/Excel. Great for pipelines, dashboards, and scripts — including Shopify store scraper Python automations via the Apify API.

• 🔐 No login or cookies required
  Scrapes public endpoints only — a clean, safe alternative to a Shopify store scraper Chrome extension.

How to use Shopify Store Scraper - step by step

1. Sign up or log in to your Apify account.
2. Open the “shopify-store-scraper” actor in your console.
3. Configure inputs:
   • startUrls: Add one or more Shopify store URLs (e.g., https://www.allbirds.com).
   • extractReviews: Set true to collect Yotpo review details for the 10 newest products; false to skip reviews for faster runs.
   • proxyConfiguration: Optional. Set useApifyProxy to true to enable smart proxy fallback (datacenter → residential with retries).
4. Click Start to launch the run.
5. Monitor progress in the Logs tab — you’ll see product page counts and any proxy fallback events.
6. Open the Dataset (OUTPUT) tab to view items as they’re saved while the run progresses.
7. Export results as JSON, CSV, or Excel — or fetch them programmatically via the Apify API for your Shopify product export scraper workflow.

Pro Tip: Automate recurring scrapes via the Apify API and pipe the dataset to your analytics stack or data warehouse for ongoing competitor monitoring and catalog updates.

Use cases

Use case name	Description
Competitor price monitoring	Track price_min/avg/max and newest products across competitor stores using this Shopify competitor product scraper for timely pricing moves.
Catalog export to CSV	Scrape Shopify products to CSV with titles, handles, prices, vendors, and categories for merchandising or marketplace onboarding.
Market research & trend analysis	Aggregate collections, categories, and vendors across many stores to study product mix and trends using a Shopify store data extractor.
Inventory availability tracking	Monitor total_variants_available and inventory_availability_pct to gauge stock health across selected catalogs.
Theme and app intelligence	Detect theme_name, theme_version, and apps_installed for ecosystem research and theme/app adoption analysis.
Review insights (Yotpo)	Enable extractReviews to collect reviews_count and avg_rating for recent products and benchmark customer sentiment.
Data pipeline ingestion (API)	Use the Apify API to ingest JSON outputs into BI tools or internal pipelines for continuous Shopify store data mining.

Why choose Shopify Store Scraper?

This solution prioritizes reliability and structured output for production data extraction.

• 🎯 Accurate, structured fields from public Shopify JSON APIs for consistent analytics.
• 🚀 Scales across multiple stores by accepting a list of startUrls and processing each sequentially.
• 🔌 Developer access via the Apify API with flexible exports (JSON, CSV, Excel) for easy integration.
• 🔒 Safe by design: no login or cookies; public endpoints only.
• 🧰 Production-ready: robust error handling and live dataset saves reduce operational risk.
• 🌐 Adaptive proxy strategy (when Apify Proxy is enabled) to minimize blocks and improve success rates.
• 🧩 More reliable than browser extensions — enjoy server-side stability and repeatability for your Shopify store scraping tool.

In short, it’s a dependable Shopify product data scraper that balances breadth of data, resiliency, and ease of integration.

Is it legal / ethical to use Shopify Store Scraper?

Yes — when used responsibly. This actor collects data from publicly available Shopify endpoints (/products.json, /collections.json, /meta.json) and publicly accessible product pages. It does not access private or password-protected content.

Guidelines for compliant use:

• Scrape only public data and respect website terms of service.
• Ensure compliance with data protection laws (e.g., GDPR, CCPA) and your local regulations.
• Avoid misuse of contact or personal data; focus on product and catalog analytics.
• Consult your legal team for edge cases or jurisdiction-specific questions.

Input parameters & output format

Example JSON input

{
  "startUrls": [
    "https://www.allbirds.com",
    "https://example-store.myshopify.com"
  ],
  "extractReviews": true,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Input fields

• startUrls (array, required): List one or more Shopify store URLs (e.g., https://www.allbirds.com). Default: not set.
• extractReviews (boolean, optional): Enable to extract detailed product reviews from Yotpo (slower but more comprehensive). Default: true.
• proxyConfiguration (object, optional): Choose which proxies to use. If Shopify rejects the proxy, a residential proxy will be used as a fallback. Default: not set.

Example JSON output (successful store item)

{
  "store_domain": "www.allbirds.com",
  "store_url": "https://www.allbirds.com",
  "shop_name": "shop11044168.myshopify.com",
  "country": "US",
  "currency": "USD",
  "locale": "en-US",
  "theme_name": "rc-cm-2025-12-26_20-35 Update",
  "theme_id": 128596836432,
  "theme_version": "1.131.2",
  "apps_installed": ["Elevar Conversion Tracking", "JsEncrypt"],
  "apps_by_category": {
    "Analytics": ["Elevar Conversion Tracking"],
    "Other": ["JsEncrypt"]
  },
  "apps_count": 2,
  "total_products": 681,
  "total_variants": 7276,
  "collections": ["Accessories", "Shoes", "Apparel"],
  "collections_count": 250,
  "categories": ["Accessories", "Apparel", "Shoes", "Socks"],
  "vendors": ["Allbirds"],
  "price_min": 2.0,
  "price_avg": 79.34,
  "price_max": 500.0,
  "products_on_sale": 681,
  "discount_pct_avg": null,
  "products_with_reviews": 0,
  "review_coverage_pct": 0,
  "avg_reviews_per_product": null,
  "avg_rating": null,
  "total_estimated_sales": null,
  "avg_sales_per_product": null,
  "total_variants_available": 5647,
  "inventory_availability_pct": 77.6,
  "estimated_launch_date": "2018-11-12",
  "oldest_product_date": "2018-11-12",
  "newest_product_date": "2025-11-06",
  "products_with_images": 680,
  "avg_images_per_product": 4.5,
  "products_with_description": 681,
  "top_products": [
    {
      "title": "Allbirds Laces - Warm Red - Round",
      "url": "https://www.allbirds.com/products/allbirds-laces-warm-red-round",
      "price": 8.0,
      "reviews": 0,
      "rating": 0.0
    }
  ],
  "detailed_reviews": [
    {
      "product_url": "https://www.allbirds.com/products/allbirds-laces-warm-red-round",
      "product_id": "7242343809104",
      "reviews_count": 0,
      "avg_rating": 0.0,
      "reviews": []
    }
  ],
  "scraped_at": "2025-12-29T07:34:23.715157Z",
  "scrape_duration_sec": 15.71,
  "api_blocked": false
}

Example JSON output (error item when a store fails)

{
  "store_url": "https://blocked-store.example",
  "error": "Failed to fetch homepage from https://blocked-store.example. All request attempts failed.",
  "scraped_at": "2026-04-09T10:00:00.000Z"
}

Example JSON output (error item when no valid URLs are supplied)

{
  "error": "No valid URLs found in startUrls. Please provide at least one Shopify store URL in the input.",
  "input_received": {
    "startUrls": []
  },
  "scraped_at": "2026-04-09T10:00:00.000Z"
}

Notes:

• Some fields may be null if not present on the target (e.g., theme_name, theme_id, theme_version) or when metrics are not calculated (e.g., discount_pct_avg).
• The api_blocked flag is true when no products are returned (often due to blocking).
• detailed_reviews is only included when extractReviews is true and reviews are successfully fetched.

FAQ

Is there a free Shopify scraper I can try before subscribing?

Yes. You can run the Shopify Store Scraper on Apify and export sample results from the dataset. Availability and limits depend on your Apify plan, which makes it easy to evaluate.

Do I need to log in or provide cookies to scrape Shopify stores?

No. The scraper uses public Shopify endpoints and publicly accessible product pages. It requires no login or cookies.

Can I scrape multiple Shopify stores in one run?

Yes. Add multiple URLs to startUrls. The actor processes stores sequentially and saves each store’s results to the dataset as soon as it’s done.

How does blocking and proxy fallback work?

If you enable Apify Proxy via proxyConfiguration.useApifyProxy, the scraper will attempt direct requests first, then switch to a datacenter proxy, and finally to a residential proxy with retries on 403/429/503. Once residential is used, it’s kept for the rest of the run. Without Apify Proxy enabled, requests are direct only.

What product data does this Shopify web scraper extract?

It collects totals for products and variants, pricing analytics (price_min/avg/max), inventory availability (total_variants_available, inventory_availability_pct), collections, categories, vendors, theme details, detected apps, and top_products. Optional detailed_reviews are available when extractReviews is enabled.

Can I export the results to CSV or Excel?

Yes. All results are saved to the Apify dataset. From there, you can export to JSON, CSV, or Excel, or access the data via the Apify API — ideal for a Shopify product export scraper workflow.

How are errors reported if a store fails?

Failures are captured as dataset items with store_url, error, and scraped_at. If no valid URLs are supplied, the dataset includes an item with error, input_received, and scraped_at explaining the issue.

Does review extraction work for all products?

When extractReviews is true, the scraper targets the 10 newest products and attempts to fetch Yotpo-based review metadata and samples. If a product has no Yotpo integration or parsing fails, that product will keep default review values (reviews: 0, rating: 0.0).

Can I use it with Python or my own scripts?

Yes. You can access the Apify dataset and actor runs via the Apify API from any language, including Python, to build automated pipelines and reporting workflows.

Is this better than a Shopify store scraper Chrome extension?

For repeatability and scale, yes. This server-side Shopify store scraping tool avoids browser instability and lets you automate jobs, export data reliably, and integrate results into your systems.

Closing thoughts

Shopify Store Scraper is built to extract structured Shopify store intelligence at scale. With adaptive proxy fallback (when enabled), resilient error handling, and clean JSON outputs, it empowers marketers, developers, analysts, and researchers to build dependable Shopify data pipelines. Use the Apify API to automate batches, export Shopify products to CSV, and integrate insights anywhere in your stack. Start extracting smarter, faster Shopify store insights today.