Shopify Product Scraper

Overview

The Shopify Product Scraper is a production-grade Apify actor that extracts product data from any Shopify store using the platform’s built-in JSON endpoints. It is designed for stability, scalability, and ease of use, providing clean, structured output suitable for market research, price monitoring, inventory analysis, and downstream automation.

The actor handles pagination, rate limiting, and concurrency automatically.

---

Key Features

• 🛍 Works on any Shopify store – automatically detects Shopify by checking JSON endpoints.
• 🚀 JSON‑first approach – fast and reliable extraction using Shopify’s native APIs.
• 🔁 Automatic pagination – scrapes all products or stops at a user-defined limit.
• 📦 Clean, simplified output – includes product details, variants, images, pricing, and availability.
• 🎯 Collection or product targeting – provide a product URL, collection URL, or store root.
• 🛡 Rate‑limit handling – configurable request delay and concurrency prevent IP bans.
• 📊 Scheduling ready – works seamlessly with Apify’s scheduled runs.

---

How It Works

1. The actor receives a list of Shopify store URLs (or specific product/collection URLs).
2. It detects if the target store exposes the JSON endpoints (/products.json or /collections/{handle}/products.json).
3. For each URL, it determines whether to scrape a single product or an entire collection.
4. It fetches product data in paginated batches (250 products per request) and applies optional filters.
5. Each product is normalized into a clean structure (price range, variants, images, etc.).
6. Results are pushed to the default Apify dataset.

---

Input Configuration

Required Fields

Field	Type	Description
startUrls	array	List of Shopify store URLs, collection URLs, or product URLs. Each entry can be a string or an object with a url field.

Optional Fields

Field	Type	Description
mode	string	Scraping mode: auto, product, or collection. Auto detects from URL.
maxProducts	integer	Maximum number of products to scrape across all start URLs.

---

Output Data Structure

Each product is output as an object with the following fields.

Example Output

{
  "id": 8326297780410,
  "title": "Teslin Bag",
  "handle": "teslin-bag-light-moss",
  "description": "<p>Comfy to carry, has a timeless design, and is made with enough space for daily essentials. Must be the Teslin. Extra points for the curved silhouette that sits close as you head from lake to trail to home.</p>",
  "brand": "tentree",
  "category": "Accessories",
  "price": 45.0,
  "available": true,
  "variants": [
    {
      "id": 45564674670778,
      "title": "LIGHT MOSS / ONE",
      "price": 45.0,
      "sku": "TAU6594-6045-ONE",
      "available": true
    }
  ],
  "images": [
    "https://cdn.shopify.com/s/files/1/2341/3995/files/Green-Recycled-Adjustable-Cross-Body-Bag-TAU6594-6045_6.jpg?v=1770338603",
    "https://cdn.shopify.com/s/files/1/2341/3995/files/Green-Recycled-Adjustable-Cross-Body-Bag-TAU6594-6045_1.jpg?v=1770338603",
    "https://cdn.shopify.com/s/files/1/2341/3995/files/Green-Recycled-Adjustable-Cross-Body-Bag-TAU6594-6045_4.jpg?v=1770338603",
    "https://cdn.shopify.com/s/files/1/2341/3995/files/Green-Recycled-Adjustable-Cross-Body-Bag-TAU6594-6045_5.jpg?v=1770338603",
    "https://cdn.shopify.com/s/files/1/2341/3995/files/Green-Recycled-Adjustable-Cross-Body-Bag-TAU6594-6045_3.jpg?v=1770338603",
    "https://cdn.shopify.com/s/files/1/2341/3995/files/Green-Recycled-Adjustable-Cross-Body-Bag-TAU6594-6045_2.jpg?v=1770338603"
  ],
  "url": "https://www.tentree.com/products/teslin-bag-light-moss",
  "created_at": "2026-02-05T16:43:19-08:00",
  "updated_at": "2026-03-23T11:33:13-07:00"
}

Use Cases

1. 📊 Market Research – analyze product catalogs, pricing strategies, and competitor assortments.

2. 🛒 Price Monitoring – track price changes and discounts over time.

3. 📈 Inventory Analysis – monitor stock levels and availability.

4. 🤖 Downstream Automation – feed data into pricing tools, analytics platforms, or inventory systems.

5. 🧠 Dataset Creation – build product databases for machine learning or recommendation engines.

Performance & Reliability

1. Automatic retries with exponential backoff

2. Lightweight output – only essential fields are kept; large fields (like HTML description) can be omitted to save space.

3. Apify platform ready – runs on Apify’s infrastructure with automatic scaling.

Support & Maintenance

This actor is actively maintained and designed for production usage. For issues or feature requests, please use the Apify platform issue tracker.

Final Notes

This actor prioritizes:

1. Data clarity – clean, documented output schema.

2. Operational reliability – robust error handling, retries, and fallback mechanisms.

3. Professional usability – intuitive input, flexible configuration, and scalable performance.

It is suitable for both individual users and enterprise-scale workflows.