Shopify Scraper

Shopify Scraper is a professional-grade crawling tool designed to extract high-fidelity product data from any e-commerce store built on the Shopify platform.

Why Use Shopify Scraper?

• Market Research: Analyze competitor pricing, product descriptions, and variants to refine your own strategy.
• Trend Monitoring: Track new product launches and stock status changes across multiple brands.
• Data Aggregation: Build comprehensive catalogs by aggregating data from various Shopify-based niche stores.
• Marketing Insights: Understand how successful brands structure their product metadata, including tags and categories.

Key Features

• 🚀 Store-wide Extraction: Capable of crawling an entire store's catalog, from collections to individual products.
• 🎯 Precision Targeting: Fetch specific collections or singular product URLs with surgical precision.
• 💱 Currency Normalization: Automatically handles currency selection and formats prices (multiplied by 100) to ensure financial accuracy without floating-point errors.
• 📦 Comprehensive Data: Extracts everything: titles, descriptions, detailed detailed lists, images, options (size/color), and real-time stock status.
• 🛡️ Resilience: Includes logic to bypass common gateway restrictions and handle "InStock"/"OutOfStock" parsing robustly.

Important Note

On certain Shopify websites, multiple SKUs may be visually merged into a single product page. Please be aware that this scraper treats each SKU as an individual product entry and does not perform any merging of these SKUs.

How it Works

1. Verification

Before running the scraper, verify your target is a Shopify store:

1. Navigate to https://<domain>/admin (e.g., https://gymshark.com/admin).
2. If you see a Shopify login page, the site is compatible.

2. Configuration

The scraper accepts a JSON input defining the target URLs and scraping behavior.

Parameter	Type	Required	Description
startUrls	Array	Yes	A list of URLs to scrape (Homepage, Collection, or Product URLs).
proxy	Object	Yes	Proxy configuration. Residential proxies are highly recommended to avoid blocks.
maxResults	Integer	No	Limit the number of products scraped. Set to 0 for unlimited (default).

Input Example

{
    "startUrls": [
        { "url": "https://uk.gymshark.com/collections/new-releases" }
    ],
    "proxy": {
        "useApifyProxy": true
    },
    "maxResults": 500
}

3. Output

Data is stored in the default dataset.

---

Use Cases

Fetch All Products

Scrape every single product from the store.

{
  "startUrls": [ { "url": "https://uk.gymshark.com" } ],
  "proxy": { "useApifyProxy": true }
}

Fetch by Collection & Currency

Scrape a specific collection ensuring prices are in USD.

{
  "startUrls": [ { "url": "https://uk.gymshark.com/collections/crop-tops?currency=USD" } ],
  "proxy": { "useApifyProxy": true }
}

---

Troubleshooting

Issue	Possible Cause	Solution
0 Results Found	The site may not be Shopify-based or has strong anti-bot protection.	Verify with the /admin trick. Try using residential proxies.
Access Denied / 403	Your IP has been flagged.	Enable useApifyProxy and ensure you have sufficient proxy quota.
Incorrect Price	Currency mismatch or raw integer format.	Remember prices are x100 (e.g., 2000 = 20.00). Ensure ?currency=XYZ param is used if supported.

Cost Estimation

When running on Apify:

• Compute Units: Depends on the site speed and number of products. Roughly 0.1-0.2 CUs per 1k products for optimized runs.
• Proxy Bandwidth: Media rich sites will consume more bandwidth. Note: These are estimates and actual costs may vary.