Any E-commerce Store Catalog Scraper

Give it a store URL. Get the entire product catalog as clean, structured JSON — products, variants, per-variant prices, sale prices, stock and images.

Most scrapers only work on one platform, and only on the big, famous marketplaces. This one auto-detects the store's platform (Shopify, WooCommerce, PrestaShop, Magento) and extracts the full catalog of any shop — including the small and mid-size stores every other tool ignores. Custom-built stores with no recognisable platform? An AI agent explores the site and builds an extraction recipe on the fly. That long tail is our specialty.

What does this Actor do?

You paste a store URL. The Actor detects how the store is built, reads its catalog the fastest way that store allows (native JSON endpoints where they exist, sitemaps and product pages otherwise), and returns one clean JSON object per product — with every variant broken out as structured data. No API keys, no store login, no per-platform setup.

• 🌍 Works on any store, not just the famous ones — Shopify, WooCommerce, PrestaShop and Magento are detected automatically; custom builds via AI.
• 🧩 Variants done properly — sizes, colours and options as structured attributes, each with its own price, sale price, stock and image. Not just the parent product.
• ⚡ Fast where it can be — Shopify catalogs read from JSON endpoints (a 1,000-product store in a handful of requests instead of a thousand page loads).
• 💶 Honest data — transparent stock signals, real sale prices, no invented numbers.

What data can you extract?

Product data	Commercial info	Per-variant detail
📝 Name (multi-language)	💰 Price & currency	🎨 Attributes (size, colour, …)
🔗 Description	🏷️ Sale price (discounted)	💰 Variant price & sale price
🏢 Brand	📂 Categories & tags	📦 Stock status (in/out)
🖼️ All images (with position)	🔗 Product & origin URL	🔢 Stock quantity (when published)
🆔 Origin ID / SKU	🧬 Product type (simple/variant)	🖼️ Variant image

Every product is one JSON object; export the dataset as JSON, CSV, Excel or XML.

{
    "product": {
        "origin_id": "7811232948456",
        "origin_url": "https://the-store.com/products/example-sneaker",
        "name": {"en": "Example Sneaker"},
        "brand": "ExampleBrand",
        "categories": ["Shoes", "Sneakers"],
        "base_price": 89.95,
        "base_discounted_price": 69.95,
        "currency": "EUR",
        "product_type": "variant"
    },
    "variants": [
        {
            "origin_variant_id": "43210",
            "sku": "SNKR-42-BLK",
            "variant_name": "42 / Black",
            "attributes": {"Size": "42", "Color": "Black"},
            "price": 89.95,
            "discounted_price": 69.95,
            "stock_status": "in_stock",
            "stock_quantity": 7,
            "image_url": "https://..."
        }
    ],
    "images": [{"source_url": "https://...", "position": 0}]
}

Which stores work?

• Shopify, WooCommerce, PrestaShop, Magento (~70% of all shops) — detected automatically and scraped with a battle-tested template. Fast and cheap.
• Custom-built stores (no recognisable platform) — turn on "Scrape custom-built stores (AI)". An AI agent explores the site, figures out where the products, prices and variants live, and builds a recipe on the fly. Hard-capped per store so cost never runs away.

Know the platform already? Set it in the Platform field to skip auto-detection.

Why use this Actor?

	Typical single-platform scraper	Any E-commerce Store Catalog Scraper
Platform coverage	One platform, big sites only	Any store — 4 platforms + custom via AI
Setup	API keys, auth, docs	Just paste a URL
Variants	Limited or extra calls	Captured automatically, structured
Small / regional shops	Usually unsupported	First-class — the long tail is the point
Custom-built stores	Not supported	AI agent builds a recipe on the fly
Cost	Per-request + subscription	Pay-per-event, only for what you get

What can you do with the data?

• 💰 Price & assortment monitoring — schedule runs to track a competitor's catalog, prices and sale events over time. Pipe changes to Slack or a database.
• 🛒 Catalog imports & dropshipping — pull a supplier's full catalog with variants ready to load into your own store.
• 📊 Market research — map a niche across dozens of small stores nobody else covers, in one place.
• 🗄️ Migration & backup — export your own store's catalog as portable JSON.

How to use it

1. Create a free Apify account.
2. Open this Actor and paste the store URL.
3. Leave Platform on auto-detect (or pick it if you know it).
4. Optionally cap Max products to control cost.
5. For non-platform shops, turn on Scrape custom-built stores (AI).
6. Click Start and export the dataset as JSON / CSV / Excel.

How much does it cost?

Pay-per-event — you're charged for what you actually get:

What	Price
Each product extracted	$0.001 ($1 / 1,000 products)
Custom-store AI onboarding (once per custom store)	$2 flat

• Platform stores (Shopify / WooCommerce / PrestaShop / Magento) pay only the per-product price. A 500-product store ≈ $0.50.
• Custom stores add the one-off $2 AI onboarding fee (the AI reads the site once and builds a recipe). A 500-product custom store ≈ $2.50. That flat fee covers the AI cost regardless of catalog size, so a tiny custom shop never runs at a loss.

Bring your own Anthropic API key to run the AI on your own account — then you skip the onboarding fee and pay only per product.

Cost tips: cap Max products while testing; set the Platform field to skip detection; leave the AI option off unless you actually need custom stores.

Fair use & compliance

• Respects robots.txt by default (opt-out only for stores you own or have permission to scrape).
• Only public catalog data is extracted — no personal data, no accounts, no login walls.
• Polite rate limiting with automatic backoff, so stores are never hammered.

Support

Open an issue on this Actor — we usually answer within 24h. If a specific store fails, include the URL: store-specific recipe fixes ship fast.