Next-Gen E-Commerce Product Scraper

A powerful, robust, and versatile web scraping solution for extracting product data from various e-commerce websites. Built specifically for Apify, this actor leverages Puppeteer to handle JavaScript-rendered content, automatically traverses domains, translates content, converts currencies, and generates ready-to-use Shopify CSVs.

🌟 Key Features

• Multi-Domain Crawling: Capable of discovering product links across entire websites just by providing the root domains.
• AI-Powered Categorization: Automatically generates detailed Shopify product categories using OpenAI (optional, requires API key).
• Automated Translation: Translates titles and descriptions natively to a target language (e.g. EN, DE, AR).
• Currency Conversion: Dynamically converts local prices to a target currency using live exchange rates, with customizable markups and margins.
• Smart Stock and Price Extraction: Deep DOM parsing logic to identify stock status, variations, and pricing using heuristic analysis.
• Shopify-Ready Exports: The scraper seamlessly exports directly to the Apify dataset using standard Shopify CSV columns (Handle, Title, Body (HTML), Vendor, Type, Tags, Image Src, Variant Price, etc.), ready for immediate import to your Shopify store.
• Resilience & Proxy Support: Built-in support for Apify Proxies to bypass rate limits and anti-bot systems.

🎯 Use Cases

• Drop-Shipping Automation: Effortlessly scrape competitor catalogs, apply price markups, and instantly import the items to your Shopify store.
• Market Research: Aggregate pricing and availability across multiple regional domains in a normalized currency.
• Content Localization: Scrape foreign e-commerce sites and dynamically translate descriptions for local markets.

⚙️ Input Parameters

The actor is highly configurable via JSON or the Apify UI:

Parameter	Type	Required	Description
urls	Array	Yes	List of domain URLs to process (e.g., ["https://example-shop.com"]).
targetCountry	Select	Yes	Target country context (e.g., EG, DE, NG). Default: EG.
concurrency	Integer	No	Number of domains to process simultaneously (1-5). Default: 1.
targetLanguage	String	No	Translates titles and descriptions to this language code (e.g., EN, DE). Default: EN.
baseCurrency	String	No	The source currency (e.g., EGP, EUR). Default: AUTO.
targetCurrency	String	No	Currency to convert final prices to (e.g., USD, NGN).
priceMultiplier	Number	No	Apply a markup multiplier to final prices. Default: 1.
exchangeRateMargin	Number	No	Adds a safety margin to the exchange rate. Default: 0.
checkStockInfo	Boolean	No	Determines whether the scraper should deeply verify stock. Default: true.
openaiApiKey	String	No	Optional API key to enable AI-powered Shopify categorization.
proxyConfiguration	Proxy	No	Apify Proxy configuration to avoid IP bans.

Example Input configuration

{
  "urls": [
    "https://www.example.com"
  ],
  "targetCountry": "DE",
  "concurrency": 2,
  "targetLanguage": "EN",
  "baseCurrency": "EUR",
  "targetCurrency": "USD",
  "priceMultiplier": 1.5,
  "checkStockInfo": true
}

📊 Output Format

The actor pushes results directly to the default Apify Dataset as soon as a product is fully processed. The output adheres to standard Shopify CSV format fields to ensure maximum compatibility.

Example extracted fields:

• Handle (URL slug)
• Title (Translated to target language)
• Body (HTML) (Cleaned product description)
• Vendor (Extracted domain/brand name)
• Product Category (Generated via AI if enabled)
• Tags
• Variant Price (Automatically converted with applied markups)
• Variant Inventory Tracker (shopify)
• Variant Inventory Qty (Extracted stock levels)
• Image Src (High-res image link)
• Image Position (1)

You can easily download the results as a CSV file from the Apify Console and upload them directly into your Shopify dashboard.

🛠 Troubleshooting

• No Products Found: Some target websites might use extremely obscure DOM architectures for products.
• Timeouts: If you set concurrency too high, the Apify Actor may run out of memory. Try keeping concurrency close to 1 or 2 for complex sites.
• Missing Stock Data: Sometimes stock statuses are hidden behind network requests that require deeper analysis or specialized proxy configurations.

If you like the actor or need custom modifications, feel free to reach out or fork the logic!