WooCommerce Product Scraper

A high-performance Apify Actor to extract detailed product information from any WooCommerce-powered online store.

---

Overview

The WooCommerce Product Scraper is an advanced Actor built for scalable, reliable, and flexible data extraction from WooCommerce e-commerce websites. Designed for e-commerce analytics, price monitoring, catalog aggregation, and competitor research, this Actor collects product data including titles, prices, images, descriptions, ratings, SKUs, categories, and more.

• Robust discovery: Automatically finds and scrapes all products from shop, category, and custom pages.
• Customizable: Easily override CSS selectors for stores with unique WooCommerce themes.
• Parallelized: Leverages Apify's infrastructure for fast, concurrent scraping.
• Export ready: Outputs structured results to Apify Dataset for effortless integration with your workflows.

---

Features

• 🚀 Fast & Parallel Scraping: Scrapes multiple pages simultaneously with configurable concurrency.
• 🎯 Flexible Targeting: Start from homepage, category, or product URLs. Supports lists and sitemaps.
• 🏷️ Rich Data Extraction: Captures comprehensive product attributes, prices (including sales), images, ratings, and metadata.
• 🛠️ Custom Selectors: Override default CSS selectors to adapt to custom WooCommerce themes.
• 🪢 Rate Limiting: Configurable wait times between requests to avoid overloading target sites.
• 💾 Structured Output: Data is saved in a normalized format, ready for export as JSON, CSV, Excel, or API consumption.

---

Input Configuration

Provide your scraping preferences via the Actor input. Example input schema:

{
  "startUrls": [
    { "url": "https://woocommerce.com/storefront/" }
  ],
  "productLimit": 10,
  "concurrency": 5,
  "waitBetweenRequests": 300,
  "customSelectors": {
    "title": "h1.product_title",
    "price": "span.woocommerce-Price-amount",
    "description": "div.woocommerce-product-details__short-description",
    "image": "figure.woocommerce-product-gallery__wrapper img, img.wp-post-image.ux-skip-lazy",
    "sku": "span.sku",
    "category": ".product_meta .posted_in a",
    "rating": ".star-rating"
  }
}

Input Fields

Field	Type	Description	Default
startUrls	array	List of URLs to start scraping (homepage, category, or product pages).	Required
productLimit	integer	Maximum number of products to scrape (0 = unlimited).	10
concurrency	integer	Number of parallel requests.	5
waitBetweenRequests	integer	Wait time (ms) between requests to avoid server overload.	300
customSelectors	object	Override CSS selectors for product fields (useful for custom WooCommerce themes).	See above example

---

Output

Results are stored in the Apify Dataset. Each entry includes:

• name - Product title
• prices - Price details (price, sale_price, regular_price, currency_symbol, currency_code, on_sale)
• images - Array of image URLs
• description - Product description (HTML/text)
• sku - Stock Keeping Unit
• categories - Product categories
• tags - Product tags
• attributes - Custom attributes
• average_rating - Product rating
• url - Source product URL

You can export data as JSON, CSV, XLSX, or use via Apify API.

---

Usage Examples

Basic Run

1. Go to the Actor page on Apify Console.
2. Click Run.
3. Input the WooCommerce store URL(s) in the startUrls field.
4. Optionally adjust productLimit, concurrency, etc.
5. Click Run. Download results from the Dataset tab.

Advanced: Custom Selectors

If the store uses a custom WooCommerce theme, override default selectors:

"customSelectors": {
  "title": "h1.custom-title",
  "price": "span.custom-price"
}

---

Best Practices & Tips

• Start with a low productLimit (e.g., 5) to validate your configuration.
• Increase waitBetweenRequests if you notice captchas or blocking.
• Always test custom selectors on actual product pages using your browser's dev tools.
• Avoid aggressive concurrency on small or protected stores.

This Actor is provided under the MIT license.

---

Built with ❤️ using Apify SDK.