vidaXL Product Scraper — eBay Ready with AI Optimization

Extract complete product data from vidaXL.com and vidaXL.de at scale — with built-in GPT-4o-mini optimization that generates eBay-ready titles, descriptions, categories, and mobile-short summaries in a single run.

---

What This Actor Does

This Actor crawls vidaXL category listing pages and product detail pages using a real Chromium browser (Playwright), extracting structured product data and optionally enriching it with AI-generated eBay content — all in one automated pipeline.

You provide a list of URLs (category pages or direct product pages) paired with your internal SKUs, and the Actor returns a clean, structured dataset ready for eBay listing tools, inventory systems, or dropshipping workflows.

---

Key Features

Full product data extraction

• Product name (with automatic vidaXL brand prefix removal)
• Brand, price, and currency
• Category breadcrumbs with category IDs and URLs
• All product images mapped to your SKU (SKU_1, SKU_2, …) with high-resolution ?sw=1024 URLs
• Selected colour variant
• Short meta description
• Full description (HTML and plain text)
• Specifications as a clean key/value map
• Pros list

AI-powered eBay content generation (optional)

• Plug in your OpenAI API key to activate GPT-4o-mini enrichment
• Generates an eBay-optimised title (max 80 characters, no brand noise)
• Suggests the correct eBay category ID for each product
• Writes a fully formatted eBay HTML description
• Produces a mobile-short summary (max 800 characters) for compact listings

Built for reliability

• Playwright Locator API throughout — lazy queries with built-in DOM retry logic
• Pre-counts elements before every extraction — no blind waitForSelector timeouts
• Isolated try/catch per field — one broken element never blocks the rest
• Tiered price extraction with three fallback selectors
• Rotating proxy support via Apify Proxy
• Configurable request limit and polite crawl delay between pages

Supports both locales

• vidaxl.com (international / English)
• vidaxl.de (German)

---

Input

{
  "startUrls": [
    { "sku": "12345", "url": "https://www.vidaxl.com/e/some-product/123.html" },
    { "sku": "67890", "url": "https://www.vidaxl.com/g/123456" }
  ],
  "open_ai_key": "sk-...",
  "prompt": "You are an eBay listing expert. Return valid JSON with keys: category_id, title, description_html, short_description.",
  "maxRequestsPerCrawl": 100
}

Field	Type	Required	Description
startUrls	Array	✅	List of { sku, url } objects. Accepts category (/g/) or product (/e/) URLs
open_ai_key	String	❌	OpenAI API key. Omit to skip AI enrichment and scrape only
prompt	String	❌	System prompt sent to GPT-4o-mini. Controls output format and tone
maxRequestsPerCrawl	Number	❌	Cap on total requests per run

---

Output

Each product is saved as one record in the Apify Dataset:

{
  "url": "https://www.vidaxl.com/e/product-name/8720287219385.html",
  "inputSKU": "12345",
  "brand": "vidaXL",
  "name": "Dog Bed Black 70x40x24 cm Velvet",
  "vidaXLPrice": "49.99",
  "ebayPrice": "41.49",
  "currency": "€",
  "breadcrumbs": [
    { "index": 1, "name": "Pet Supplies", "url": "...", "categoryId": "123" },
    { "index": 2, "name": "Dog Beds", "url": "...", "categoryId": "456" }
  ],
  "images": [
    { "fileName": "12345_1", "url": "https://...?sw=1024" },
    { "fileName": "12345_2", "url": "https://...?sw=1024" }
  ],
  "selectedColor": "Black",
  "shortDescription": "...",
  "descriptionHtml": "<p>...</p>",
  "descriptionText": "...",
  "specificationsHtml": "<ul>...</ul>",
  "specifications": {
    "Material": "Velvet",
    "Dimensions": "70 x 40 x 24 cm",
    "Colour": "Black"
  },
  "pros": ["Soft and comfortable", "Easy to clean"],
  "ChatGPTresponse": {
    "ebayCategory_id": "20744",
    "ebayTitle": "Dog Bed Black 70x40x24 cm Velvet Soft Pet Sofa Cushion Cosy",
    "ebayDescriptionHtml": "<div>...</div>",
    "mobileShort": "Cosy velvet dog bed in black..."
  }
}

Pricing note: ebayPrice is pre-calculated at vidaXLPrice × 0.83 to account for eBay fees and leave a margin buffer.

---

Use Cases

• eBay dropshippers sourcing from vidaXL who need bulk-listed, AI-optimised product content
• Inventory managers tracking prices, availability, and specifications across hundreds of SKUs
• E-commerce agencies building product feeds for clients reselling vidaXL goods
• Price monitoring across the .com and .de storefronts

---

Notes

• This Actor uses Apify Proxy for IP rotation. Residential or datacenter proxies are both supported.
• AI enrichment calls OpenAI's API and will consume tokens from your OpenAI account.
• A 5-second polite delay is applied between product page requests to avoid rate limiting.
• The Actor is optimised for vidaXL's current DOM structure. If vidaXL updates their site layout, field-level error logging will pinpoint exactly which selectors need updating.