PriceRunner Scraper

A comprehensive web scraper for PriceRunner that extracts product data including details, prices, reviews, price history, and similar products.

Features

• 🔍 Category Discovery - Automatically discovers all product categories
• 📦 Product Listing - Extracts all products from categories with pagination
• 💰 Price Data - Scrapes current prices from all merchants
• 📊 Price History - Tracks price changes over 3, 6, and 12 months
• ⭐ Reviews - Collects user and professional reviews
• 🔗 Similar Products - Finds related product recommendations
• 🌍 Multi-Region - Supports UK, US, SE, DE, DK, FR regions

Input

Parameter	Type	Description
mode	string	Scraping mode: full, categories, products, consolidate
categoryIds	array	Specific category IDs to scrape (optional)
countryCode	string	Region: uk, us, se, de, dk, fr
outputFormat	string	Output format: json, csv, both
maxProductsPerCategory	integer	Max products per category (0 = unlimited)
minDelay / maxDelay	integer	Rate limiting delays in seconds
includePriceHistory	boolean	Include price history data
includeReviews	boolean	Include review data
includeSimilarProducts	boolean	Include similar products

Output

The scraper outputs product data to the default dataset with the following structure:

{
    "product_id": 123456,
    "category_id": 10,
    "product_name": "Example Product",
    "lowest_price": 99.99,
    "currency": "GBP",
    "total_offers": 15,
    "average_rating": 4.5,
    "total_reviews": 127,
    "price_history": {...},
    "offers": [...],
    "reviews": [...],
    "similar_products": [...]
}

Usage Examples

Scrape All Categories (Full Mode)

{
    "mode": "full",
    "countryCode": "uk",
    "outputFormat": "both"
}

Scrape Specific Categories

{
    "mode": "categories",
    "categoryIds": [10, 94, 82],
    "countryCode": "uk"
}

Quick Test (Limited Products)

{
    "mode": "full",
    "categoryIds": [10],
    "maxProductsPerCategory": 10,
    "countryCode": "uk"
}

Rate Limiting

The scraper includes built-in rate limiting to avoid being blocked. Default settings:

• Minimum delay: 2 seconds
• Maximum delay: 5 seconds

Increase these values if you encounter blocking issues.

Where to Find Output

After running the Actor:

1. Product Data: Go to Storage tab → Default dataset

   • Each row = 1 product
   • Can export as JSON, CSV, or Excel

2. Usage Stats (for billing): Go to Storage tab → Key-value store → USAGE_STATS

   • total_products_scraped: Number of products (for billing)
   • total_categories_scraped: Number of categories processed

Pricing Model

This Actor is designed for per-product pricing:

• Example: $1.50 per 1000 products
• The USAGE_STATS key in the Key-value store shows exact product count

Notes

• Running in full mode with all categories can take several hours
• Memory usage scales with the number of products scraped
• Recommended memory: 2GB minimum, 4GB+ for large scrapes