eBay Product Scraper

What is eBay Product Scraper and How Does It Work?

eBay Product Scraper is a powerful web scraping tool that extracts detailed product information from eBay product pages. It collects comprehensive data including product details, variants, reviews, seller information, and more — all exportable in JSON or CSV format.

Why Use eBay Product Scraper?

Use this scraper to:

• Monitor pricing and availability of products on eBay
• Track product ratings and reviews for market research
• Analyze seller performance and reputation
• Compare product variants and options
• Automate data extraction for eCommerce intelligence and competitive analysis

Features

• Extracts product details (title, price, availability, images, description, etc.)
• Categorizes product variants by type (size, color, model, etc.)
• Extracts complete variant information (prices, images, availability)
• Scrapes product reviews and ratings
• Collects seller information and ratings
• Supports multiple eBay domains and languages
• Uses proxy rotation and user agent randomization for better reliability
• Automatic retry mechanism for failed requests
• Smart handling of different eBay page layouts and structures
• Efficient memory management for processing large numbers of products

How to Use eBay Product Scraper

1. Enter one or more eBay product URLs
2. Configure scraping options (reviews, variants, details, seller info)
3. Select language and proxy settings
4. Run the scraper and download the extracted data
5. Optionally, access the data via API without logging into Apify

How to Use eBay Product Scraper on Apify

To use this scraper on Apify, follow these simple steps:

1. Go to the eBay Product Scraper on Apify platform

2. Input Configuration:

   • Enter one or more eBay product URLs you want to scrape
   • Configure which data components to scrape (reviews, variants, details, seller info)
   • Select language and proxy settings if needed

3. Run the Actor:

   • Click the "Start" button to begin scraping
   • The actor will process each URL and extract the requested data

4. Access Your Results:

   • Once complete, view your results in the "Dataset" tab
   • Download the data in your preferred format (JSON, CSV, Excel, etc.)
   • Alternatively, access the data via the Apify API

5. Schedule Regular Runs (Optional):

   • Set up scheduled runs to monitor products over time
   • Configure webhooks to receive notifications when runs complete

Input Parameters

Parameter	Type	Description
productUrls	Array	List of eBay product URLs to scrape
scrapeReviews	Boolean	Whether to scrape product reviews
scrapeProductVariants	Boolean	Whether to scrape product variants/options
scrapeProductDetails	Boolean	Whether to scrape detailed product specifications
scrapeSellerInfo	Boolean	Whether to scrape seller information
language	String	Language to use on eBay
proxyCountry	String	Country for proxy (AUTO_SELECT_PROXY_COUNTRY to auto-select based on domain)

Example Input

{
  "productUrls": [
    "https://www.ebay.com/itm/123456789",
    "https://www.ebay.com/itm/987654321"
  ],
  "scrapeReviews": true,
  "scrapeProductVariants": true,
  "scrapeProductDetails": true,
  "scrapeSellerInfo": true,
  "language": "en-US",
  "proxyCountry": "US"
}

Output

The actor outputs a JSON object for each product with the following structure:

{
  "url": "https://www.ebay.com/...",
  "title": "Product Title",
  "price": "$19.99",
  "currency": "USD",
  "availability": "In Stock",
  "images": ["https://i.ebayimg.com/...", ...],
  "details": {...},
  "description": "Product description...",
  "about_section": [...],
  "average_rating": "4.5",
  "review_count": "123",
  "structured_variants": {
    "models": [...],
    "colors": [...],
    "sizes": [...],
    "other": [...]
  },
  "seller_info": {...},
  "product_reviews": [...],
  "seller_reviews": [...]
}

Running Locally with Apify CLI

You can also run this actor locally using Apify CLI:

1. Install Apify CLI: npm install -g apify-cli
2. Navigate to the project directory
3. Run apify run to start the actor locally
4. Access the results in the apify_storage directory

How the Scraper Works

The eBay Product Scraper uses Playwright, a modern headless browser automation library, to navigate eBay product pages and extract data. Here's how it works:

1. Browser Automation: The actor launches a headless browser instance that mimics real user behavior when visiting eBay pages.

2. Data Extraction Process:

   • Navigates to each product URL
   • Waits for critical page elements to load
   • Uses both DOM parsing and JavaScript evaluation to extract product information
   • Handles different page layouts and element structures across various eBay domains
   • Extracts structured data including product details, prices, images, and reviews

3. Structured Variant Handling: The scraper intelligently categorizes product variants by type:

   • Identifies different variant types (size, color, model, etc.)
   • Organizes variants into structured categories
   • Captures price, availability, and image differences between variants

4. Seller Information Extraction: When enabled, the scraper:

   • Extracts detailed seller information including ratings and feedback scores
   • Captures seller policies (returns, shipping, etc.)
   • Collects seller history and performance metrics

5. Review Processing: The scraper handles both product and seller reviews:

   • Extracts review content, ratings, and reviewer information
   • Organizes reviews by type (product vs. seller)
   • Preserves review metadata (dates, helpfulness votes, etc.)

6. Error Handling: The actor implements robust error handling with automatic retries for failed requests, timeouts, and navigation errors.

Anti-blocking Measures

This actor uses several techniques to avoid being blocked by eBay:

• Random user agent rotation: Cycles through different browser user-agent strings to avoid detection
• Headless browser with realistic behavior: Simulates human-like navigation patterns and timing
• Proper request throttling and timing: Adds random delays between actions to avoid triggering rate limits
• Proxy rotation across different countries: Uses proxies appropriate for the target eBay domain
• Session management: Maintains consistent sessions to appear as a legitimate user

Performance Optimization

The scraper is optimized for both speed and reliability:

• Selective data extraction based on configuration options to improve performance
• Efficient DOM traversal to minimize memory usage
• Smart caching of repeated information
• Optimized image URL extraction to avoid redundant requests

Limitations

• Some product variants may not be detected on certain eBay listings
• Review scraping may be limited for products with a large number of reviews
• Some seller information may not be available for all sellers
• eBay's website structure changes frequently, which may require updates to the scraping logic

License

This project is licensed under the MIT License - see the LICENSE file for details.