EBay Scraper Ultimate

eBay Scraper Ultimate is a sophisticated and robust Apify Actor designed to extract comprehensive product data from eBay. It goes beyond simple title and price extraction, providing deep insights into product variants, ratings, and customer feedback.

Features

• Robust Title & Data Extraction: Uses multiple fallback selectors and increased timeouts to handle various eBay page layouts and slow loading times.
• Bot Detection Handling: Automatically detects and handles eBay's "Pardon Our Interruption" screens, logging warnings and skipping blocked pages to ensure crawl continuity.
• Enhanced Image Gallery: Extracts all available product images, including high-resolution versions (up to 1600px) from the gallery.
• Deep Item Specifications: Captures comprehensive technical details and item specifics using advanced table-parsing logic.
• Seller Insights: Extracts seller names and feedback ratings to help identify reputable sources.
• Reliable Ratings & Reviews:
  • Average Rating: Extracts the average star rating using reliable LD+JSON structured data.
  • Rating Count: Captures the total number of ratings for the product.
• Customer Feedback: Scrapes the top 10 most relevant customer comments/reviews for each product.
• Proxy Support: Built-in support for Apify Proxy to prevent blocking and ensure high reliability.
• Optimized for Performance: Combines Playwright for dynamic content and BeautifulSoup for fast, resilient data extraction.

How to Use

Input Parameters

The Actor accepts the following input parameters:

Field	Type	Description	Default
searchQuery	String	Required. The product name or keywords to search for on eBay.	iPhone 15
maxProducts	Integer	Maximum number of products to scrape.	20
proxyConfiguration	Object	Apify Proxy or external proxy configuration for rotating IP addresses.	{ "useApifyProxy": true }

Proxy Configuration

The Actor supports both Apify Proxy and External Proxies. You can configure these in the Apify Console under the Input tab:

1. Apify Proxy: Select "Automatic" or specify proxy groups to use Apify's built-in residential or datacenter proxies.
2. External Proxies: Select "Custom proxies" and provide a list of your own proxy URLs (e.g., http://username:password@proxy.example.com:8080).

[!TIP] Using proxies is highly recommended for eBay to prevent bot detection and ensure high reliability.

Output Data

The results are stored in the default dataset. Each item in the dataset represents a product and contains the following fields:

• url: The direct link to the eBay product page.
• title: The full title of the product.
• price: The current listed price.
• condition: The condition of the item (e.g., "New", "Very Good - Refurbished").
• variants: An object containing available options (e.g., {"Color": ["Black", "Blue"], "Storage": ["128GB", "256GB"]}).
• averageRating: The average star rating of the product.
• ratingCount: The total number of ratings received.
• sellerName: The name of the seller.
• sellerRating: The feedback rating of the seller.
• itemDetails: An object containing detailed specifications of the item.
• images: An array of product image URLs.
• comments: An array of the top 10 customer comments.

Local Development

If you want to run this Actor locally, ensure you have the Apify CLI installed.

1. Install dependencies:

   $pip install -r requirements.txt
   

2. Run the Actor:

   $apify run
   

Deployment to Apify

To deploy this Actor to the Apify platform:

1. Log in to Apify:

   $apify login
   

2. Push the project:

   $apify push
   

Resources

• Apify SDK for Python
• Crawlee for Python
• Beautiful Soup Documentation
• Apify Proxy Documentation