🎵️ E-commerce Product Crawler

An Apify actor for scraping product information from major e-commerce platforms (Amazon, eBay, Shopee). This actor allows you to collect detailed product data based on your search terms.

✨ Features

• 🔍 Search products across multiple platforms
• 📊 Configurable number of results
• 💰 Real-time pricing data
• 📝 Detailed product descriptions
• 🖼️ Product images
• ⭐ Ratings and reviews
• 📈 Sales statistics
• 👥 Seller information
• 🤖 Powered by Gemini AI
• 🔑 Pre-configured API key

⚙️ Input Configuration

The actor accepts the following input parameters:

Field	Type	Required	Description
searchTerm	String	Yes	Product name or keywords to search for
maxProducts	Integer	No	Maximum number of products to collect (default: 10, max: 100)
platform	String	Yes	E-commerce platform to search on (amazon, ebay, shopee)

Example input:

{
    "searchTerm": "wireless earbuds",
    "maxProducts": 20,
    "platform": "amazon"
}

📤 Output

The actor stores results in the default dataset. Each item contains:

• 📝 name: Product name
• 💰 price: Current price
• 📄 description: Product description
• 🖼️ images: List of product image URLs
• ⭐ rating: Average rating (out of 5)
• 💬 numReviews: Number of reviews
• 📊 numSales: Number of sales (if available)
• 🏪 seller: Seller name/store
• 🔗 url: Product URL
• 🏢 platform: E-commerce platform name
• ℹ️ additionalDetails: Additional product details
• ⏰ collectedAt: Data collection timestamp

Example output:

{
    "name": "Sony WF-1000XM4 Wireless Earbuds",
    "price": 248.00,
    "description": "Industry Leading Noise Canceling Bluetooth Earbuds...",
    "images": [
        "https://m.media-amazon.com/images/I/abc123.jpg",
        "https://m.media-amazon.com/images/I/def456.jpg"
    ],
    "rating": 4.5,
    "numReviews": 1250,
    "numSales": 5000,
    "seller": "Sony Store",
    "url": "https://www.amazon.com/product/abc123",
    "platform": "amazon",
    "additionalDetails": {
        "color": "Black",
        "brand": "Sony",
        "warranty": "1 year"
    },
    "collectedAt": "2023-12-24T12:00:00"
}

🚀 Usage

1. 📌 Create a new task for the E-commerce Product Crawler actor
2. ⌨️ Input your search term, platform choice, and maximum number of products
3. ▶️ Run the actor and wait for results
4. 📊 Access the collected data in the actor's dataset

⚠️ Limitations

• 🕒 Rate limiting: The actor includes delays between requests
• 📈 Maximum results: Limited to 100 products per run
• 🔍 Search scope: Limited to available products
• 🌐 Platform support: Currently supports Amazon, eBay, and Shopee
• 🤖 AI accuracy: Results depend on Gemini API's accuracy

📦 Dependencies

• 🐍 Python 3.9+
• 📚 Required packages:
  • apify>=1.1.0
  • requests>=2.31.0
  • python-dotenv>=1.0.0
  • aiohttp>=3.8.0
  • google-generativeai>=0.3.0
  • beautifulsoup4>=4.12.0
  • lxml>=4.9.0

📄 License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

---

Made with Hung Dinh ❤️