Global Arbitrage Agent 🚀

An AI-Powered E-commerce Research Tool for the Apify $1M Challenge.

The Global Arbitrage Agent is a high-performance web automation tool designed to identify profitable price discrepancies between AliExpress and Amazon. Unlike traditional scrapers that rely solely on text matching, this agent leverages Gemini 1.5 Flash AI to perform intelligent product verification, ensuring that arbitrage opportunities are based on identical physical items.

---

✨ Key Features

• AI-Driven Product Matching: Uses Google Gemini 1.5 Flash to verify that a product found on AliExpress is the exact same model/spec as the one on Amazon, significantly reducing "false positives."
• Anti-Bot & Stealth Architecture: Implements advanced fingerprinting evasion, including navigator.webdriver masking and randomized human-like interaction patterns (scrolling, delays, and mouse movement).
• Residential Proxy Support: Fully integrated with Apify Residential Proxies to bypass aggressive anti-scraping walls on retail platforms.
• Automated ROI Calculation: Automatically parses complex currency strings into numeric data to calculate:
  • Net Profit: (Amazon Price - Ali Price)
  • ROI %: Return on Investment for each matched pair.
• Debug-Ready Logs: Automatically captures a high-resolution screenshot during every run, stored in the Key-Value Store, allowing you to see exactly what the bot saw.

---

🛠️ Technical Stack

• Core Logic: Python 3.11
• Automation: Playwright (Chromium)
• Intelligence: Google Gemini 1.5 Flash (via google-genai)
• Platform: Apify SDK & Apify Client
• Network: Apify Residential Proxies

---

🚀 How It Works

1. Input: The user provides a searchQuery (e.g., "Magsafe Power Bank") and their geminiApiKey.
2. Marketplace Search: The Actor launches a stealth browser to visit AliExpress and Amazon simultaneously.
3. Heuristic Scraping: It uses "Greedy Selectors" to find product titles, prices, and links even if the websites update their CSS classes.
4. AI Verification: The raw data from both sites is sent to Gemini 1.5 Flash. The AI acts as a "Human Validator," checking for identical specs, brands, and models.
5. Data Enrichment: The Actor calculates profit margins and ROI for all validated matches.
6. Storage: The final curated list is pushed to the Apify Dataset for easy export to CSV, JSON, or Excel.

---

⚙️ Setup & Configuration

To run this Actor successfully for the challenge, follow these steps:

1. Proxy Configuration (Crucial)

Amazon and AliExpress block standard server IPs.

• Go to the Proxy tab in the Apify Console.
• Ensure Residential Proxies are enabled.
• In the Actor's Run Configuration, select "Automatic" or "Residential" proxy groups.

2. Actor Permissions

• Go to Settings > Actor Permissions.
• Set permissions to Full Access. This is required for the Actor to access your Proxy environment variables.

3. Gemini API Key

• Obtain a free or paid API Key from Google AI Studio.
• Pass this as geminiApiKey in the Actor Input.

---

📊 Example Output

Product Name	Ali Price	Amazon Price	Profit	ROI %
65W GaN USB-C Charger	$12.45	$34.99	$22.54	181.04%
Portable Magsafe Battery	$18.20	$45.00	$26.80	147.25%

---