Flipkart Product Scraper (Apify Actor)

A high-performance, production-ready Apify Actor for scraping product data from Flipkart. Built using the official Camoufox + Playwright + TypeScript (Crawlee) template.

Camoufox is an anti-detect C++ fork of Firefox engineered to look identical to real human browsers at the engine level, seamlessly bypassing Akamai Bot Manager and Cloudflare anti-scraping defenses without triggering captchas or blocks.

---

Features

• 🔍 Flexible Inputs: Search by keywords (e.g., ["smart watch", "iphone 15", "running shoes"]) or pass direct category, search, or product detail URLs.
• ⚡ Dual Scraping Modes:
  • Deep Detail Mode (scrapeProductDetails: true): Navigates into each product page to extract complete technical specifications, full high-res image galleries, seller info, ratings breakdown, and bullet-point highlights.
  • Fast Listing Mode (scrapeProductDetails: false): Extracts items directly from search and category listing cards for ultra-fast scraping with minimal compute unit consumption.
• 🖼️ High-Resolution Images: Automatically detects and upgrades Flipkart thumbnail CDN URLs (/image/128/128/) to full high-resolution image URLs (/image/1664/1664/).
• 🏷️ Comprehensive Pricing: Extracts current discounted price, original MRP, discount percentage, and currency (INR).
• 📊 Structured Technical Specifications: Converts Flipkart's complex specification tables into organized nested categories (General, Display, Platform, Memory, Camera, Battery, Warranty, etc.).
• ⭐ Ratings & Reviews: Captures overall rating score, total ratings count, and total reviews count.
• 🏪 Seller Insights: Extracts seller name and seller performance rating score.
• 🔗 Clean Canonical URLs: Removes dynamic tracking and session tokens while preserving canonical product IDs (pid).
• 📄 Automatic Pagination: Seamlessly navigates search result pages up to user-defined limits.

---

Input Parameters

Parameter	Type	Default	Description
searchTerms	Array<string>	["wireless earbuds"]	Keywords to search on Flipkart.
startUrls	Array<object>	[]	Direct Flipkart URLs (Search, Category, or Product Detail pages).
maxItems	Integer	20	Maximum number of products to scrape into the dataset.
maxPagesPerQuery	Integer	2	Maximum pagination depth per search term.
scrapeProductDetails	Boolean	true	Extract full specs, high-res images & seller info (true) or fast summary from cards (false).
proxyConfiguration	Object	Apify Proxy	Proxy configuration. Residential proxy is recommended for high-volume runs.

Example Input

{
  "searchTerms": [
    "gaming laptop",
    "noise cancelling headphones"
  ],
  "maxItems": 50,
  "maxPagesPerQuery": 3,
  "scrapeProductDetails": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

Output Dataset Schema

Each product record pushed to the Apify dataset contains:

{
  "id": "MOBGTAGPTB3VS24W",
  "title": "Apple iPhone 15 (Black, 128 GB)",
  "brand": "Apple",
  "currentPrice": 65999,
  "originalPrice": 79900,
  "discountPercent": "17% off",
  "currency": "INR",
  "rating": 4.6,
  "ratingCount": 18234,
  "reviewCount": 1420,
  "inStock": true,
  "url": "https://www.flipkart.com/apple-iphone-15-black-128-gb/p/itm6ac6485515ae4?pid=MOBGTAGPTB3VS24W",
  "mainImage": "https://rukminim2.flixcart.com/image/1664/1664/xif0q/mobile/k/l/l/-original-imagtc5fz9spysyk.jpeg",
  "images": [
    "https://rukminim2.flixcart.com/image/1664/1664/xif0q/mobile/k/l/l/-original-imagtc5fz9spysyk.jpeg",
    "https://rukminim2.flixcart.com/image/1664/1664/xif0q/mobile/y/p/5/-original-imagtc5fzh362k3h.jpeg",
    "https://rukminim2.flixcart.com/image/1664/1664/xif0q/mobile/8/e/b/-original-imagtc5fcz3ghhfh.jpeg"
  ],
  "highlights": [
    "128 GB ROM",
    "15.49 cm (6.1 inch) Super Retina XDR Display",
    "48MP + 12MP | 12MP Front Camera",
    "A16 Bionic Chip, 6 Core Processor"
  ],
  "description": "Dynamic Island bubbles up alerts and Live Activities — so you don’t miss them while you’re doing something else...",
  "specifications": {
    "General": {
      "In The Box": "Handset, USB-C Charge Cable, Documentation",
      "Model Number": "MTP03HN/A",
      "Model Name": "iPhone 15",
      "Color": "Black",
      "SIM Type": "Dual Sim(Nano + eSIM)"
    },
    "Display Features": {
      "Display Size": "15.49 cm (6.1 inch)",
      "Resolution": "2556 x 1179 Pixels",
      "Resolution Type": "Super Retina XDR Display"
    },
    "Os & Processor Features": {
      "Operating System": "iOS 17",
      "Processor Type": "A16 Bionic Chip, 6 Core Processor"
    }
  },
  "seller": {
    "name": "SuperComNet",
    "rating": 4.5
  },
  "breadcrumbs": [
    "Mobiles & Accessories",
    "Mobiles",
    "Apple Mobiles"
  ],
  "searchQuery": "gaming laptop",
  "scrapedAt": "2026-09-11T14:55:00.000Z"
}

---

Local Development & Testing

1. Install dependencies:

   $npm install
   

2. Run in development mode:

   $npm run start:dev
   

3. Build TypeScript:

   $npm run build
   

4. Run production build:

   $npm run start:prod
   

---

Deploy to Apify

To deploy this Actor to your Apify account:

apify login
apify push

The Actor will be built in the Apify Cloud using the provided Dockerfile with pre-configured Camoufox stealth browser and ready for scheduled runs, API triggers, and integrations.