BigBasket Product Search Scraper: Extract Grocery Data at Scale

---

What Is BigBasket?

BigBasket is India's largest online grocery and FMCG marketplace, offering millions of products across hundreds of categories. From fresh produce to packaged goods, BigBasket's product search pages contain valuable data: pricing, availability, ratings, brand information, and SKU details. Manually collecting this data is impractical — the BigBasket Product Search Scraper automates extraction, transforming search results into structured datasets.

---

Overview

The BigBasket Product Search Scraper extracts comprehensive product information from BigBasket's category and search pages, including pricing tiers, pack options, inventory status, and customer ratings. It is ideal for:

• Price comparison sites monitoring grocery price fluctuations
• Market researchers analyzing FMCG availability and trends
• Retail analysts benchmarking competitor offerings
• Data aggregators building grocery product databases

Key features include configurable item limits, failure tolerance with ignore_url_failures, and detailed product attribute extraction across 50+ fields per item.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://www.bigbasket.com/pc/beverages/tea/?page=4"
  ],
  "max_items_per_url": 200,
  "ignore_url_failures": true
}

Field	Description
urls	Array of BigBasket category or search result page URLs
max_items_per_url	Maximum products extracted per URL (e.g., 200 for 200 items per page)
ignore_url_failures	If true, scraper continues if a URL fails instead of stopping the entire run

Tip: Use pagination URLs (e.g., ?page=1, ?page=2) to scrape multiple pages within a single input, or add multiple URLs to extract different categories simultaneously.

---

Output Format

Sample output

{
  "id": "40317383",
  "desc": "Clear & Light Green Tea",
  "sku_max_quantity": 0,
  "pack_desc": "(50 Bags x 1.3 g Each)",
  "hide_default_pack_size_widget": false,
  "sort_index_pos": 0,
  "cart_count": 0,
  "is_best_value": false,
  "magnitude": "65",
  "sku_deck_type": "discounts_deck",
  "show_only_tag": false,
  "subscription_nudge_flag": false,
  "number_of_skus_sold": null,
  "w": "65 g",
  "absolute_url": "/pd/40317383/lipton-green-tea-clear-light-13-g/",
  "unit": "g",
  "usp": "",
  "requested_sku_id": "40317383",
  "availability": {
    "avail_status": "001",
    "short_eta": "10 mins",
    "display_mrp": true,
    "display_sp": true,
    "not_for_sale": false,
    "button": "Add",
    "show_express": false
  },
  "pricing": {
    "offer_communication": {},
    "available_offer_type": "offer",
    "offer_badge_text": "",
    "emi_offers": {},
    "bank_offers": {},
    "discount": {
      "deal_type": null,
      "deal_score": null,
      "mrp": "375",
      "mrp_per_pack": null,
      "d_text": "₹30 OFF",
      "d_avail": "true",
      "prim_price": {
        "sp": "345",
        "rsp": "345",
        "sp_per_pack": null,
        "icon": {
          "base_url": null,
          "image": null,
          "format": null
        },
        "desc": "",
        "base_price": "5.3",
        "base_unit": "g"
      },
      "sec_price": {
        "sp": null,
        "icon": null,
        "desc": null,
        "background": null
      },
      "subscription_price": "345",
      "camp_detail": {
        "c": [
          4152734
        ],
        "c_f": 0,
        "d_t": "percent",
        "d_v": 8,
        "dual_pricing": false,
        "m_f": 0,
        "narq": 9999999,
        "r_c": [
          4152734
        ],
        "v_f": 30
      },
      "offer_entry_text": "",
      "offer_available": "false"
    },
    "promo": null,
    "subscribe": {
      "desc": null,
      "desc_label": null,
      "subs_c": [],
      "subs_sp": null
    },
    "offer": {}
  },
  "variant_info": [],
  "sku_badge": null,
  "usps": [],
  "images": [
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-2_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-3_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-4_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-5_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-6_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-7_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-8_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-9_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-10_3-lipton-green-tea-clear-light.jpg"
    }
  ],
  "subscription_info": null,
  "variable_weight": null,
  "brand": {
    "name": "Lipton",
    "slug": "lipton",
    "url": "/pb/lipton/"
  },
  "theme": {},
  "category": {
    "tlc_name": "Beverages",
    "tlc_slug": "beverages",
    "mlc_name": "Tea",
    "mlc_slug": "tea",
    "mlc_id": 360,
    "llc_name": "Tea Bags",
    "llc_slug": "type=pc&slug=tea-bags",
    "llc_id": 361
  },
  "additional_attr": {
    "info": [
      {
        "type": "food_type",
        "label": "veg",
        "sub_type": "veg"
      }
    ]
  },
  "combo": null,
  "children": [],
  "rating_info": {
    "avg_rating": "4.6",
    "rating_count": 16,
    "review_count": 0,
    "sku_id": 40317383
  },
  "visibility": {
    "path_id": 10864,
    "fc_id": 1820,
    "sa_id": 19224,
    "supply_chain_ecs": null
  },
  "additional_info": {
    "per_unit_pd_page": true,
    "per_unit_listing_page": true
  },
  "video_links": [],
  "ctas": {
    "data": []
  },
  "ean_code": "40317383",
  "parent_info": {
    "id": 589858,
    "parent_product_id": null,
    "child_product_id": null,
    "order": 0,
    "parent_id": 40317383,
    "child_id": 40317383,
    "is_default": 1,
    "type": 1,
    "created_by_id": 340420,
    "updated_by_id": 340420,
    "created_on": "2025-06-02 12:23:31",
    "updated_on": "2025-06-02 12:23:31"
  },
  "high_affinity": [],
  "inv_info": {
    "skus": [
      {
        "id": 40317383,
        "qty": 1,
        "fc_id": 1820
      }
    ]
  },
  "quality_report": {
    "enabled": false
  },
  "prescription_only": false,
  "bxgy": null,
  "is_free_reward": false,
  "prescription_or_virtual_consult": false,
  "show_quality_bottom_sheet_image": false,
  "is_tobacco": false,
  "from_url": "https://www.bigbasket.com/pc/beverages/tea/?page=4"
}

Each product record contains 50+ fields capturing price, availability, inventory, ratings, and metadata:

Product Identification

Field	Meaning
ID	Unique BigBasket product identifier
SKU	Stock Keeping Unit code for inventory tracking
EAN Code	European Article Number barcode
Absolute URL	Full product page link
Brand	Product brand or manufacturer name
Category	Product category path (e.g., Beverages > Tea)

Description & Attributes

Field	Meaning
Description	Full product title and description
Pack Description	Details about pack/bundle size
Weight	Product weight (e.g., 500g, 1L)
Unit	Measurement unit (kg, liters, units, etc.)
Variable Weight	Whether weight varies per unit
USP	Unique Selling Proposition or key product benefit
USPs	Array of multiple unique selling points
Additional Attributes	Extra product specifications (color, flavor, organic, etc.)
Additional Info	Miscellaneous product details

Pricing & SKU Options

Field	Meaning
Pricing	Current price, discounts, and deals
SKU Max Quantity	Maximum purchasable quantity per order
SKU Deck Type	Pack variety type (single, multi-pack, combo)
Hide Default Pack Size Widget	UI flag to hide pack size selector
Requested SKU ID	Specific SKU variant requested
Number of SKUs Sold	Count of available SKU variants

Availability & Inventory

Field	Meaning
Availability	Stock status (in stock, out of stock, limited)
Inventory Info	Detailed inventory and restock details
Cart Count	Number of units added to carts (social proof)
Is Best Value	Whether item is marked as best value/deal

Ratings & Reviews

Field	Meaning
Rating Info	Customer rating score and review count
Quality Report	Product quality metrics or certifications
Show Quality Bottom Sheet Image	UI flag for quality assurance display

Variant & Bundle Data

Field	Meaning
Variant Info	Available product variants (size, flavor, etc.)
Children	Bundled or related child products
Combo	Bundle/combo deal information
Parent Info	Parent product details if this is a variant
BXGY	Buy X Get Y offer details

Visual & Media

Field	Meaning
Images	Product image URLs and metadata
Video Links	Product demo or review video URLs
Theme	Visual theme category for the product

Subscription & Offers

Field	Meaning
Subscription Info	Details if product is available via BigBasket Subscription
Subscription Nudge Flag	Flag to suggest subscription option
Is Free Reward	Whether product can be earned via loyalty rewards
BXGY	Buy X Get Y promotion details

Compliance & Restrictions

Field	Meaning
Prescription Only	Whether product requires a prescription
Prescription or Virtual Consult	Consultation requirement flag
Is Tobacco	Regulatory flag for tobacco products

Sorting & Display

Field	Meaning
Sort Index Position	Product position in search results ranking
SKU Badge	Special badge (new, bestseller, etc.)
Show Only Tag	Visibility restriction tags
High Affinity	Algorithm-generated relevance flag
Visibility	Whether product is publicly visible
CTAs	Call-to-action buttons (Add to Cart, etc.)
Magnitude	Size/scale category indicator

---

How to Use

1. Locate category URLs — Navigate BigBasket's category pages (e.g., Beverages, Tea, Dairy) and copy the URL.
2. Add pagination — Append ?page=1, ?page=2, etc., or list multiple URLs to scrape multiple pages.
3. Configure limits — Set max_items_per_url (typically 50–500 depending on volume needed).
4. Enable robustness — Set ignore_url_failures: true to skip problematic pages.
5. Run & export — Execute the scraper and download results as JSON, CSV, or Excel.

Best practices:

• Start with lower max_items_per_url values to test URLs before large runs.
• Use category-specific URLs for cleaner, more relevant datasets.
• Schedule regular scrapes to track price changes and availability trends.

---

Use Cases & Business Value

• Price monitoring: Track competitor pricing changes hourly or daily
• Market intelligence: Identify trending products and seasonal demand shifts
• Inventory management: Monitor stock levels and restock patterns
• Affiliate & aggregation: Feed real-time product data into your own platforms
• Research: Analyze FMCG brand distribution, pack variety, and pricing strategies

The BigBasket Product Search Scraper transforms unstructured web data into actionable business insights, enabling data-driven decisions in retail and e-commerce.

---

Conclusion

The BigBasket product search scraper is your gateway to comprehensive grocery and FMCG market data. With 50+ product attributes and flexible configuration, it supports price monitoring, competitive analysis, and research workflows that would otherwise require manual effort. Start scraping today and unlock insights from India's largest online grocery marketplace.