# Bigbasket Product Search Scraper (`soft_alexist/bigbasket-product-search-scraper`) Actor

Scrape product listings from BigBasket's vast grocery catalog with precision. This scraper captures prices, availability, ratings, inventory, and 50+ product attributes per item — essential for price monitoring, market analysis, and competitive intelligence.

- **URL**: https://apify.com/soft\_alexist/bigbasket-product-search-scraper.md
- **Developed by:** [Soft Alexist](https://apify.com/soft_alexist) (community)
- **Categories:** Automation, Developer tools, E-commerce
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## BigBasket Product Search Scraper: Extract Grocery Data at Scale

***

### What Is BigBasket?

BigBasket is India's largest online grocery and FMCG marketplace, offering millions of products across hundreds of categories. From fresh produce to packaged goods, BigBasket's product search pages contain valuable data: pricing, availability, ratings, brand information, and SKU details. Manually collecting this data is impractical — the **BigBasket Product Search Scraper** automates extraction, transforming search results into structured datasets.

***

### Overview

The **BigBasket Product Search Scraper** extracts comprehensive product information from BigBasket's category and search pages, including pricing tiers, pack options, inventory status, and customer ratings. It is ideal for:

- **Price comparison sites** monitoring grocery price fluctuations
- **Market researchers** analyzing FMCG availability and trends
- **Retail analysts** benchmarking competitor offerings
- **Data aggregators** building grocery product databases

Key features include configurable item limits, failure tolerance with `ignore_url_failures`, and detailed product attribute extraction across 50+ fields per item.

***

### Input Format

The scraper accepts a JSON configuration object:

```json
{
  "urls": [
    "https://www.bigbasket.com/pc/beverages/tea/?page=4"
  ],
  "max_items_per_url": 200,
  "ignore_url_failures": true
}
```

| Field | Description |
|---|---|
| `urls` | Array of BigBasket category or search result page URLs |
| `max_items_per_url` | Maximum products extracted per URL (e.g., `200` for 200 items per page) |
| `ignore_url_failures` | If `true`, scraper continues if a URL fails instead of stopping the entire run |

> **Tip:** Use pagination URLs (e.g., `?page=1`, `?page=2`) to scrape multiple pages within a single input, or add multiple URLs to extract different categories simultaneously.

***

### Output Format

**Sample output**

```json
{
  "id": "40317383",
  "desc": "Clear & Light Green Tea",
  "sku_max_quantity": 0,
  "pack_desc": "(50 Bags x 1.3 g Each)",
  "hide_default_pack_size_widget": false,
  "sort_index_pos": 0,
  "cart_count": 0,
  "is_best_value": false,
  "magnitude": "65",
  "sku_deck_type": "discounts_deck",
  "show_only_tag": false,
  "subscription_nudge_flag": false,
  "number_of_skus_sold": null,
  "w": "65 g",
  "absolute_url": "/pd/40317383/lipton-green-tea-clear-light-13-g/",
  "unit": "g",
  "usp": "",
  "requested_sku_id": "40317383",
  "availability": {
    "avail_status": "001",
    "short_eta": "10 mins",
    "display_mrp": true,
    "display_sp": true,
    "not_for_sale": false,
    "button": "Add",
    "show_express": false
  },
  "pricing": {
    "offer_communication": {},
    "available_offer_type": "offer",
    "offer_badge_text": "",
    "emi_offers": {},
    "bank_offers": {},
    "discount": {
      "deal_type": null,
      "deal_score": null,
      "mrp": "375",
      "mrp_per_pack": null,
      "d_text": "₹30 OFF",
      "d_avail": "true",
      "prim_price": {
        "sp": "345",
        "rsp": "345",
        "sp_per_pack": null,
        "icon": {
          "base_url": null,
          "image": null,
          "format": null
        },
        "desc": "",
        "base_price": "5.3",
        "base_unit": "g"
      },
      "sec_price": {
        "sp": null,
        "icon": null,
        "desc": null,
        "background": null
      },
      "subscription_price": "345",
      "camp_detail": {
        "c": [
          4152734
        ],
        "c_f": 0,
        "d_t": "percent",
        "d_v": 8,
        "dual_pricing": false,
        "m_f": 0,
        "narq": 9999999,
        "r_c": [
          4152734
        ],
        "v_f": 30
      },
      "offer_entry_text": "",
      "offer_available": "false"
    },
    "promo": null,
    "subscribe": {
      "desc": null,
      "desc_label": null,
      "subs_c": [],
      "subs_sp": null
    },
    "offer": {}
  },
  "variant_info": [],
  "sku_badge": null,
  "usps": [],
  "images": [
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-2_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-2_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-3_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-3_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-4_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-4_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-5_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-5_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-6_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-6_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-7_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-7_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-8_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-8_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-9_4-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-9_4-lipton-green-tea-clear-light.jpg"
    },
    {
      "s": "https://www.bbassets.com/media/uploads/p/s/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "m": "https://www.bbassets.com/media/uploads/p/m/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "l": "https://www.bbassets.com/media/uploads/p/l/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "xl": "https://www.bbassets.com/media/uploads/p/xl/40317383-10_3-lipton-green-tea-clear-light.jpg",
      "xxl": "https://www.bbassets.com/media/uploads/p/xxl/40317383-10_3-lipton-green-tea-clear-light.jpg"
    }
  ],
  "subscription_info": null,
  "variable_weight": null,
  "brand": {
    "name": "Lipton",
    "slug": "lipton",
    "url": "/pb/lipton/"
  },
  "theme": {},
  "category": {
    "tlc_name": "Beverages",
    "tlc_slug": "beverages",
    "mlc_name": "Tea",
    "mlc_slug": "tea",
    "mlc_id": 360,
    "llc_name": "Tea Bags",
    "llc_slug": "type=pc&slug=tea-bags",
    "llc_id": 361
  },
  "additional_attr": {
    "info": [
      {
        "type": "food_type",
        "label": "veg",
        "sub_type": "veg"
      }
    ]
  },
  "combo": null,
  "children": [],
  "rating_info": {
    "avg_rating": "4.6",
    "rating_count": 16,
    "review_count": 0,
    "sku_id": 40317383
  },
  "visibility": {
    "path_id": 10864,
    "fc_id": 1820,
    "sa_id": 19224,
    "supply_chain_ecs": null
  },
  "additional_info": {
    "per_unit_pd_page": true,
    "per_unit_listing_page": true
  },
  "video_links": [],
  "ctas": {
    "data": []
  },
  "ean_code": "40317383",
  "parent_info": {
    "id": 589858,
    "parent_product_id": null,
    "child_product_id": null,
    "order": 0,
    "parent_id": 40317383,
    "child_id": 40317383,
    "is_default": 1,
    "type": 1,
    "created_by_id": 340420,
    "updated_by_id": 340420,
    "created_on": "2025-06-02 12:23:31",
    "updated_on": "2025-06-02 12:23:31"
  },
  "high_affinity": [],
  "inv_info": {
    "skus": [
      {
        "id": 40317383,
        "qty": 1,
        "fc_id": 1820
      }
    ]
  },
  "quality_report": {
    "enabled": false
  },
  "prescription_only": false,
  "bxgy": null,
  "is_free_reward": false,
  "prescription_or_virtual_consult": false,
  "show_quality_bottom_sheet_image": false,
  "is_tobacco": false,
  "from_url": "https://www.bigbasket.com/pc/beverages/tea/?page=4"
}
```

Each product record contains 50+ fields capturing price, availability, inventory, ratings, and metadata:

#### Product Identification

| Field | Meaning |
|---|---|
| `ID` | Unique BigBasket product identifier |
| `SKU` | Stock Keeping Unit code for inventory tracking |
| `EAN Code` | European Article Number barcode |
| `Absolute URL` | Full product page link |
| `Brand` | Product brand or manufacturer name |
| `Category` | Product category path (e.g., Beverages > Tea) |

#### Description & Attributes

| Field | Meaning |
|---|---|
| `Description` | Full product title and description |
| `Pack Description` | Details about pack/bundle size |
| `Weight` | Product weight (e.g., 500g, 1L) |
| `Unit` | Measurement unit (kg, liters, units, etc.) |
| `Variable Weight` | Whether weight varies per unit |
| `USP` | Unique Selling Proposition or key product benefit |
| `USPs` | Array of multiple unique selling points |
| `Additional Attributes` | Extra product specifications (color, flavor, organic, etc.) |
| `Additional Info` | Miscellaneous product details |

#### Pricing & SKU Options

| Field | Meaning |
|---|---|
| `Pricing` | Current price, discounts, and deals |
| `SKU Max Quantity` | Maximum purchasable quantity per order |
| `SKU Deck Type` | Pack variety type (single, multi-pack, combo) |
| `Hide Default Pack Size Widget` | UI flag to hide pack size selector |
| `Requested SKU ID` | Specific SKU variant requested |
| `Number of SKUs Sold` | Count of available SKU variants |

#### Availability & Inventory

| Field | Meaning |
|---|---|
| `Availability` | Stock status (in stock, out of stock, limited) |
| `Inventory Info` | Detailed inventory and restock details |
| `Cart Count` | Number of units added to carts (social proof) |
| `Is Best Value` | Whether item is marked as best value/deal |

#### Ratings & Reviews

| Field | Meaning |
|---|---|
| `Rating Info` | Customer rating score and review count |
| `Quality Report` | Product quality metrics or certifications |
| `Show Quality Bottom Sheet Image` | UI flag for quality assurance display |

#### Variant & Bundle Data

| Field | Meaning |
|---|---|
| `Variant Info` | Available product variants (size, flavor, etc.) |
| `Children` | Bundled or related child products |
| `Combo` | Bundle/combo deal information |
| `Parent Info` | Parent product details if this is a variant |
| `BXGY` | Buy X Get Y offer details |

#### Visual & Media

| Field | Meaning |
|---|---|
| `Images` | Product image URLs and metadata |
| `Video Links` | Product demo or review video URLs |
| `Theme` | Visual theme category for the product |

#### Subscription & Offers

| Field | Meaning |
|---|---|
| `Subscription Info` | Details if product is available via BigBasket Subscription |
| `Subscription Nudge Flag` | Flag to suggest subscription option |
| `Is Free Reward` | Whether product can be earned via loyalty rewards |
| `BXGY` | Buy X Get Y promotion details |

#### Compliance & Restrictions

| Field | Meaning |
|---|---|
| `Prescription Only` | Whether product requires a prescription |
| `Prescription or Virtual Consult` | Consultation requirement flag |
| `Is Tobacco` | Regulatory flag for tobacco products |

#### Sorting & Display

| Field | Meaning |
|---|---|
| `Sort Index Position` | Product position in search results ranking |
| `SKU Badge` | Special badge (new, bestseller, etc.) |
| `Show Only Tag` | Visibility restriction tags |
| `High Affinity` | Algorithm-generated relevance flag |
| `Visibility` | Whether product is publicly visible |
| `CTAs` | Call-to-action buttons (Add to Cart, etc.) |
| `Magnitude` | Size/scale category indicator |

***

### How to Use

1. **Locate category URLs** — Navigate BigBasket's category pages (e.g., Beverages, Tea, Dairy) and copy the URL.
2. **Add pagination** — Append `?page=1`, `?page=2`, etc., or list multiple URLs to scrape multiple pages.
3. **Configure limits** — Set `max_items_per_url` (typically 50–500 depending on volume needed).
4. **Enable robustness** — Set `ignore_url_failures: true` to skip problematic pages.
5. **Run & export** — Execute the scraper and download results as JSON, CSV, or Excel.

**Best practices:**

- Start with lower `max_items_per_url` values to test URLs before large runs.
- Use category-specific URLs for cleaner, more relevant datasets.
- Schedule regular scrapes to track price changes and availability trends.

***

### Use Cases & Business Value

- **Price monitoring:** Track competitor pricing changes hourly or daily
- **Market intelligence:** Identify trending products and seasonal demand shifts
- **Inventory management:** Monitor stock levels and restock patterns
- **Affiliate & aggregation:** Feed real-time product data into your own platforms
- **Research:** Analyze FMCG brand distribution, pack variety, and pricing strategies

The **BigBasket Product Search Scraper** transforms unstructured web data into actionable business insights, enabling data-driven decisions in retail and e-commerce.

***

### Conclusion

The **BigBasket product search scraper** is your gateway to comprehensive grocery and FMCG market data. With 50+ product attributes and flexible configuration, it supports price monitoring, competitive analysis, and research workflows that would otherwise require manual effort. Start scraping today and unlock insights from India's largest online grocery marketplace.

# Actor input Schema

## `urls` (type: `array`):

Add the URLs of the product list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.

## `ignore_url_failures` (type: `boolean`):

If true, the scraper will continue running even if some URLs fail to be scraped.

## `max_items_per_url` (type: `integer`):

The maximum number of items to scrape per URL.

## Actor input object example

```json
{
  "urls": [
    "https://www.bigbasket.com/pc/beverages/tea/?page=4"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 500
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "https://www.bigbasket.com/pc/beverages/tea/?page=4"
    ],
    "ignore_url_failures": true,
    "max_items_per_url": 500
};

// Run the Actor and wait for it to finish
const run = await client.actor("soft_alexist/bigbasket-product-search-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "urls": ["https://www.bigbasket.com/pc/beverages/tea/?page=4"],
    "ignore_url_failures": True,
    "max_items_per_url": 500,
}

# Run the Actor and wait for it to finish
run = client.actor("soft_alexist/bigbasket-product-search-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "https://www.bigbasket.com/pc/beverages/tea/?page=4"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 500
}' |
apify call soft_alexist/bigbasket-product-search-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,soft_alexist/bigbasket-product-search-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/cOfiXB2uXOhnXlgAn/builds/4XnfXY6s5fP1MmhVg/openapi.json