Redbrain Product Search Scraper: Extract Product Data from Search Results

---

What Is Redbrain.shop?

Redbrain.shop is an e-commerce search and aggregation platform that indexes products from multiple merchants and retailers. It provides curated search results for consumers looking to compare prices, availability, and merchant options across a wide product catalog. For businesses, scraping Redbrain product data unlocks market insights — tracking competitor pricing, monitoring product availability, analyzing merchant performance, and building product intelligence databases. The Redbrain Product Search Scraper automates this process, transforming search result pages into clean, structured datasets.

---

Overview

The Redbrain Product Search Scraper extracts comprehensive product details from Redbrain.shop search result pages. It captures product metadata, pricing, merchant information, and availability in a single structured output. Ideal users include:

• Price monitoring services tracking competitive pricing across retailers
• E-commerce aggregators building product databases and comparison tools
• Market researchers analyzing product trends, merchant performance, and pricing strategies
• Developers integrating Redbrain data into affiliate platforms or price alerts
• Retailers benchmarking against competitor listings on the platform

The scraper handles multiple search queries, respects pagination, and offers configurable limits for flexible data collection at any scale.

---

Input Configuration

The scraper accepts a JSON configuration object with three key parameters:

{
  "urls": [
    "https://www.redbrain.shop/search?q=nike%20shoes&locales=en_GB"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Parameter Definitions

Parameter	Type	Description
urls	Array	Search result page URLs from Redbrain.shop. Format: https://www.redbrain.shop/search?q=[QUERY]&locales=[LOCALE]. You can add multiple search URLs in a single run.
ignore_url_failures	Boolean	If true, the scraper continues running even if some URLs fail. If false, the entire run stops on first failure. Default: true.
max_items_per_url	Integer	Maximum number of products to extract per URL (1–200). Set to 20 for light runs, 100+ for bulk collection. Default: 20.

Example Usage

{
  "urls": [
    "https://www.redbrain.shop/search?q=nike%20shoes&locales=en_GB",
    "https://www.redbrain.shop/search?q=adidas%20running&locales=en_GB",
    "https://www.redbrain.shop/search?q=puma%20sports&locales=en_US"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 150
}

Tip: Use URL encoding for special characters in search queries (e.g., spaces as %20). Customize the locales parameter for region-specific results.

---

Output Format

Example Output Record

{
  "typename": "Offer",
  "title": "Rat & Boa Green Cobra Skirt Lime Medium Women's 100% Fsc Viscose",
  "gtin": "05060915356949",
  "catalogue_id": "05060915356949",
  "traffic_channel_id": "2dab090926fe4c179f2d25ef3dcdad9d",
  "external_id": "d72b76c61393c99c121682fb70f0485e0c0433a0",
  "condition": null,
  "availability": "IN_STOCK",
  "merchant": {
    "__typename": "Merchant",
    "name": "Rat & Boa",
    "logo": null
  },
  "affiliate": {
    "__typename": "Affiliate",
    "name": "RAKUTEN"
  },
  "pricing": {
    "__typename": "Pricing",
    "price": {
      "__typename": "Money",
      "value": 140,
      "currency": "GBP"
    },
    "onsale_percentage": null
  },
  "images": [
    {
      "__typename": "Image",
      "u_r_l": "https://cdn.shopify.com/s/files/1/0942/9062/products/cobra-skirt-lime-4_dec1c675-d04e-4c77-a88d-81b420f71f26.jpg?v=1693302818"
    }
  ],
  "shipping": {
    "__typename": "Shipping",
    "price": null,
    "label": "DEFAULT_CARRIER",
    "min_days": 1,
    "max_days": 3
  },
  "links": {
    "__typename": "Links",
    "tracking": "https://click.linksynergy.com/link?id=pfxNKSnglIM&offerid=1863225.529446058676572154175410&type=15&murl=https%3A%2F%2Fwww.ratandboa.com%2Fproducts%2Fcobra-skirt-lime%3Fvariant%3D40718594801769"
  },
  "discount": null,
  "tag": {
    "__typename": "Tag",
    "sale_discount": null,
    "watching": null,
    "trending": null,
    "new_in": null,
    "is_demo": null
  },
  "has_price_history": true,
  "from_url": "https://www.redbrain.shop/c/1604/clothing-and-accessories/clothing?locales=en_GB&categoryIds=1604"
}

Each product extracted returns a detailed record with 17+ fields:

Product Identification

Field	Description
Typename	Product category or type (e.g., "Shoe", "Apparel", "Accessory")
Title	Full product name as displayed on Redbrain
GTIN	Global Trade Item Number (barcode/UPC code) for product identification
Catalogue ID	Redbrain's internal product catalogue identifier
External ID	Merchant-specific product ID or SKU

Merchant & Marketplace Info

Field	Description
Condition	Product condition (e.g., New, Used, Refurbished)
Availability	Stock status (e.g., In Stock, Out of Stock, Pre-order)
Merchant	Seller or retailer name offering the product
Affiliate	Whether the listing is affiliate-enabled for commission tracking

Pricing & Offers

Field	Description
Pricing	Current price, currency, and price-per-unit metrics
Discount	Active discount amount or percentage off original price
Has Price History	Boolean indicating whether historical pricing data is available for trend analysis

Product Media & Details

Field	Description
Images	Array of product image URLs (thumbnail, full-size, alternative angles)
Links	Product page URL, merchant store link, and related product links
Shipping	Shipping cost, estimated delivery time, and carrier information
Tag	Product tags, categories, and keyword labels for filtering

---

How to Use

1. Prepare search URLs — Navigate to Redbrain.shop, perform a search (e.g., "nike shoes"), and copy the full search result URL including the q and locales parameters.

2. Build your configuration — Create a JSON object with:

   • One or more search URLs in the urls array
   • ignore_url_failures set to true for uninterrupted runs
   • max_items_per_url set to desired limit (e.g., 100 for standard, 200 for bulk)

3. Start the scraper — Paste the configuration and run the actor. Monitor the execution log for progress.

4. Export results — Download output as JSON, CSV, or Excel. Results are ready to integrate into databases, spreadsheets, or analytics tools.

Best practices:

• Start with small max_items_per_url (20–50) to test URL validity
• Use locale filters to scope results by region and language
• For large-scale runs, batch URLs into multiple runs to avoid timeouts
• Export to CSV for quick analysis in Excel; use JSON for integration into applications

Common issues:

• URLs must be direct search result pages (not category pages)
• Verify URL encoding if special characters appear broken in results
• Set ignore_url_failures: true when running bulk operations

---

Use Cases & Business Value

• Price monitoring: Track competitor pricing in real-time and set up price alert systems
• Market intelligence: Analyze product availability, merchant presence, and discount trends
• SEO & content: Build product comparison content with Redbrain listings as data source
• Affiliate marketing: Identify top-performing products and merchants for promotion
• Inventory planning: Monitor stock availability across multiple merchants to optimize purchasing

The scraper delivers actionable product data that would take hours to collect manually, enabling data-driven decisions in hours.

---

Conclusion

The Redbrain Product Search Scraper is a powerful tool for anyone needing structured product data from Redbrain.shop at scale. With 17+ fields covering pricing, availability, merchant info, and product media, it transforms search results into intelligence. Whether you're monitoring prices, building aggregator platforms, or conducting market research, this scraper delivers the data you need — fast and reliably.