Redbrain Product Search Scraper: Extract Product Data from Search Results

---

What Is Redbrain.shop?

Redbrain.shop is an e-commerce search and aggregation platform that indexes products from multiple merchants and retailers. It provides curated search results for consumers looking to compare prices, availability, and merchant options across a wide product catalog. For businesses, scraping Redbrain product data unlocks market insights — tracking competitor pricing, monitoring product availability, analyzing merchant performance, and building product intelligence databases. The Redbrain Product Search Scraper automates this process, transforming search result pages into clean, structured datasets.

---

Overview

The Redbrain Product Search Scraper extracts comprehensive product details from Redbrain.shop search result pages. It captures product metadata, pricing, merchant information, and availability in a single structured output. Ideal users include:

• Price monitoring services tracking competitive pricing across retailers
• E-commerce aggregators building product databases and comparison tools
• Market researchers analyzing product trends, merchant performance, and pricing strategies
• Developers integrating Redbrain data into affiliate platforms or price alerts
• Retailers benchmarking against competitor listings on the platform

The scraper handles multiple search queries, respects pagination, and offers configurable limits for flexible data collection at any scale.

---

Input Configuration

The Actor supports two scraping modes — use only one at a time:

1. Scrape by URLs — scrape data directly from a list of Redbrain.shop search result URLs.

Example Usage

{
  "urls": [
    "https://www.redbrain.shop/search?q=nike%20shoes&locales=en_GB",
    "https://www.redbrain.shop/search?q=adidas%20running&locales=en_GB",
    "https://www.redbrain.shop/search?q=puma%20sports&locales=en_US"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 150
}

2. Scrape by search filters — scrape data using a keyword and additional filters (category, price range, discount, condition, etc.) instead of providing URLs.

{
  "keyword": "running shoes",
  "category": "469",
  "price_min": 20,
  "price_max": 100,
  "discount": "TWENTY_FIVE_PERCENT",
  "condition": "NEW",
  "max_items_per_url": 100
}

There is also a General settings group that applies to both modes.

1. Scrape by URLs

Use this mode when you already have specific search result URLs. When this mode is used, all options in the "Scrape by search filters" section will be disabled.

Field	Type	Default	Description
urls	array	(required)	Search result page URLs from Redbrain.shop, e.g. https://www.redbrain.shop/search?q=[QUERY]&locales=[LOCALE]. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. Add multiple URLs to scrape multiple queries in a single run.
ignore_url_failures	boolean	true	If true, the scraper continues running even if some URLs fail. If false, the entire run stops on the first failure.

2. Scrape by search filters

Use this mode when you want to search using a keyword and additional filter attributes instead of scraping by URLs. If you use this mode, leave the urls field above empty.

Field	Type	Default	Description
keyword	string	—	The keyword to search for.
sort_by	string ("", BY_PRICE, BY_PRICE_DROP)	—	Sort results by Relevance (empty), Price (BY_PRICE), or Price drop (BY_PRICE_DROP).
category	string	—	The product category to filter by, selected from a predefined list of category IDs (e.g. Shoes, Electronics, Clothing, Health & Beauty, Toys & Games, and many more subcategories). Leave empty for Any. See the dropdown in the Actor input UI for the full list of available categories.
price_min	integer	—	The minimum price to filter results by.
price_max	integer	—	The maximum price to filter results by.
discount	string ("", FIVE_PERCENT, TEN_PERCENT, TWENTY_FIVE_PERCENT, FIFTY_PERCENT)	—	Filter by minimum discount: Any, 5% or more, 10% or more, 25% or more, 50% or more.
condition	string ("", NEW, USED, REFURBISHED)	—	Filter by item condition: Any, New, Used, Refurbished.

3. General settings

Applies to both scraping modes above.

Field	Type	Default	Description
max_items_per_url	integer	20	The maximum number of products to extract per URL/search. Set to 20 for light runs, 100+ for bulk collection.

Tip: Use URL encoding for special characters in search queries (e.g., spaces as %20). Customize the locales parameter for region-specific results.

---

Output Format

Example Output Record

{
  "typename": "Offer",
  "title": "Rat & Boa Green Cobra Skirt Lime Medium Women's 100% Fsc Viscose",
  "gtin": "05060915356949",
  "catalogue_id": "05060915356949",
  "traffic_channel_id": "2dab090926fe4c179f2d25ef3dcdad9d",
  "external_id": "d72b76c61393c99c121682fb70f0485e0c0433a0",
  "condition": null,
  "availability": "IN_STOCK",
  "merchant": {
    "__typename": "Merchant",
    "name": "Rat & Boa",
    "logo": null
  },
  "affiliate": {
    "__typename": "Affiliate",
    "name": "RAKUTEN"
  },
  "pricing": {
    "__typename": "Pricing",
    "price": {
      "__typename": "Money",
      "value": 140,
      "currency": "GBP"
    },
    "onsale_percentage": null
  },
  "images": [
    {
      "__typename": "Image",
      "u_r_l": "https://cdn.shopify.com/s/files/1/0942/9062/products/cobra-skirt-lime-4_dec1c675-d04e-4c77-a88d-81b420f71f26.jpg?v=1693302818"
    }
  ],
  "shipping": {
    "__typename": "Shipping",
    "price": null,
    "label": "DEFAULT_CARRIER",
    "min_days": 1,
    "max_days": 3
  },
  "links": {
    "__typename": "Links",
    "tracking": "https://click.linksynergy.com/link?id=pfxNKSnglIM&offerid=1863225.529446058676572154175410&type=15&murl=https%3A%2F%2Fwww.ratandboa.com%2Fproducts%2Fcobra-skirt-lime%3Fvariant%3D40718594801769"
  },
  "discount": null,
  "tag": {
    "__typename": "Tag",
    "sale_discount": null,
    "watching": null,
    "trending": null,
    "new_in": null,
    "is_demo": null
  },
  "has_price_history": true,
  "from_url": "https://www.redbrain.shop/c/1604/clothing-and-accessories/clothing?locales=en_GB&categoryIds=1604"
}

Each product extracted returns a detailed record with 17+ fields:

Product Identification

Field	Description
Typename	Product category or type (e.g., "Shoe", "Apparel", "Accessory")
Title	Full product name as displayed on Redbrain
GTIN	Global Trade Item Number (barcode/UPC code) for product identification
Catalogue ID	Redbrain's internal product catalogue identifier
External ID	Merchant-specific product ID or SKU

Merchant & Marketplace Info

Field	Description
Condition	Product condition (e.g., New, Used, Refurbished)
Availability	Stock status (e.g., In Stock, Out of Stock, Pre-order)
Merchant	Seller or retailer name offering the product
Affiliate	Whether the listing is affiliate-enabled for commission tracking

Pricing & Offers

Field	Description
Pricing	Current price, currency, and price-per-unit metrics
Discount	Active discount amount or percentage off original price
Has Price History	Boolean indicating whether historical pricing data is available for trend analysis

Product Media & Details

Field	Description
Images	Array of product image URLs (thumbnail, full-size, alternative angles)
Links	Product page URL, merchant store link, and related product links
Shipping	Shipping cost, estimated delivery time, and carrier information
Tag	Product tags, categories, and keyword labels for filtering

---

How to Use

1. Prepare search URLs — Navigate to Redbrain.shop, perform a search (e.g., "nike shoes"), and copy the full search result URL including the q and locales parameters.

2. Build your configuration — Create a JSON object with:

   • One or more search URLs in the urls array
   • ignore_url_failures set to true for uninterrupted runs
   • max_items_per_url set to desired limit (e.g., 100 for standard, 200 for bulk)

3. Start the scraper — Paste the configuration and run the actor. Monitor the execution log for progress.

4. Export results — Download output as JSON, CSV, or Excel. Results are ready to integrate into databases, spreadsheets, or analytics tools.

Best practices:

• Start with small max_items_per_url (20–50) to test URL validity
• Use locale filters to scope results by region and language
• For large-scale runs, batch URLs into multiple runs to avoid timeouts
• Export to CSV for quick analysis in Excel; use JSON for integration into applications

Common issues:

• URLs must be direct search result pages (not category pages)
• Verify URL encoding if special characters appear broken in results
• Set ignore_url_failures: true when running bulk operations

---

Use Cases & Business Value

• Price monitoring: Track competitor pricing in real-time and set up price alert systems
• Market intelligence: Analyze product availability, merchant presence, and discount trends
• SEO & content: Build product comparison content with Redbrain listings as data source
• Affiliate marketing: Identify top-performing products and merchants for promotion
• Inventory planning: Monitor stock availability across multiple merchants to optimize purchasing

The scraper delivers actionable product data that would take hours to collect manually, enabling data-driven decisions in hours.

---

Conclusion

The Redbrain Product Search Scraper is a powerful tool for anyone needing structured product data from Redbrain.shop at scale. With 17+ fields covering pricing, availability, merchant info, and product media, it transforms search results into intelligence. Whether you're monitoring prices, building aggregator platforms, or conducting market research, this scraper delivers the data you need — fast and reliably.