Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

Bol.com Product Search Scraper: Extract Product Data - Market Research Tool

Introduction

Bol.com stands as the Netherlands' and Belgium's largest online marketplace, serving over 13.7 million active customers with a product range exceeding 41 million items. Now, 25 years later, the shop has 13.7 million active customers in The Netherlands and Belgium, a product range of 41 million items and 46.500 sales partners. For businesses, researchers, and e-commerce professionals, accessing this vast product database presents significant opportunities for market analysis, competitive research, and pricing strategies.

The challenge lies in manually collecting product information from thousands of listings - a time-consuming process that often yields inconsistent results. Our Bol.com Product Search Scraper addresses this challenge by automating the data extraction process, enabling users to gather comprehensive product information efficiently and systematically.

Overview of the Bol.com Scraper

The Bol.com Product Search Scraper is a powerful automation tool designed to extract detailed product information from search result pages on Bol.com. This scraper systematically navigates through product listings, collecting essential data points that are crucial for business intelligence and market research.

The scraper excels in handling large-scale data extraction while maintaining accuracy and consistency. It can process multiple product category pages simultaneously, making it ideal for comprehensive market analysis. The tool is particularly valuable for e-commerce sellers, market researchers, pricing analysts, and business development professionals who need reliable access to Bol.com's extensive product catalog.

Target users include e-commerce businesses analyzing competitor products, market research firms studying Dutch and Belgian retail trends, pricing specialists monitoring market dynamics, and entrepreneurs exploring product opportunities in the Benelux region.

Input and Output Specifications

Example url 1: https://www.bol.com/nl/nl/l/oled-tv-s/7291/63323/?page=3&promo=etvs-oled

Example url 2: https://www.bol.com/nl/nl/ra/tot-50-korting-op-modeaccessoires-/409548?bltgh=e85c9c62-de49-436a-9c38-2c71b0a89289.flexBannerCarousel_Flexbanner-3.flex-banner-3.Banner&promo=main_605_C409548_3_MHP_1_200026570&cid=1753345812997-1960633693784

Example url 3: https://www.bol.com/nl/nl/l/kasten/14080/?bltgh=73a51d5c-9a1f-4004-b227-e10eaf63e3d6.recentlyViewedCategoriesEntry.category-item-2.CategoryImage&cid=1753346083635-9218424723013

Example Screenshot of product information page:

Input Format

The scraper accepts configuration through a JSON object with several key parameters:

Scrape with URLs:

{
  "max_retries_per_url": 2, // Maximum number of retry attempts for each URL
  "proxy": { // Proxy configuration to avoid bot detection
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "NL" // Choose a country that matches your target data location
  },
  "max_items_per_url": 20, // Total number of items you want to scrape
  "urls": [ // Product list page URLs to scrape
    "https://www.bol.com/nl/nl/l/oled-tv-s/7291/63323/?page=3&promo=etvs-oled",
    "https://www.bol.com/nl/nl/l/kasten/14080/?bltgh=73a51d5c-9a1f-4004-b227-e10eaf63e3d6.recentlyViewedCategoriesEntry.category-item-2.CategoryImage&cid=1753346083635-9218424723013",
    "https://www.bol.com/nl/nl/ra/tot-50-korting-op-modeaccessoires-/409548?bltgh=e85c9c62-de49-436a-9c38-2c71b0a89289.flexBannerCarousel_Flexbanner-3.flex-banner-3.Banner&promo=main_605_C409548_3_MHP_1_200026570&cid=1753345812997-1960633693784"
  ],
  "ignore_url_failures": true // Continue scraping even if some URLs fail
}

The urls parameter: List of product list page URLs that you want to scrape. You can add URLs one by one, or use the Bulk edit section to add a prepared list.

The ignore_url_failures parameter: If set to true, the scraper will continue running even if some URLs fail to be scraped after reaching the maximum number of retries. This ensures that one problematic URL doesn't stop your entire scraping job.

When you provide a list of URLs for scraping, all options in the "Scrape with search filters" section will be disabled. The system will only collect data from the URLs you specified.

Scrape with Search Filters:

{
  "max_retries_per_url": 2, // Maximum number of retry attempts for each search filter
  "proxy": { // Proxy configuration to avoid bot detection
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "NL" // Choose a country that matches your target data location
  },
  "max_items_per_url": 20, // Total number of items you want to scrape
  "keyword": "laptop", // Search keyword to find products
  "sort_by": "price0", // Sort products by specific criteria
  "page": 1 // Starting page number for search results
}

The keyword parameter: The search keyword to find products (e.g., "laptop", "boeken", "telefoon", "camera").

The sort_by parameter: Sort products by various criteria:

• "popularity" - Popularity (most popular first)
• "price0" - Price (low to high)
• "price1" - Price (high to low)
• "release_date1" - Release Date (newest first)
• "rating1" - Rating (highest rated first)
• "wishListRank1" - Wish List Rank (most wishlisted first)

The page parameter: Starting page number for scraping, useful for continuing interrupted scrapes or targeting specific result ranges.

When using search filters for scraping, you need to leave the urls field empty (or set it to null) in the "Scrape with URLs" configuration.

General Options:

The max_items_per_url parameter: Limits the number of products extracted from each product list page or search results page. The default value is 20, providing a manageable batch size while allowing for comprehensive data collection.

The max_retries_per_url parameter: Sets the maximum number of retry attempts for each URL or search filters if the scrape is detected as a bot or the page fails to load. The default value is 2, providing a good balance between thoroughness and efficiency.

The proxy parameter: Proxy configuration is essential for maintaining anonymity and avoiding detection. The residential proxy option ensures that your scraping activities appear as legitimate browsing, reducing the risk of being blocked or rate-limited. You should choose a country that matches the location of the website you're scraping (e.g., Netherlands/NL for bol.com).

Output:

The scraper returns comprehensive product data in a structured format with 21 distinct fields:

[ // List of product information
  {
    "id": "9300000144940948",
    "url": "https://www.bol.com/nl/nl/p/sony-xr-65a80l-65-inch-4k-oled-2023/9300000144940948/",
    "title": "Sony Bravia XR-65A80L - 65 inch - 4K OLED - 2023",
    "product_specs": [
      "2023",
      "65 inch",
      "100 Hz",
      "OLED",
      "Backlight: Self-emitting",
      "Smart TV",
      "Google TV"
    ],
    "description": "De Sony Bravia XR-65A80L is een geavanceerde OLED-tv met een helder scherm en de Cognitive Processor…",
    "image_url": "https://media.s-bol.com/YJ6mGo45vZOp/xkyK4yr/168x103.jpg",
    "total_reviews": 12,
    "rating_score": 5.0,
    "price": 1989.0,
    "category_id": "7291",
    "categories": [],
    "brand": "Sony",
    "brick": "10001400",
    "seller": "Verkoop door bol",
    "seller_link": "Verkoop door bol",
    "discount": 210.0,
    "orderable": "available",
    "energy_label": "F",
    "product_delivery_highlight": "Op voorraad",
    "product_delivery_note": "Voor 23:59 besteld, morgen in huis. Levering op afspraak. \nLevertijd\nWe doen er alles aan om dit artikel op tijd te bezorgen. Het is echter in een enkel geval mogelijk dat door omstandigheden de bezorging vertraagd is.\nBezorgopties\nWe bieden verschillende opties aan voor het bezorgen of ophalen van je bestelling. Welke opties voor jouw bestelling beschikbaar zijn, zie je bij het afronden van de bestelling.",
    "quantity": 1,
    "from_url": "https://www.bol.com/nl/nl/l/oled-tv-s/7291/63323/?page=3&promo=etvs-oled",
    "page": 3
  }, // ... Many other product details
]

Core Product Information:

• ID: Unique product identifier for database management
• URL: Direct link to the product page for reference
• Title: Complete product name as displayed on Bol.com
• Description: Detailed product description for content analysis

Product Specifications:

• Product Specs: Technical specifications and features
• Brand: Manufacturer or brand name for brand analysis
• Category ID: Numerical category identifier for classification
• Categories: Full category path for product segmentation

Visual and Media Data:

• Image URL: Primary product image for visual analysis
• Energy Label: Energy efficiency rating for applicable products

Pricing and Commercial Data:

• Price: Current selling price in euros
• Discount: Percentage or amount of discount applied
• Orderable: Availability status for inventory tracking

Seller Information:

• Seller: Name of the selling entity
• Seller Link: Direct link to seller profile
• Brick: Physical store availability indicator

Customer Feedback:

• Total Reviews: Number of customer reviews for popularity assessment
• Rating Score: Average customer rating for quality evaluation

Logistics Data:

• Product Delivery Highlight: Key delivery features
• Product Delivery Note: Specific delivery instructions
• Quantity: Available stock levels

This comprehensive data structure enables multi-dimensional analysis of products, from pricing strategies to customer satisfaction trends.

Usage Instructions

Step 1: Choose Your Scraping Approach

Option A - URL Preparation: Navigate to Bol.com and perform your desired product search using the website's search and category navigation features. Copy the complete search result URLs, ensuring they include category and filter parameters. The scraper works best with paginated search results.

Option B - Use Search Filters: Define your search criteria using the built-in filters:

• Set keyword for specific products (e.g., "laptop", "boeken", "telefoon")
• Select sort_by to organize results (popularity, price, rating, release date, wishlist rank)
• Set page to start from a specific results page

Step 2: Configuration Setup Configure the JSON input with appropriate proxy settings. For Netherlands-based data, set the proxy country to "NL" (Netherlands) or nearby regions. Adjust max_items_per_url based on your data requirements - higher values provide more comprehensive coverage but increase processing time. Enable ignore_url_failures for robust scraping.

Step 3: Execution and Monitoring Launch the scraper and monitor its progress through the provided dashboard. The tool will systematically process each URL or search filter, handling pagination automatically. Typical processing time ranges from 5-15 minutes per 100 products, depending on proxy performance and server response times.

Best Practices:

Method Selection:

• Use URL-based scraping for specific category pages or complex filtered searches
• Use filter-based scraping for keyword searches with sorting options
• Combine both approaches: use filters for product discovery, then URLs for targeted category extraction

Scraping Strategy:

• Use Netherlands (NL) residential proxies to avoid IP blocking
• Implement reasonable delays between requests (handled automatically)
• Process data in batches for large-scale extraction
• Regularly update proxy configurations for optimal performance

Filter Optimization:

Sorting Strategy:

• Use sort_by: "popularity" to identify trending/popular products
• Use sort_by: "price0" (low to high) for budget-focused research or finding deals
• Use sort_by: "price1" (high to low) to identify premium products
• Use sort_by: "rating1" to find highest-rated products
• Use sort_by: "release_date1" to track newest product releases
• Use sort_by: "wishListRank1" to identify most-desired products

Keyword Strategy:

• Use Dutch keywords for better results (e.g., "laptop", "boeken", "telefoon", "camera")
• Try specific product names or model numbers for precise targeting
• Test keyword variations to ensure comprehensive coverage

Advanced Filter Combinations:

• Budget products: keyword: "laptop", sort_by: "price0"
• Premium items: keyword: "camera", sort_by: "price1"
• Trending products: keyword: "boeken", sort_by: "popularity"
• Top-rated: keyword: "telefoon", sort_by: "rating1"
• New releases: keyword: "games", sort_by: "release_date1"
• Most wanted: keyword: "speelgoed", sort_by: "wishListRank1"

Common Issues:

Empty Results:

• For filter-based: Verify keyword is in Dutch or commonly used on Bol.com
• Try broader keywords if results are limited
• Test different sort_by options to see if results appear

Connection Issues:

• Ensure using Netherlands (NL) proxies for best access
• Enable ignore_url_failures to handle temporary connection issues
• Increase max_retries_per_url to 3-5 for better reliability

Sort Code Issues:

• Ensure sort_by values match exactly: "popularity", "price0", "price1", "release_date1", "rating1", "wishListRank1"
• Leave empty or use "popularity" as default if uncertain

URL Format Errors:

• For URL-based: Ensure URLs are from bol.com/nl/nl/ (Dutch site)
• Include all query parameters when copying URLs
• Test URLs manually in browser before adding to scraper

Proxy Configuration:

• Always use Netherlands (NL) proxies for bol.com
• Residential proxies provide better success rates than datacenter proxies
• Rotate proxy settings if experiencing consistent blocks

Use Cases:

• Price Monitoring: Use sort_by: "price0" or "price1" to track price ranges
• Popularity Analysis: Use sort_by: "popularity" to identify trending products
• Quality Research: Use sort_by: "rating1" to find best-reviewed items
• New Product Tracking: Use sort_by: "release_date1" to monitor latest releases
• Wishlist Trends: Use sort_by: "wishListRank1" to identify most-desired products
• Market Research: Compare same keyword across different sort options for comprehensive analysis

Benefits and Applications

The Bol.com scraper delivers significant time savings, reducing manual data collection from hours to minutes. This automation enables real-time competitive analysis, allowing businesses to adjust pricing strategies dynamically based on market conditions.

Key Applications:

• Competitive Intelligence: Monitor competitor pricing, product offerings, and market positioning
• Market Research: Analyze product trends, customer preferences, and brand performance
• Inventory Planning: Track product availability and demand patterns
• Price Optimization: Implement dynamic pricing strategies based on market data
• Brand Monitoring: Track brand presence and performance across categories

The extracted data supports data-driven decision making, enabling businesses to identify market opportunities, optimize product positioning, and enhance competitive advantage in the Benelux market.

Conclusion

The Bol.com Product Search Scraper provides essential market intelligence for businesses operating in or targeting the Dutch and Belgian markets. By automating data extraction from Europe's leading marketplace, users gain access to comprehensive product insights that drive informed business decisions.

Ready to unlock Bol.com's market data potential? Start extracting valuable product intelligence today and gain a competitive edge in the Benelux e-commerce landscape.

Related Actors

Bol product details scraper: Extract detailed product information from Bol.com effortlessly with this powerful scraping tool

Bol review scraper: Extract detailed review information from Bol.com effortlessly with this powerful scraping tool

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Bol.com Product Search Query Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.