Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

Tesco.com Scraper: Extract Product Data & Pricing Intelligence

Introduction

Tesco operates as one of the UK's leading supermarket chains, offering an extensive online grocery shopping platform that serves millions of customers. With up to 50,000 products available online, including all major brands, Tesco's e-commerce platform represents a goldmine of valuable market data for businesses, researchers, and analysts seeking comprehensive grocery market insights.

The Tesco.com Product Search Scraper addresses the critical need for automated data extraction from this vast product catalog. Whether you're conducting competitive pricing analysis, monitoring product availability, tracking promotional campaigns, or building comprehensive market research datasets, manual data collection from Tesco's extensive inventory would be virtually impossible and highly time-consuming. This scraper provides an efficient solution for extracting structured product data at scale, enabling businesses to make data-driven decisions in the competitive UK grocery market.

Scraper Overview and Capabilities

The Tesco.com Product Search Scraper is a sophisticated data extraction tool designed specifically for navigating Tesco's complex e-commerce architecture. This scraper can extract comprehensive product details like UPC/GTIN, price, competitor price, category, availability, promotions, nutrition, and images from Tesco UK at scale. The tool supports automated pagination, allowing users to scrape entire product categories without manual intervention.

Key strengths of this scraper include its robust proxy integration, intelligent retry mechanisms, and comprehensive data field extraction. The tool is engineered to handle Tesco's anti-bot measures effectively while maintaining high success rates and data accuracy. It's particularly valuable for e-commerce businesses, market researchers, price comparison services, inventory management systems, and competitive intelligence teams who need reliable access to Tesco's product data.

The scraper is ideal for retail analysts tracking market trends, dropshipping businesses sourcing products, academic researchers studying consumer markets, and businesses developing price optimization strategies. Its scalable architecture ensures consistent performance whether extracting data from a single product category or conducting comprehensive market scans across multiple departments.

Input and Output Details

Example url 1: https://www.tesco.com/groceries/en-GB/shop/frozen-food/vegetables/all?sortBy=relevance&page=2

Example url 2: https://www.tesco.com/groceries/en-GB/shop/clothing-and-accessories/all

Example url 3: https://www.tesco.com/groceries/en-GB/shop/bakery/all

Example Screenshot of product information page:

Input Format

The scraper accepts JSON configuration with several key parameters:

Input:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "max_items_per_url": 20,
  "urls": [ 
    "https://www.tesco.com/groceries/en-GB/shop/frozen-food/vegetables/all?sortBy=relevance&page=2", 
    "https://www.tesco.com/groceries/en-GB/shop/clothing-and-accessories/all",
    "https://www.tesco.com/groceries/en-GB/shop/bakery/all"
    // // Links to product list by query page.
  ]
}

Input Parameter Explanations:

• max_retries_per_url: Defines the maximum number of retry attempts for failed requests, ensuring robust data extraction even with intermittent connection issues
• proxy: Essential for avoiding bot detection; residential proxies from the target country (like UK or nearby regions) provide the most reliable access
• max_items_per_url: Controls the number of products extracted per category page, allowing for focused data collection or comprehensive scans
• urls: Category or search result URLs from Tesco's website, supporting various product sections from groceries to clothing

Output Format

You get the output from the Tesco.com Product Search Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of product information
  {
  "id": "317204044",
  "is_for_sale": true,
  "status": "AvailableForSale",
  "seller": null,
  "price": {
    "__typename": "PriceType",
    "actual": 3.25,
    "unit_price": 6.5,
    "unit_of_measure": "kg"
  },
  "promotions": [],
  "fulfilment": null,
  "context": null,
  "tpnb": "93550382",
  "tpnc": "317204044",
  "gtin": "05000227001717",
  "ad_id": "display_3S9ztzcW7HevtbeJ1vFLNU6z1z8KCgoIOTM1NTAzODISABoMCLbC4MUGEKTU3c8DIgIIAQ==",
  "base_product_id": "93550382",
  "title": "Aunt Bessie’s Green Vegetable Mix 500g ",
  "brand_name": "AUNT BESSIE'S",
  "short_description": null,
  "default_image_url": "https://digitalcontent.api.tesco.com/v2/media/ghs/b3294021-c10a-44c2-895f-1ed02cadab59/acda7e3a-4e64-4f90-90b9-5e711ef20066.jpeg?h=225&w=225",
  "super_department_id": "b;RnJvemVuJTIwRm9vZA==",
  "media": {
    "__typename": "ProductMediaType",
    "default_image": {
      "__typename": "ProductMediaDefaultImageType",
      "aspect_ratio": null
    }
  },
  "quantity_in_basket": null,
  "super_department_name": "Frozen Food",
  "department_id": "b;RnJvemVuJTIwRm9vZCU3Q1ZlZ2V0YWJsZXM=",
  "department_name": "Vegetables",
  "aisle_id": "b;RnJvemVuJTIwRm9vZCU3Q1ZlZ2V0YWJsZXMlN0NNaXhlZCUyMFZlZ2V0YWJsZXM=",
  "aisle_name": "Mixed Vegetables",
  "shelf_id": "b;RnJvemVuJTIwRm9vZCU3Q1ZlZ2V0YWJsZXMlN0NNaXhlZCUyMFZlZ2V0YWJsZXMlN0NGcm96ZW4lMjBWZWdldGFibGVzJTIwLSUyME1peGVkJTIwVmVnZXRhYmxlcw==",
  "shelf_name": "Frozen Vegetables - Mixed Vegetables",
  "display_type": "Quantity",
  "product_type": "SingleProduct",
  "average_weight": 0,
  "bulk_buy_limit": 25,
  "group_bulk_buy_limit": 0,
  "bulk_buy_limit_message": "You have reached the maximum quantity for this product",
  "bulk_buy_limit_group_id": "G00002499",
  "time_restricted_delivery": null,
  "restricted_delivery": null,
  "is_in_favourites": null,
  "is_new": false,
  "is_restricted_order_amendment": null,
  "max_weight": 0,
  "min_weight": 0,
  "increment": 0,
  "details": {
    "__typename": "ProductDetailsType",
    "components": [
      {
        "__typename": "AdditionalInfo",
        "is_low_everyday_pricing": false
      }
    ]
  },
  "catch_weight_list": null,
  "restrictions": [],
  "reviews": {
    "__typename": "ReviewsType",
    "stats": {
      "__typename": "ReviewStatsType",
      "no_of_reviews": 1,
      "overall_rating": 3,
      "overall_rating_range": 5
    }
  },
  "model_metadata": null,
  "from_url": "https://www.tesco.com/groceries/en-GB/shop/frozen-food/vegetables/all"
}, // ... Many other product details
]

The scraper returns comprehensive product data in multiple formats (JSON, CSV, Excel), with each product containing detailed information across these key fields:

Product Identification:

• ID: Unique product identifier within Tesco's system
• TPNB: Tesco Product Number Base - primary product identifier
• TPNC: Tesco Product Number Category - category-specific identifier
• GTIN: Global Trade Item Number for universal product identification
• Base Product ID: Core product identifier for variations

Commercial Information:

• For Sale: Boolean indicating product availability for purchase
• Status: Current product status (active, discontinued, out of stock)
• Seller: Product seller information (Tesco or third-party marketplace)
• Price: Current selling price with currency information
• Promotions: Active promotional offers and discount details
• Fulfilment: Delivery and collection options available

Product Details:

• Title: Full product name and description
• Brand Name: Manufacturer or brand information
• Short Description: Concise product summary
• Default Image URL: Primary product image for display purposes
• Details: Comprehensive product specifications and features

Categorization:

• Super Department Name/ID: Top-level category (e.g., "Food & Drink")
• Department Name/ID: Mid-level category (e.g., "Fresh Food")
• Aisle Name/ID: Specific product section (e.g., "Vegetables")
• Shelf Name/ID: Precise product location within category

Purchase Specifications:

• Average Weight: Typical product weight for variable-weight items
• Bulk Buy Limit: Maximum quantity purchasable in single transaction
• Min/Max Weight: Weight range for variable products
• Increment: Minimum purchase increment for bulk items

Enhanced Data:

• Reviews: Customer rating and review information
• Media: Additional product images and multimedia content
• Restrictions: Age restrictions, delivery limitations, or purchase constraints
• Is New: Flag indicating recently added products

This comprehensive data structure enables detailed market analysis, competitive pricing strategies, inventory management, and customer behavior insights.

Usage Guidelines and Best Practices

Step-by-Step Implementation:

1. Target URL Selection: Begin by identifying specific Tesco category pages or search results that contain your desired products. Use Tesco's website navigation to find relevant sections.

2. Proxy Configuration: Configure residential proxies from UK or nearby countries to avoid detection. The scraper's success rate significantly improves with proper proxy settings.

3. Parameter Optimization: Set appropriate limits for max_items_per_url based on your data requirements. Start with smaller limits for testing, then scale up for production runs.

4. Execution Monitoring: Monitor scraping progress and adjust retry settings based on success rates. Higher retry counts improve data completeness but increase execution time.

Best Practices:

• Implement respectful scraping intervals to avoid overwhelming Tesco's servers
• Regularly update URL patterns as Tesco may modify their website structure
• Store extracted data in structured formats for easy analysis and integration
• Validate data quality by cross-checking critical fields like prices and availability

Common Issue Resolution:

• Access Denied Errors: Rotate proxy settings and reduce request frequency
• Incomplete Data: Increase retry limits and verify URL accessibility
• Structure Changes: Update selectors when Tesco modifies their page layout
• Rate Limiting: Implement delays between requests and use distributed proxy pools

Business Benefits and Applications

The Tesco.com Product Search Scraper delivers significant time savings compared to manual data collection, reducing weeks of research into hours of automated extraction. This solution provides accurate, real-time data extraction from Tesco and other eCommerce platforms, ensuring you have the most up-to-date information.

Key Applications:

• Competitive Analysis: Track competitor pricing strategies and promotional campaigns
• Market Research: Analyze product assortments, brand presence, and category trends
• Inventory Management: Monitor product availability and stock levels
• Price Intelligence: Develop dynamic pricing strategies based on market data
• Product Development: Identify market gaps and consumer demand patterns

The business value extends to improved decision-making speed, enhanced market positioning, and reduced manual research costs. Companies using this data can optimize their product offerings, adjust pricing strategies in real-time, and identify emerging market opportunities before competitors.

Conclusion

The Tesco.com Product Search Scraper represents a powerful solution for accessing comprehensive UK grocery market data efficiently and reliably. With its robust architecture, comprehensive data extraction capabilities, and business-ready output formats, this tool empowers organizations to leverage Tesco's extensive product catalog for strategic advantage. Whether you're conducting market research, optimizing inventory, or developing competitive strategies, this scraper provides the reliable data foundation necessary for informed business decisions.

Ready to unlock valuable market insights from Tesco's vast product catalog? Start extracting comprehensive grocery data today and transform your business intelligence capabilities.

Related Actors

• Tesco.com Product Details Scraper: A specialized data extraction solution engineered to harvest comprehensive product information from Tesco.com's.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Tesco.com Product Search Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.