Lidl UK Product Scraper

Scrape product listings, categories, prices, and detailed item data from Lidl UK (lidl.co.uk).

Use this scraper for price monitoring, market research, product research, and availability checks on the Lidl UK online grocery catalog.

Disclaimer: This is an unofficial scraper and is not affiliated with, endorsed by, or sponsored by Lidl or the Schwarz Group.

Supported operations

Operation	Description
search	Keyword search via public SSR storefront
category	List products for a category
categories	Discover shoppable category pages
item	Full product details from product page
search_filters	Availability, category pivots, sort options
probe	Health check for storefront access

Not supported: store locator, review feeds, full Lidl SKU catalog.

Input guide by operation

The Apify Console form shows all fields at once. Only fill the fields relevant to your chosen operation.

search (default)

Field	Required	Notes
query	Yes	e.g. wine, milk
page	No	Default 1
limit	No	Default 5, max 100
sort	No	relevance, price_asc, price_desc, title_asc, title_desc

category

Field	Required	Notes
category_id or slug or url	One required	e.g. category_id=a10023986, slug red-wine/a10023986
page, limit, sort	No	Pagination and sort

item

Field	Required	Notes
barcode or product_id or slug or url	One required	Use ids from search/category results, e.g. product_id=10048484

categories / search_filters / probe

No additional required fields beyond operation. For search_filters, optional query or category context helps.

Example inputs

Default search:

{
  "operation": "search",
  "query": "wine",
  "limit": 5
}

Category listing:

{
  "operation": "category",
  "category_id": "a10023986",
  "limit": 5
}

Full item by product id:

{
  "operation": "item",
  "product_id": "10048484"
}

Output fields

Search / category listings

id, name, brand, source_url, slug, price, discount_price, currency, image, category, breadcrumbs

Item (full enrichment)

id, name, brand, source_url, description, price, discount_price, currency, barcode, images, specifications, attributes, stock_status, in_stock, variants, rating, review_count

Run summary is stored in the OUTPUT key-value record.

Proxy behavior

• Default strategy in cloud: proxy_first with GB Apify RESIDENTIAL proxy.
• Modes: auto (recommended), direct, apify, custom via proxyMode input or env vars.
• Retries: Rotates httpx / cloudscraper / tls_client / curl_cffi on block-like responses.
• Structured errors: Returns error summary in OUTPUT instead of crashing when blocked.

Limitations

• Covers the publicly listed Lidl UK online catalog (limited SKU scope vs full store inventory).
• Pagination is server-side slicing of the SSR product grid.
• Standalone product_id works best after a prior search/category call in the same run; barcode is more reliable for direct item lookup.
• No store-specific pricing or postcode availability.

Free trial limit

Free/trial Apify users are limited to 10 result requests per UTC day. Paid users receive normal configured limits. Set disableFreeTrialGuard: true to bypass for private testing.

Monetization

Pay-per-event pricing:

• Actor start: ~$0.005
• Dataset item (result-item): ~$0.0003