Lidl Scraper - European Grocery Products & Prices

What does Lidl Scraper do?

Lidl Scraper extracts structured Lidl grocery products and prices across Europe — Germany, France, the UK, Poland, Italy and 23 more markets (lidl.de, lidl.fr, lidl.it …). Every product row is tagged by country with the current price, the strikethrough normal price, per-unit pricing, brand, category, images and the product page. Pick one country or several in a single run.

New to Apify? Sign up free and use the included $5 monthly platform credit to test this actor.

Key features

• 🌍 Germany, France, the UK, Poland, Italy + 23 more — scrape one or several of 28 Lidl markets via countries; every row is tagged with its country for cross-border comparison.
• 🔍 Keyword search or full catalog — search by query, or leave it empty to dump the entire national assortment per country.
• 💰 Current + normal price — the live price, the strikethrough priceNormal, an isOnOffer flag and the on-label discountText.
• ⚖️ Per-unit comparison pricing — comparePrice + compareUnit (per kg / l / stk), the shelf-label per-unit rate.
• 🏷️ Structured brand, category + product page — brand, category, imageUrl, the canonical portalUrl and an erpNumber identity.
• ♻️ Incremental price tracking — incrementalMode + stateKey returns only NEW / UPDATED / EXPIRED, tracked separately per country.
• 🔔 Notifications — push each run to Telegram, Discord, Slack, WhatsApp or a generic webhook (n8n / Make / Zapier).
• 📦 Compact mode — drop heavy fields and keep the essentials, for AI agents and MCP workflows.

What data can you extract from lidl.de?

Each result includes Core listing fields (country, ean, erpNumber, productId, name, brand, categoryLvl0, and labels, and more). In standard mode, all fields are always present — unavailable data points are returned as null, never omitted. In compact mode, only core fields are returned.

Input

The main inputs are a search keyword and a result limit. Additional filters and options are available in the input schema.

Key parameters:

• countries — Lidl country codes to scrape (e.g. ["DE", "FR", "IT"]). One or several. Covers Lidl's largest markets — Germany, France, the UK, Poland, Italy — and 23 more (28 in total). Defaults to Germany. Each product row is tagged with its country. (default: ["DE"])
• query — Keyword search across the Lidl catalog (e.g. "arla", "kaffe"). Searches product names and brands. Leave empty to scan the entire national assortment.
• maxResults — Maximum total products per country (0 = unlimited; a national catalog is typically several hundred to a few thousand). (default: 200)
• incrementalMode — Compare against the previous run's state and emit only NEW / UPDATED / EXPIRED products (price changes, new SKUs, delistings). Requires 🔑 State Key. EXPIRED detection only fires for a full uncapped catalog scan (a keyword search can't tell delisted from out-of-scope). State is tracked per country. (default: false)
• compact — Keep only shopping essentials (identity, price, normal price, per-unit price, offer flags, image, product page) and drop heavier fields. Same row count, same billing. (default: false)
• inStockOnly — Drop products flagged as out of stock. (default: false)
• ...and 16 more parameters

Input examples

Search a brand in Germany — Targeted run scoped to a keyword query in one market.

→ Matching products with current price, normal price and per-unit pricing.

{
  "countries": [
    "DE"
  ],
  "query": "milch",
  "maxResults": 50
}

Full national catalog (France) — Leave query empty to dump the entire French assortment.

→ Every product with current + strikethrough normal price and product page.

{
  "countries": [
    "FR"
  ],
  "maxResults": 0
}

Incremental price monitor (Germany) — Only emit products that changed since the previous run with this stateKey.

→ NEW / UPDATED / EXPIRED rows only; state tracked per country.

{
  "countries": [
    "DE"
  ],
  "maxResults": 0,
  "incrementalMode": true,
  "stateKey": "lidl-tracker",
  "emitExpired": true
}

Output

Each run produces a dataset of structured grocery records. Results can be downloaded as JSON, CSV, or Excel from the Dataset tab in Apify Console.

Example grocery record

{
  "country": "DE",
  "ean": "493775",
  "erpNumber": "100400529",
  "productId": "100400529",
  "name": "ESMARA® Herren Pantolette",
  "brand": "ESMARA®",
  "categoryLvl0": "Kategorien/Mode/Herrenmode/Schuhe/Sandalen",
  "labels": [
    "Basic",
    "Price"
  ],
  "price": 7.99,
  "priceNormal": 7.99,
  "comparePrice": null,
  "compareUnit": null,
  "isOnOffer": false,
  "discountText": null,
  "unitSize": null,
  "unitMeasure": null,
  "inStock": null,
  "disclaimer": null,
  "imageUrl": "https://www.lidl.de/assets/gcpcd047f879b6b4d6698b2b26db7437732.jpg",
  "images": [
    "https://www.lidl.de/assets/gcpcd047f879b6b4d6698b2b26db7437732.jpg",
    "https://www.lidl.de/assets/gcpee2edf24b8ba488fa2c59cf918b068ed.jpg",
    "https://www.lidl.de/assets/gcpf229373a80f94fdc94d74c74f07c68d8.jpg"
  ],
  "portalUrl": "https://www.lidl.de/p/esmara-herren-pantolette/p100400529",
  "currency": "EUR",
  "source": "lidl",
  "scrapedAt": "2026-06-10T19:10:02.849Z",
  "changeType": null,
  "firstSeenAt": null,
  "lastSeenAt": null,
  "expiredAt": null
}

Incremental fields

When incremental mode is on, each record also carries:

• changeType — one of NEW, UPDATED, UNCHANGED, REAPPEARED, EXPIRED. Default output covers NEW / UPDATED / REAPPEARED; set emitUnchanged: true or emitExpired: true to opt into the others.
• firstSeenAt, lastSeenAt — ISO-8601 timestamps tracking the listing across runs.

How to scrape lidl.de

1. Go to Lidl Scraper in Apify Console.
2. Enter a search keyword.
3. Set maxResults to control how many results you need.
4. Click Start and wait for the run to finish.
5. Export the dataset as JSON, CSV, or Excel.

Use cases

• Extract grocery data from lidl.de for market research and competitive analysis.
• Track pricing trends across regions and categories over time.
• Monitor new and changed listings on scheduled runs without processing the full dataset every time.
• Feed structured data into AI agents, MCP tools, and automated pipelines using compact mode.
• Export clean, structured data to dashboards, spreadsheets, or data warehouses.

How much does it cost to scrape lidl.de?

Lidl Scraper uses pay-per-event pricing. You pay a small fee when the run starts and then for each result that is actually produced.

• Run start: $0.01 per run
• Per result: $0.002 per grocery record

Example costs:

• 10 results: $0.03
• 25 results: $0.06
• 100 results: $0.21
• 200 results: $0.41
• 500 results: $1.01

Example: recurring monitoring savings

These examples compare full re-scrapes with incremental runs at different churn rates. Churn is the share of listings that are new or whose tracked content changed since the previous run. Actual churn depends on your query breadth, source activity, and polling frequency — the scenarios below are examples, not predictions.

Example setup: 250 results per run, daily polling (30 runs/month). Event-pricing examples scale linearly with result count.

Churn rate	Full re-scrape run cost	Incremental run cost	Savings vs full re-scrape	Monthly cost after baseline
5% — stable niche query	$0.51	$0.04	$0.47 (93%)	$1.05
15% — moderate broad query	$0.51	$0.08	$0.43 (83%)	$2.55
30% — high-volume aggregator	$0.51	$0.16	$0.35 (69%)	$4.80

Full re-scrape monthly cost at daily polling: $15.30. First month with incremental costs $1.53 / $2.97 / $5.15 for the 5% / 15% / 30% scenarios because the first run builds baseline state at full cost before incremental savings apply.

Platform usage (compute and proxies) is billed separately by Apify based on actual consumption. Incremental runs consume less on result processing, though fixed per-run overhead stays the same.

FAQ

How many results can I get from lidl.de?

The number of results depends on the search query and available listings on lidl.de. Use the maxResults parameter to control how many results are returned per run.

Does Lidl Scraper support recurring monitoring?

Yes. Enable incremental mode to only receive new or changed listings on subsequent runs. This is ideal for scheduled monitoring where you want to track changes over time without re-processing the full dataset.

Can I integrate Lidl Scraper with other apps?

Yes. Lidl Scraper works with Apify's integrations to connect with tools like Zapier, Make, Google Sheets, Slack, and more. You can also use webhooks to trigger actions when a run completes.

Can I use Lidl Scraper with the Apify API?

Yes. You can start runs, manage inputs, and retrieve results programmatically through the Apify API. Client libraries are available for JavaScript, Python, and other languages.

Can I use Lidl Scraper through an MCP Server?

Yes. Apify provides an MCP Server that lets AI assistants and agents call this actor directly. Use compact mode and excludeEmptyFields to keep payloads manageable for LLM context windows.

Is it legal to scrape lidl.de?

This actor extracts publicly available data from lidl.de. Web scraping of public information is generally considered legal, but you should always review the target site's terms of service and ensure your use case complies with applicable laws and regulations, including GDPR where relevant.

Your feedback

If you have questions, need a feature, or found a bug, please open an issue on the actor's page in Apify Console. Your feedback helps us improve.

You might also like

• Bilka Scraper - Danish Grocery Products & Prices — Scrape Bilka (Salling Group), Denmark's largest hypermarket chain. Get the full product catalog.
• Føtex Scraper - Danish Grocery Products & Prices — Scrape Føtex (Salling Group), one of Denmark's largest supermarket chains. Get the full product.
• Netto Scraper - Danish Grocery Products & Prices — Scrape Netto (Salling Group), Denmark's largest discount-grocery chain. Get the full product.
• REMA 1000 Scraper - Danish Grocery Products & Prices — Scrape rema1000.dk — Denmark's largest discount-grocery chain with 3900 SKUs. Search products by.

Getting started with Apify

New to Apify? Create a free account with $5 credit — no credit card required.

1. Sign up — $5 platform credit included
2. Open this actor and configure your input
3. Click Start — export results as JSON, CSV, or Excel

Need more later? See Apify pricing.