# Lidl Germany Product Scraper (`solidcode/lidl-de-scraper`) Actor \[💰 $2.5 / 1K] Scrape products from Lidl Germany (lidl.de) — titles, brands, prices with discounts, images, categories, ratings and stock. Search by keyword or paste search, category, and product URLs. - **URL**: https://apify.com/solidcode/lidl-de-scraper.md - **Developed by:** [SolidCode](https://apify.com/solidcode) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.50 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Lidl Germany Product Scraper Pull the full product catalog from Lidl Germany (lidl.de) at scale — titles, brands, current and original prices, discount percentages, high-resolution images, German category paths, star ratings, and live stock status as one clean row per product. Built for price-monitoring teams, German-market e-commerce analysts, and deal aggregators who need fresh Lidl.de pricing and assortment data without building and maintaining their own collector. ### Why This Scraper? - **Full pricing intelligence on every row** — current price, original (struck-through) price, discount percentage, and currency code, so you can track every Lidl markdown and compute savings without a second lookup. - **7 sort orders, including Biggest discount and Best selling** — surface clearance items and bestseller rankings on demand, not just Lidl's default relevance ordering. - **Brand filter + in-stock-only toggle together** — pull a clean SILVERCREST, PARKSIDE, or KRUPS catalog with sold-out noise stripped out in a single run. - **Star ratings with the recommend breakdown** — average score, total review count, and the would-recommend yes/no split captured for every rated product. - **Three input modes, zero URL-building** — plain keyword search, a pasted Lidl.de URL, or a direct product link; the type is detected for you automatically. - **German product taxonomy in full** — the main category plus the complete category breadcrumb path Lidl shows on each product. - **Every product image, not just the thumbnail** — the main image URL plus the full ordered image gallery array per product. - **Up to the entire matching catalog per search** — smooth automatic pagination walks all results for a keyword with a single total cap across the whole run. - **Brand logos and order minimums** — each row carries the brand logo URL and the minimum orderable quantity, ready for catalog and storefront builds. ### Use Cases **Price Monitoring** - Track current vs. original price on key products to catch every markdown - Watch discount percentages move over time across a category - Alert when a target item drops below a price threshold - Compare Lidl pricing against your own or a competitor's catalog **Competitive Intelligence** - Pull a full single-brand catalog (e.g. PARKSIDE tools) for assortment analysis - Benchmark Lidl's bestseller ranking against your product line - Map which brands Lidl carries in a category and at what price points - Detect new product launches by sorting on Newest **Deal Aggregation** - Feed a deals or coupon site with Lidl's biggest current discounts - Surface clearance items with the Biggest discount sort order - Build a daily "top markdowns" feed filtered to in-stock products - Rank deals by savings using current and original price together **Market Research** - Analyze price distribution across an entire German product category - Study rating and review volume as a demand signal per product - Track stock availability patterns across the assortment - Build pricing histories for German-market retail studies **Catalog Building** - Populate a product database with images, descriptions, and categories - Sync brand, category path, and pricing into a comparison engine - Enrich an existing catalog with Lidl ratings and stock status ### Getting Started #### Simple Keyword Search Just one keyword and a small result cap to start: ```json { "searchTerms": ["kaffee"], "maxResults": 50 } ```` #### Brand Catalog, In Stock, Best Deals First Pull only available PARKSIDE products, biggest discounts first: ```json { "searchTerms": ["bohrmaschine"], "brand": "PARKSIDE", "inStockOnly": true, "sortBy": "percentageDiscount-desc", "maxResults": 200 } ``` #### Paste Lidl.de URLs Directly Mix a search results page and a single product page — the type is detected automatically: ```json { "startUrls": [ "https://www.lidl.de/q/search?q=bettw%C3%A4sche", "https://www.lidl.de/p/silvercrest-kaffeevollautomat/p100123456" ], "maxResults": 100 } ``` #### Multiple Terms, Newest First, Unlimited ```json { "searchTerms": ["kaffee", "tee", "kakao"], "sortBy": "firstOnlineDate-desc", "maxResults": 0 } ``` ### Input Reference #### What to Scrape | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `searchTerms` | string\[] | `["kaffee"]` | Plain keywords to search Lidl.de for, such as `kaffee`, `bohrmaschine`, or `bettwäsche`. One search runs per term — no URLs to build. Add as many as you like. | | `startUrls` | string\[] | `[]` | Paste Lidl.de links directly: search result pages, category pages, or individual product pages. The type is detected automatically. | #### Filters | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `sortBy` | select | `Relevance` | Order results are returned in: Relevance, Price: low to high, Price: high to low, Newest, Highest rated, Best selling, or Biggest discount. Applies to keyword and category searches. | | `brand` | string | `null` | Only return products from a single brand, e.g. `SILVERCREST`, `PARKSIDE`, `KRUPS`. Enter the brand name exactly as Lidl shows it. Leave empty for all brands. | | `inStockOnly` | boolean | `false` | When on, only products currently available to order online are returned. | #### Options | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `maxResults` | integer | `100` | Maximum number of products to return in total across all search terms and URLs. Set to `0` to collect everything available. Start with 20–100 to test, then increase. | ### Output One flat row per product. Here's a representative result: ```json { "productId": "100123456", "title": "SILVERCREST Kaffeevollautomat", "brand": "SILVERCREST", "brandLogo": "https://www.lidl.de/assets/silvercrest-logo.png", "description": "Vollautomatische Kaffeemaschine mit Milchaufschäumer und 15 bar Druck.", "canonicalUrl": "https://www.lidl.de/p/silvercrest-kaffeevollautomat/p100123456", "price": { "current": 199.0, "currency": "EUR", "originalPrice": 249.0, "discountPercentage": 20 }, "mainImage": "https://www.lidl.de/p/media/silvercrest-1.jpg", "images": [ "https://www.lidl.de/p/media/silvercrest-1.jpg", "https://www.lidl.de/p/media/silvercrest-2.jpg" ], "category": { "main": "Haushalt", "path": ["Haushalt", "Küche", "Kaffee & Espresso", "Kaffeevollautomaten"] }, "ratings": { "average": 4.6, "count": 312, "recommendedYes": 290, "recommendedNo": 22 }, "stock": { "available": true, "minOrderQuantity": 1 }, "searchUrl": "https://www.lidl.de/q/search?q=kaffee", "scrapedAt": "2026-06-17T14:30:00Z" } ``` #### Core Fields | Field | Type | Description | |-------|------|-------------| | `productId` | string | Unique Lidl product identifier | | `title` | string | Product name | | `brand` | string | Brand name as shown on Lidl | | `brandLogo` | string | Brand logo image URL | | `description` | string | Product description text | | `canonicalUrl` | string | Direct link to the Lidl.de product page | #### Pricing | Field | Type | Description | |-------|------|-------------| | `price.current` | number | Current selling price | | `price.currency` | string | Currency code (e.g. `EUR`) | | `price.originalPrice` | number | Original / struck-through price before discount; `null` when not discounted | | `price.discountPercentage` | number | Discount percentage off the original price | #### Images & Category | Field | Type | Description | |-------|------|-------------| | `mainImage` | string | Primary product image URL | | `images` | string\[] | Full ordered gallery of product image URLs | | `category.main` | string | Top-level category name | | `category.path` | string\[] | Full category breadcrumb path | #### Ratings | Field | Type | Description | |-------|------|-------------| | `ratings.average` | number | Average star rating; `null` when there are no reviews | | `ratings.count` | number | Total number of reviews | | `ratings.recommendedYes` | number | Reviewers who would recommend the product | | `ratings.recommendedNo` | number | Reviewers who would not recommend the product | #### Stock & Meta | Field | Type | Description | |-------|------|-------------| | `stock.available` | boolean | Whether the product is currently available to order online | | `stock.minOrderQuantity` | number | Minimum orderable quantity | | `searchUrl` | string | The search or source URL this product came from | | `scrapedAt` | string | ISO timestamp of data collection | ### Tips for Best Results - **Start small to verify, then scale.** Set `maxResults` to 20–100 on your first run to confirm the data matches your needs, then raise the cap or set it to `0` for everything. - **Use `Biggest discount` to surface clearance.** The `percentageDiscount-desc` sort order puts the deepest markdowns at the top — ideal for deal feeds and clearance tracking. - **Pair `brand` with `inStockOnly` for a clean competitor catalog.** A single brand name plus the in-stock toggle gives you a sellable, deduplicated assortment with no sold-out clutter. - **Prefer keyword search for category coverage.** Pasting a category page works, but typing the category keyword into `searchTerms` (e.g. `kaffee`) reliably returns the fullest set of products for that category. - **Combine many terms in one run.** Add several keywords to `searchTerms` to cover a whole product area at once — `maxResults` is a single total cap across all of them. - **Sort by `Newest` to catch launches.** The `firstOnlineDate-desc` order surfaces freshly added products first, perfect for new-arrival monitoring. - **Enter brand names exactly as Lidl shows them.** Lidl's own brands are typically uppercase (`SILVERCREST`, `PARKSIDE`, `KRUPS`); match the casing for a clean filter. ### Pricing **From $2.50 per 1,000 results** — priced below comparable Lidl product collectors on the market. Bronze, Silver, and Gold subscribers pay progressively less; the table below shows total cost at each discount tier. | Results | No discount | Bronze | Silver | Gold | |---------|-------------|--------|--------|------| | 100 | $0.30 | $0.28 | $0.27 | $0.25 | | 1,000 | $3.00 | $2.80 | $2.65 | $2.50 | | 10,000 | $30.00 | $28.00 | $26.50 | $25.00 | | 100,000 | $300.00 | $280.00 | $265.00 | $250.00 | A "result" is any product row in the output dataset. No compute or time-based charges — you pay per result, plus a small fixed per-run start fee. ### Integrations Export data in JSON, CSV, Excel, XML, or RSS. Connect to 1,500+ apps via: - **Zapier** / **Make** / **n8n** — Workflow automation - **Google Sheets** — Direct spreadsheet export - **Slack** / **Email** — Notifications on new results - **Webhooks** — Trigger custom APIs on run completion - **Apify API** — Full programmatic access ### Legal & Ethical Use This actor is designed for legitimate price monitoring, market research, and competitive analysis of publicly available Lidl.de product listings. Users are responsible for complying with applicable laws and Lidl's Terms of Service. Do not use collected data for spam, harassment, or any illegal purpose. Only publicly available product information is collected — no personal data and no login-protected content. # Actor input Schema ## `searchTerms` (type: `array`): Type plain keywords to search Lidl.de for, such as 'kaffee', 'bohrmaschine' or 'bettwäsche'. We build the search for you — no need to create URLs. Add as many terms as you like. ## `startUrls` (type: `array`): Paste Lidl.de links directly: search result pages, category pages, or individual product pages. The type is detected automatically. Use this if you already have the exact pages you want. ## `maxResults` (type: `integer`): Maximum number of products to return in total, across all search terms and URLs. Set to 0 to collect everything available. Tip: start with 20-100 to test, then increase. ## `sortBy` (type: `string`): Order in which products are returned for keyword and category searches. 'Relevance' is the default Lidl ordering. ## `brand` (type: `string`): Only return products from a single brand (e.g. 'SILVERCREST', 'PARKSIDE', 'KRUPS'). Enter the brand name exactly as Lidl shows it. Leave empty to include all brands. ## `inStockOnly` (type: `boolean`): When on, only products that are currently available to order online are returned. ## Actor input object example ```json { "searchTerms": [ "kaffee" ], "startUrls": [], "maxResults": 100, "sortBy": "relevancy", "inStockOnly": false } ``` # Actor output Schema ## `overview` (type: `string`): Table of scraped Lidl products with title, brand, price, category, ratings and stock. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchTerms": [ "kaffee" ], "startUrls": [], "maxResults": 100, "sortBy": "relevancy" }; // Run the Actor and wait for it to finish const run = await client.actor("solidcode/lidl-de-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchTerms": ["kaffee"], "startUrls": [], "maxResults": 100, "sortBy": "relevancy", } # Run the Actor and wait for it to finish run = client.actor("solidcode/lidl-de-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchTerms": [ "kaffee" ], "startUrls": [], "maxResults": 100, "sortBy": "relevancy" }' | apify call solidcode/lidl-de-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=solidcode/lidl-de-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Lidl Germany Product Scraper", "description": "[💰 $2.5 / 1K] Scrape products from Lidl Germany (lidl.de) — titles, brands, prices with discounts, images, categories, ratings and stock. Search by keyword or paste search, category, and product URLs.", "version": "1.0", "x-build-id": "B8f93TOAtjGbyPIbR" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/solidcode~lidl-de-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-solidcode-lidl-de-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/solidcode~lidl-de-scraper/runs": { "post": { "operationId": "runs-sync-solidcode-lidl-de-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/solidcode~lidl-de-scraper/run-sync": { "post": { "operationId": "run-sync-solidcode-lidl-de-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "searchTerms": { "title": "Search Terms", "type": "array", "description": "Type plain keywords to search Lidl.de for, such as 'kaffee', 'bohrmaschine' or 'bettwäsche'. We build the search for you — no need to create URLs. Add as many terms as you like.", "items": { "type": "string" } }, "startUrls": { "title": "Lidl URLs", "type": "array", "description": "Paste Lidl.de links directly: search result pages, category pages, or individual product pages. The type is detected automatically. Use this if you already have the exact pages you want.", "items": { "type": "string" } }, "maxResults": { "title": "Max Results", "minimum": 0, "type": "integer", "description": "Maximum number of products to return in total, across all search terms and URLs. Set to 0 to collect everything available. Tip: start with 20-100 to test, then increase." }, "sortBy": { "title": "Sort By", "enum": [ "relevancy", "price", "price-desc", "firstOnlineDate-desc", "ratingScore-desc", "sh_carts-desc", "percentageDiscount-desc" ], "type": "string", "description": "Order in which products are returned for keyword and category searches. 'Relevance' is the default Lidl ordering.", "default": "relevancy" }, "brand": { "title": "Brand", "type": "string", "description": "Only return products from a single brand (e.g. 'SILVERCREST', 'PARKSIDE', 'KRUPS'). Enter the brand name exactly as Lidl shows it. Leave empty to include all brands." }, "inStockOnly": { "title": "In-stock products only", "type": "boolean", "description": "When on, only products that are currently available to order online are returned.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```