Lidl Product Scraper

What does Lidl Product Scraper do?

Collect comprehensive product data from Lidl US including prices, images, GTINs, stock status, merchandising details, and full product descriptions. Provide a Lidl search URL, product listing, product detail page, or a keyword, and the Actor returns structured product records ready for analysis, monitoring, or database enrichment.

Why use Lidl Product Scraper?

• Structured product datasets - Collect clean product records with pricing, dimensions, ingredients, allergens, identifiers, and images without manual copy-paste.
• Automation-ready output - Export results to JSON, CSV, Excel, XML, or connect them to Google Sheets, Airtable, Make, or Zapier.
• Price and stock monitoring - Track current, regular, promotional, myLidl member, and upcoming prices across repeated runs.
• Use-case fit - Supports price monitoring, assortment analysis, product research, and catalog enrichment workflows.

What data can you extract from Lidl US?

Field	Description
name	Product name
current_price	Current selling price
regular_price	Regular price
promotion_price	Promotional price
myLidl_price	myLidl member price
upcoming_price	Upcoming price
currency	Currency code
gtin	Primary GTIN
stock_status_code	Stock status (INSTOCK, etc.)
product_url	Lidl product detail page
primary_image_url	Main product image
description	Short package description
allergens	Listed allergens
ingredients	Listed ingredients
origin_country	Country of origin
brand_names	Brand names
merchandising_module	In-store module description

How to use Lidl Product Scraper

1. Open the Actor on Apify Store.
2. Provide a Lidl URL or a search keyword.
3. Set the result limit and optional page cap.
4. Run the Actor.
5. Download the dataset or connect it to your workflow.

Input Parameters

Parameter	Type	Required	Default	Description
url	String	No	https://www.lidl.com/search/products/milk	Lidl search URL, product list URL, product detail URL, or supported mobile API URL
keyword	String	No	milk	Search term used when url is not provided
results_wanted	Integer	No	20	Maximum number of products to collect
max_pages	Integer	No	5	Safety cap for paginated requests

At least one of url or keyword must be supplied. When both are provided, url takes priority.

Output Data

Each dataset item may contain these fields. Fields without actual values are omitted from your output.

Field	Type	Description
rank	Integer	Position in the collected output
source_type	String	Input mode used for this record
source_url	String	Lidl page or API source
source_keyword	String	Search keyword when applicable
source_total_results	Integer	Total results from the source
store_id	String	Store identifier for pricing context
product_id	String	Lidl product identifier
item_id	String	Lidl item identifier
product_url	String	Lidl product detail page
name	String	Product name
gtin	String	Primary GTIN
alternative_gtins	Array	Additional GTIN values
description	String	Short package description
long_description_html	String	Rich product description
long_description_text	String	Plain text description
primary_image_url	String	Main product image
image_urls	Array	All product images
image_ids	Array	Image asset identifiers
category_ids	Array	Category identifiers
brand_names	Array	Brand names
quantity	Number	Package quantity
package_type	String	Package type code
weight	Number	Product weight
height	Number	Product height
length	Number	Product length
volume	Number	Product volume
origin_country	String	Country of origin
origin_region	String	Region of origin
allergens	Array	Listed allergens
ingredients	Array	Listed ingredients
current_price	Number	Current selling price
regular_price	Number	Regular price
promotion_price	Number	Promotional price
mylidl_price	Number	myLidl member price
upcoming_price	Number	Upcoming price
currency	String	Currency code
base_price_text	String	Per-unit price text
base_quantity_value	Number	Base quantity for pricing
base_quantity_unit	String	Base quantity unit
current_price_type	String	Price type (REGULAR, PROMOTION)
current_price_start_date	String	Price effective start date
current_price_end_date	String	Price effective end date
stock_status_code	String	Stock status (INSTOCK, etc.)
merchandising_module	String	In-store module description
aisle	Number	Aisle placement
tags	Array	Product tags
contains_alcohol	Boolean	Alcohol content flag
bogo_info	Object	Buy-one-get-one details

Usage Examples

Search by Keyword

Collect products matching a search term:

{
    "keyword": "organic milk",
    "results_wanted": 20,
    "max_pages": 3
}

Start from a Lidl Search URL

Use a specific search results page:

{
    "url": "https://www.lidl.com/search/products/milk",
    "results_wanted": 30,
    "max_pages": 4
}

Collect a Product Listing

Get all products from a category listing:

{
    "url": "https://www.lidl.com/products?category=all&sort=productAtoZ",
    "results_wanted": 50,
    "max_pages": 2
}

Single Product Detail

Get full data for one product:

{
    "url": "https://www.lidl.com/products/1257738"
}

Sample Output

{
    "rank": 1,
    "source_type": "searchUrl",
    "source_url": "https://www.lidl.com/search/products/milk",
    "source_keyword": "milk",
    "store_id": "US01053",
    "product_id": "1257738",
    "product_url": "https://www.lidl.com/products/1257738",
    "name": "fairlife fat free ultra-filtered milk",
    "gtin": "0856312002757",
    "description": "52 fl. oz.",
    "current_price": 5.32,
    "regular_price": 5.32,
    "currency": "USD",
    "base_price_text": "10.2 cents per fl.oz.",
    "stock_status_code": "INSTOCK",
    "merchandising_module": "Chiller",
    "aisle": 1,
    "primary_image_url": "https://production-endpoint.azureedge.net/images/74P32D1G6LFJAC1GF0QJ0C0/93d23a72-a4aa-4cd7-854d-dde284a7574e/921405_500x500_500x500.tif.jpg",
    "contains_alcohol": false
}

Tips for Best Results

• Start with a smaller result limit on your first run to verify the output matches your needs. Increase limits after confirming field coverage.
• Use search URLs for keyword-focused extractions, product listing URLs for broad category coverage, and product detail URLs for individual product lookups.
• Set max_pages as a safety limit to prevent overly long runs. Adjust both results_wanted and max_pages to balance runtime against data volume.
• Some fields may be empty when the source page does not publish that information. Check multiple results before assuming the Actor failed.

Integrations

• Google Sheets - Build trackable pricing and product spreadsheets.
• Airtable - Create searchable product databases.
• Make - Design automated monitoring workflows.
• Zapier - Route product updates into your business tools.
• Webhooks - Forward datasets into custom pipelines.
• API - Access datasets programmatically from your own systems.

Export Formats

• JSON - For APIs, scripts, and programmatic use.
• CSV - For spreadsheet-based analysis.
• Excel - For business reporting and charting.
• XML - For external system integrations.

Frequently Asked Questions

Can I search by keyword instead of URL?

Yes. Provide the keyword field with any search term, and the Actor collects results from Lidl search.

Which Lidl page types are supported?

Search pages, product listing pages with categories, product detail pages, and the equivalent mobile API URLs all work with this Actor.

What happens when both url and keyword are set?

The url field takes priority. This lets you use a specific page while still having the keyword available for reference.

How many products can I collect?

There is no hard limit. Use results_wanted to cap the total, and max_pages to limit how many paginated requests the Actor makes.

Are empty or null fields included in the output?

No. Fields without real values are omitted before storage so your exports stay clean and focused.

Does this work with Lidl stores outside the US?

The Actor defaults to the US store context. Different store IDs may produce results for other Lidl markets, but US is the primary target.

How fast does the Actor complete?

With default settings (20 results), it typically finishes in seconds. Larger collections scale predictably with the number of pages needed.

Can I schedule regular runs?

Yes. Apify schedules let you run this Actor daily or weekly to track pricing and availability changes over time.

What pricing data is available?

Current price, regular price, promotional price, myLidl member price, upcoming price, and per-unit base price text are all captured when available.

Is product availability included?

Yes. The stock_status_code field indicates whether the product is in stock, and merchandising placement details are included.

Can I export the data to CSV or Excel?

Yes. Apify datasets can be downloaded in CSV, Excel, JSON, XML, and other supported formats.

Is this Actor suitable for non-technical users?

Yes. The Actor can be run from Apify Console with form-based inputs, and the output can be downloaded without writing code.

Is it legal to scrape Lidl?

Scraping public web data can be legal, but you are responsible for complying with applicable laws, website terms, and privacy rules.

Related Actors

• Zepto Product Scraper - Collect product data from Zepto's quick commerce platform.
• Apify Store Scraper - Extract data from the Apify Store marketplace.

Support

For issues, feature requests, or custom Actor work, use the Issues tab on the Actor page or contact the developer through Apify.

Legal Notice

This Actor is designed for legitimate data collection from publicly available sources. Users are responsible for using the data responsibly and complying with applicable laws and Lidl's terms of service.