Consum Scraper

Scrapes products and prices from Consum's online supermarket. You can search the same way as on the website, download every product in a category, or both (the category then filters the search, like on the website), or download the whole catalogue.

Input

Set a search term, a category, or both — or leave both empty to scrape the whole catalogue.

Parameter	Options	Description
searchTerm	(optional) Text to search for	One search, like the search box on the website. Returns the same products, in the same order, as the website.
category	(optional) Category ID, e.g. 2811, or a category page URL	Every product in this category or subcategory, including all its subcategories. With a search term, keeps only the search results in this category.
productUrls	(optional) List of product-page URLs, e.g. https://tienda.consum.es/es/p/caretas-de-cerdo-origen-espana/100032	Detail mode. Fetches each product's detail (name, brand, description, format, images including the label photo) from its code endpoint instead of scraping a listing. Consum publishes no structured nutrition/ingredients — only as a label image. When set, searchTerm and category are ignored.

Example using a search query:

{
  "searchTerm": "leche condensada"
}

Example using a category (a pasted category URL works too):

{
  "category": "https://tienda.consum.es/es/c/despensa/aperitivos-frutos-secos/frutos-secos/nueces/1991"
}

Example searching inside a category (2073 is Condensada):

{
  "searchTerm": "leche",
  "category": "2073"
}

Example scraping product detail (takes product-page URLs, like the productData.url of listing rows):

{
  "productUrls": [
    "https://tienda.consum.es/es/p/caretas-de-cerdo-origen-espana/100032"
  ]
}

Categories

The root categories and their IDs. A subcategory's ID is the number at the end of its URL on the website, e.g. 1991 in /es/c/despensa/aperitivos-frutos-secos/frutos-secos/nueces/1991.

ID	Category
1239	Droguería y limpieza
1486	Bazar
1690	Bebidas
1783	Congelados y helados
1833	Platos preparados
2297	Infantil
2469	Mascotas
2811	Despensa
2812	Frescos
2814	Cuidado personal
4108	Horno
5281	Ecológico y saludable
99999	Ahora más barato

Output

• Dataset: one item per product, as Consum returns it. Search results also carry search_term. Sponsored products that Consum inserts into listings as ads are left out, so every product really matches the search or category. A product appears only once per run.
• Detail mode (productUrls): one item per product with code, ean, name, brand, description, format, images (incl. the ingredients/nutrition label photo), contains_allergens and url. Consum exposes no structured nutrition/ingredients text — only as that label image.
• FAILED_REQUESTS (key-value store, only when some requests failed): the URL and error of each failed page. If any page failed, the run fails rather than returning an incomplete dataset as a success.

Product fields

Values come as Consum sends them. Fields inside an object are written with a dot, e.g. productData.name.

Field	Description
code	Product code, as in the product page URL.
id	Internal product ID.
ean	EAN barcode.
productData.name, productData.description	Name, and name with size, e.g. Leche Condensada Entera Lata 1 Kg.
productData.brand	Brand (id, name).
productData.url, productData.imageURL	Product page and main image.
productData.availability, productData.temporaryOutOfStock	Availability code ("1" = available) and temporarily out of stock.
productData.novelty, productData.featured	New product, featured product.
productData.attributes, productData.attributeGroups	Product attributes, as codes and values.
priceData.prices	PRICE (regular) and, during an offer, OFFER_PRICE. In each, value.centAmount is the price in EUR (despite its name) and value.centUnitAmount the unit price.
priceData.unitPriceUnitType	The unit of the unit price, e.g. 1 Kg.
priceData.taxPercentage	VAT rate.
priceData.minimumUnit, priceData.maximumUnit, priceData.intervalUnit	Fewest and most units per order, and the quantity step.
offers	Active offers, e.g. Ahora más barato, with start and end dates.
categories	Categories the product is in (id, name). 999992811 means it is also in Ahora más barato.
media	All product images.
search_term	Search rows only: the search that returned the product.