What does Idealo Product Scraper do?

Idealo product scraper allows you to extract product data from the idealo.de authorping site. It gives you detailed product information in structured formats like JSON, which you can use in your own reports, spreadsheets, and applications. Idealo product scraper allows you to collect detailed product information from all countries where Idealo.de operates, including:

• ID
• URL
• Name
• Full Title
• Variant Title
• Brand
• Product Overview
• Description
• Image URL
• SKU
• GTIN
• Low Price
• High Price
• Currency
• Total Offers
• Top Offers
• Total Ratings
• Rating Score
• Detail
• Pros
• Cons

Input & Output

To start collecting Idealo.de product data, simply fill out the input form. Idealo product scraper recognizes the following input parameters:

• URLs - Links to product information pages, seller product listing pages, or product query pages via search, categories, etc. You can paste URLs one at a time or use the Bulk Edit section to add a prepared list.
• Scrape type - The type of link you just pasted includes: Get products by Queries and Get products by Specific product urls. Note: When using the Get products by Specific product urls option, the Total pages to scrape input parameters will have no effect.
• Total pages to scrape - If you use a product listing page path type, don't forget to fill in this field, which allows you to choose the total page when crawling from the product listing page.
• Limit the number of retries - Maximum number of retries when collecting data when an unexpected error occurs.
• Timeout on page load - Maximum waiting time when accessing the links you provided.
• Proxy configuration - Add a proxy to ensure that during the data collection process, you are not detected as a bot.

Idealo.de product scraper offers 3 different types of data collection, including:

1. Collect product data from product information pages

Example url: https://www.idealo.de/preisvergleich/OffersOfProduct/203473202_-af400eudbcp-ninja.html

Example Screenshot of product information page:

Input:

1{
2  "max_retries": 2, // Maximum waiting time when accessing the links you provided.
3  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
4    "useApifyProxy": true,
5    "apifyProxyGroups": [
6      "RESIDENTIAL" 
7    ],
8    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
9  },
10  "scrape_type": "specific_product_urls", // Get products by Specific product urls
11  "timeout": 5,
12  "urls": [ // Links to product information pages.
13    "https://www.idealo.de/preisvergleich/OffersOfProduct/203473202_-af400eudbcp-ninja.html"
14  ]
15}

Output:

You get the output from the Idealo.de product scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

1[ // List of product information
2  {
3    "id": "203473202",
4    "url": "https://www.idealo.de/preisvergleich/OffersOfProduct/203473202_-af400eudbcp-ninja.html",
5    "name": "Ninja AF400",
6    "full_title": "Ninja AF400 AF400EUDBCP",
7    "variant_title": "AF400EUDBCP",
8    "brand": "Ninja",
9    "product_overview": "Produktübersicht: 9,5 Liter  Fassungsvermögen Frittiergut 2,8 kg  2.470 Watt  Temperaturbereich bis 180 °C  mit Timer",
10    "description": "Bereits ab 269,90 € ✓ Große Shopvielfalt ✓ Testberichte & Meinungen ✓ | Jetzt Ninja  AF400EUDBCP  günstig kaufen bei idealo.de",
11    "image_url": [
12      "https://cdn.idealo.com/folder/Product/203473/2/203473202/s1_produktbild_gross/ninja-af400eudbcp.jpg"
13    ],
14    "sku": "0622356264518",
15    "gtin": "0622356264518",
16    "low_price": 269.9,
17    "high_price": 299.0,
18    "currency": "EUR",
19    "total_offers": 4,
20    "top_offers": [
21      {
22        "shop_name": "warenstube-bender.de",
23        "products": [
24          {
25            "id": 203473202,
26            "category": 3513,
27            "name": "Ninja AF400EUDBCP",
28            "price": 269.9
29          }
30        ],
31        "event": "leadout"
32      },
33      {
34        "shop_name": "ninjakitchen.de",
35        "products": [
36          {
37            "id": 203473202,
38            "category": 3513,
39            "name": "Ninja AF400EUDBCP",
40            "price": 269.99
41          }
42        ],
43        "event": "leadout"
44      },
45      {
46        "shop_name": "eBay",
47        "products": [
48          {
49            "id": 203473202,
50            "category": 3513,
51            "name": "Ninja AF400EUDBCP",
52            "price": 279.0
53          }
54        ],
55        "event": "leadout"
56      },
57      {
58        "shop_name": "otto.de (Marktplatzhändler)",
59        "products": [
60          {
61            "id": 203473202,
62            "category": 3513,
63            "name": "Ninja AF400EUDBCP",
64            "price": 299.0
65          }
66        ],
67        "event": "leadout"
68      }
69    ],
70    "total_ratings": null,
71    "rating_score": null,
72    "detail": [
73      {
74        "key": "Produkttypen",
75        "value": "Heißluftfritteuse, Doppelfritteuse"
76      },
77      {
78        "key": "Serien",
79        "value": "Ninja Foodi, Ninja Foodi MAX"
80      },
81      {
82        "key": "Fassungsvermögen",
83        "value": "9,5 Liter"
84      },
85      {
86        "key": "Fassungsvermögen Frittiergut",
87        "value": "2,8 kg"
88      },
89      {
90        "key": "Zubereitungsarten",
91        "value": "Backen, Braten, Kochen, ohne Fett, Dörren, Erwärmen"
92      },
93      {
94        "key": "Bedienelemente",
95        "value": "Tasten"
96      },
97      {
98        "key": "Sicherheitseinrichtungen",
99        "value": "Kontrollleuchte, Anti-Rutsch-Füße, wärmeisolierter Griff"
100      },
101      {
102        "key": "Ausstattungen",
103        "value": "Ein-/Ausschalter, abnehmbarer Frittierkorb, abnehmbares Zubehör"
104      },
105      {
106        "key": "Funktionen",
107        "value": "Timer"
108      },
109      {
110        "key": "Anzeigen",
111        "value": "LED, mit Display"
112      },
113      {
114        "key": "Form",
115        "value": "rechteckig"
116      },
117      {
118        "key": "Farbe",
119        "value": "schwarz"
120      },
121      {
122        "key": "Material",
123        "value": "Metall"
124      },
125      {
126        "key": "Breite",
127        "value": "41,5 cm"
128      },
129      {
130        "key": "Höhe",
131        "value": "32,5 cm"
132      },
133      {
134        "key": "Tiefe",
135        "value": "27 cm"
136      },
137      {
138        "key": "Gewicht",
139        "value": "8,8 kg"
140      },
141      {
142        "key": "Leistung (W)",
143        "value": "2.470 Watt"
144      },
145      {
146        "key": "Anzahl der Automatikprogramme",
147        "value": "6"
148      },
149      {
150        "key": "Temperaturbereich",
151        "value": "bis 180 °C"
152      },
153      {
154        "key": "Betriebsspannung",
155        "value": "220 - 240 V"
156      },
157      {
158        "key": "Netzabsicherung",
159        "value": "16 A"
160      },
161      {
162        "key": "Frequenz",
163        "value": "50 Hz"
164      }
165    ],
166    "pros": [
167      "großes Fassungsvermögen",
168      "2 synchronisierbare Garschubladen",
169      "breiter Temperaturbereich"
170    ],
171    "cons": [
172      "keine App-Konnektivität",
173      "keine komplett vorkonfigurierten Garprogramme"
174    ],
175    "from_url": null,
176    "page": null
177  }, // ... Many other product details
178]

2. Collect product data from products by Queries

Example url: "https://www.idealo.de/preisvergleich/ProductCategory/3513I16-705.html",

Example Screenshot of Author product list page:

Input:

1{
2  "max_retries": 2, // Maximum waiting time when accessing the links you provided.
3  "total_pages_to_scrape": 10, // Total page you want scrape
4  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
5    "useApifyProxy": true,
6    "apifyProxyGroups": [
7      "RESIDENTIAL" 
8    ],
9    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
10  },
11  "scrape_type": "product_list_by_query", // Get products by Specific product urls
12  "timeout": 5,
13  "urls": [ // List of product list page from query urls
14    "https://www.idealo.de/preisvergleich/ProductCategory/3513I16-705.html"
15  ],
16}

Output:

You get the output from the Idealo.de product scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

1[
2  {
3    "id": "204292302",
4    "url": "https://www.idealo.de/preisvergleich/OffersOfProduct//204292302",
5    "name": null,
6    "full_title": "Ninja AF400",
7    "variant_title": null,
8    "brand": null,
9    "product_overview": "Heißluftfritteuse, 9,5 Liter, Fassungsvermögen Frittiergut 2,8 kg, 2.470 Watt, Temperaturbereich bis 180 °C, mit Timer",
10    "description": null,
11    "image_url": "https://cdn.idealo.com/folder/Product/204292/3/204292302/s1_produktbild_mittelgross/ninja-af400.jpg",
12    "sku": null,
13    "gtin": null,
14    "low_price": 159.99,
15    "high_price": 159.99,
16    "currency": "€",
17    "total_offers": 80,
18    "top_offers": null,
19    "total_ratings": 20,
20    "rating_score": 2.4,
21    "detail": null,
22    "pros": null,
23    "cons": null,
24    "from_url": "https://www.idealo.de/preisvergleich/ProductCategory/3513I16-705.html", // Which url are the products crawled from
25    "page": 1 // Which page are the products crawled from
26  }, // ... Many other product details
27]

How can I use the data extracted from Idealo.de with Idealo.de Product Scraper?

1💙 Increase brand awareness.
2📈 Analyze upcoming trends and influences of product categories or Brands, Sellers.
3🔬 Get data for research and testing.
4⭐ NCount and score authentic product reviews and back up sentiment analysis with real data.
5🪧 Plan commercial campaigns on Idealo.de or other sales platforms. 
6📚 Simplify market research and marketing campaigns.
7📋 Get a list of perfectly matched marketing leads.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Idealo.de product scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.