1 day trial then $3.00/month - No credit card required now

Scrape product data from any e-commerce site

eloquent_mountain/scrape-product-data-from-any-e-commerce-site

1 day trial then $3.00/month - No credit card required now

Scrapes e-commerce product data from any (e-commerce) website that has a dataLayer object (mostly used in google analytics implementations). It returns all product data in multiple data formats. Also available as an API to integrate with your own or other products. Circumvents the Cookie wall.

You can access the Scrape product data from any e-commerce site programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1{
2  "openapi": "3.0.1",
3  "info": {
4    "version": "0.0",
5    "x-build-id": "1Am6rnbaTwtSvlZp2"
6  },
7  "servers": [
8    {
9      "url": "https://api.apify.com/v2"
10    }
11  ],
12  "paths": {
13    "/acts/eloquent_mountain~scrape-product-data-from-any-e-commerce-site/run-sync-get-dataset-items": {
14      "post": {
15        "operationId": "run-sync-get-dataset-items-eloquent_mountain-scrape-product-data-from-any-e-commerce-site",
16        "x-openai-isConsequential": false,
17        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
18        "tags": [
19          "Run Actor"
20        ],
21        "requestBody": {
22          "required": true,
23          "content": {
24            "application/json": {
25              "schema": {
26                "$ref": "#/components/schemas/inputSchema"
27              }
28            }
29          }
30        },
31        "parameters": [
32          {
33            "name": "token",
34            "in": "query",
35            "required": true,
36            "schema": {
37              "type": "string"
38            },
39            "description": "Enter your Apify token here"
40          }
41        ],
42        "responses": {
43          "200": {
44            "description": "OK"
45          }
46        }
47      }
48    },
49    "/acts/eloquent_mountain~scrape-product-data-from-any-e-commerce-site/runs": {
50      "post": {
51        "operationId": "runs-sync-eloquent_mountain-scrape-product-data-from-any-e-commerce-site",
52        "x-openai-isConsequential": false,
53        "summary": "Executes an Actor and returns information about the initiated run in response.",
54        "tags": [
55          "Run Actor"
56        ],
57        "requestBody": {
58          "required": true,
59          "content": {
60            "application/json": {
61              "schema": {
62                "$ref": "#/components/schemas/inputSchema"
63              }
64            }
65          }
66        },
67        "parameters": [
68          {
69            "name": "token",
70            "in": "query",
71            "required": true,
72            "schema": {
73              "type": "string"
74            },
75            "description": "Enter your Apify token here"
76          }
77        ],
78        "responses": {
79          "200": {
80            "description": "OK",
81            "content": {
82              "application/json": {
83                "schema": {
84                  "$ref": "#/components/schemas/runsResponseSchema"
85                }
86              }
87            }
88          }
89        }
90      }
91    },
92    "/acts/eloquent_mountain~scrape-product-data-from-any-e-commerce-site/run-sync": {
93      "post": {
94        "operationId": "run-sync-eloquent_mountain-scrape-product-data-from-any-e-commerce-site",
95        "x-openai-isConsequential": false,
96        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
97        "tags": [
98          "Run Actor"
99        ],
100        "requestBody": {
101          "required": true,
102          "content": {
103            "application/json": {
104              "schema": {
105                "$ref": "#/components/schemas/inputSchema"
106              }
107            }
108          }
109        },
110        "parameters": [
111          {
112            "name": "token",
113            "in": "query",
114            "required": true,
115            "schema": {
116              "type": "string"
117            },
118            "description": "Enter your Apify token here"
119          }
120        ],
121        "responses": {
122          "200": {
123            "description": "OK"
124          }
125        }
126      }
127    }
128  },
129  "components": {
130    "schemas": {
131      "inputSchema": {
132        "type": "object",
133        "required": [
134          "start_urls"
135        ],
136        "properties": {
137          "start_urls": {
138            "title": "URL's to scrape",
139            "type": "array",
140            "description": "List of pages (from the same website) that you wish to scrape the product data from ",
141            "items": {
142              "type": "object",
143              "required": [
144                "url"
145              ],
146              "properties": {
147                "url": {
148                  "type": "string",
149                  "title": "URL of a web page",
150                  "format": "uri"
151                }
152              }
153            }
154          },
155          "cookie_accept": {
156            "title": "CSS selector for Cookie accept button click",
157            "type": "string",
158            "description": "Some websites only create the dataLayer object after cookies have been accepted. If your scrape results in zero output, then that's likely the case. \n \n 1. Open the website you wish to scrape in INCOGNITO. \n 2. Right- click on 'accept' button of cookie wall and click 'inspect element'. \n 3. Right- click on the highlighted element and Copy (css) selector. \n 4. Paste it in below field. "
159          }
160        }
161      },
162      "runsResponseSchema": {
163        "type": "object",
164        "properties": {
165          "data": {
166            "type": "object",
167            "properties": {
168              "id": {
169                "type": "string"
170              },
171              "actId": {
172                "type": "string"
173              },
174              "userId": {
175                "type": "string"
176              },
177              "startedAt": {
178                "type": "string",
179                "format": "date-time",
180                "example": "2025-01-08T00:00:00.000Z"
181              },
182              "finishedAt": {
183                "type": "string",
184                "format": "date-time",
185                "example": "2025-01-08T00:00:00.000Z"
186              },
187              "status": {
188                "type": "string",
189                "example": "READY"
190              },
191              "meta": {
192                "type": "object",
193                "properties": {
194                  "origin": {
195                    "type": "string",
196                    "example": "API"
197                  },
198                  "userAgent": {
199                    "type": "string"
200                  }
201                }
202              },
203              "stats": {
204                "type": "object",
205                "properties": {
206                  "inputBodyLen": {
207                    "type": "integer",
208                    "example": 2000
209                  },
210                  "rebootCount": {
211                    "type": "integer",
212                    "example": 0
213                  },
214                  "restartCount": {
215                    "type": "integer",
216                    "example": 0
217                  },
218                  "resurrectCount": {
219                    "type": "integer",
220                    "example": 0
221                  },
222                  "computeUnits": {
223                    "type": "integer",
224                    "example": 0
225                  }
226                }
227              },
228              "options": {
229                "type": "object",
230                "properties": {
231                  "build": {
232                    "type": "string",
233                    "example": "latest"
234                  },
235                  "timeoutSecs": {
236                    "type": "integer",
237                    "example": 300
238                  },
239                  "memoryMbytes": {
240                    "type": "integer",
241                    "example": 1024
242                  },
243                  "diskMbytes": {
244                    "type": "integer",
245                    "example": 2048
246                  }
247                }
248              },
249              "buildId": {
250                "type": "string"
251              },
252              "defaultKeyValueStoreId": {
253                "type": "string"
254              },
255              "defaultDatasetId": {
256                "type": "string"
257              },
258              "defaultRequestQueueId": {
259                "type": "string"
260              },
261              "buildNumber": {
262                "type": "string",
263                "example": "1.0.0"
264              },
265              "containerUrl": {
266                "type": "string"
267              },
268              "usage": {
269                "type": "object",
270                "properties": {
271                  "ACTOR_COMPUTE_UNITS": {
272                    "type": "integer",
273                    "example": 0
274                  },
275                  "DATASET_READS": {
276                    "type": "integer",
277                    "example": 0
278                  },
279                  "DATASET_WRITES": {
280                    "type": "integer",
281                    "example": 0
282                  },
283                  "KEY_VALUE_STORE_READS": {
284                    "type": "integer",
285                    "example": 0
286                  },
287                  "KEY_VALUE_STORE_WRITES": {
288                    "type": "integer",
289                    "example": 1
290                  },
291                  "KEY_VALUE_STORE_LISTS": {
292                    "type": "integer",
293                    "example": 0
294                  },
295                  "REQUEST_QUEUE_READS": {
296                    "type": "integer",
297                    "example": 0
298                  },
299                  "REQUEST_QUEUE_WRITES": {
300                    "type": "integer",
301                    "example": 0
302                  },
303                  "DATA_TRANSFER_INTERNAL_GBYTES": {
304                    "type": "integer",
305                    "example": 0
306                  },
307                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
308                    "type": "integer",
309                    "example": 0
310                  },
311                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
312                    "type": "integer",
313                    "example": 0
314                  },
315                  "PROXY_SERPS": {
316                    "type": "integer",
317                    "example": 0
318                  }
319                }
320              },
321              "usageTotalUsd": {
322                "type": "number",
323                "example": 0.00005
324              },
325              "usageUsd": {
326                "type": "object",
327                "properties": {
328                  "ACTOR_COMPUTE_UNITS": {
329                    "type": "integer",
330                    "example": 0
331                  },
332                  "DATASET_READS": {
333                    "type": "integer",
334                    "example": 0
335                  },
336                  "DATASET_WRITES": {
337                    "type": "integer",
338                    "example": 0
339                  },
340                  "KEY_VALUE_STORE_READS": {
341                    "type": "integer",
342                    "example": 0
343                  },
344                  "KEY_VALUE_STORE_WRITES": {
345                    "type": "number",
346                    "example": 0.00005
347                  },
348                  "KEY_VALUE_STORE_LISTS": {
349                    "type": "integer",
350                    "example": 0
351                  },
352                  "REQUEST_QUEUE_READS": {
353                    "type": "integer",
354                    "example": 0
355                  },
356                  "REQUEST_QUEUE_WRITES": {
357                    "type": "integer",
358                    "example": 0
359                  },
360                  "DATA_TRANSFER_INTERNAL_GBYTES": {
361                    "type": "integer",
362                    "example": 0
363                  },
364                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
365                    "type": "integer",
366                    "example": 0
367                  },
368                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
369                    "type": "integer",
370                    "example": 0
371                  },
372                  "PROXY_SERPS": {
373                    "type": "integer",
374                    "example": 0
375                  }
376                }
377              }
378            }
379          }
380        }
381      }
382    }
383  }
384}

Scrape any e-commerce website product data with a dataLayer OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Scrape product data from any e-commerce site from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Scrape product data from any e-commerce site API in Python

Scrape product data from any e-commerce site API in JavaScript

Scrape product data from any e-commerce site API through CLI

Scrape product data from any e-commerce site API

Developer

Paco

Actor Metrics

40 monthly users
2 bookmarks
>99% runs succeeded
3.2 days response time
Created in Jun 2023
Modified 2 months ago

Categories

E-commerce

🏯 Instagram Comments Scraper (Pay Per Result)

apidojo/instagram-comments-scraper

The Instagram Comments Scraper is the perfect tool for extracting comments from Instagram posts quickly and affordably. Priced at just $0.50 per 1,000 comments, it offers impressive speeds, processing 100 to 200 comments per second!

API Dojo

137

Zoominfo Scraper

ecomscrape/zoominfo-company-scraper

Zoominfo Scraper extracts detailed company data from Zoominfo, providing structured formats like JSON for reports, spreadsheets,.. It supports input via URLs or company names, proxy setup, and retries. Output includes revenue, address, industries, and more, ideal for market research and analysis.

ecomscrape

Google Maps Reviews Scraper

compass/Google-Maps-Reviews-Scraper

Extract all reviews of Google Maps places using place URLs. Get review text, published date, response from owner, review URL, and reviewer's details. Download scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Compass

6.4k

184

Facebook Ads Scraper

apify/facebook-ads-scraper

Extract advertising data from one or multiple Facebook Pages. Get page details, reach estimates, publisher platforms, report count, number of impressions, ad IDs, timestamps, and more. Download Facebook ads data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

6.2k

Amazon Reviews Scraper

junglee/amazon-reviews-scraper

Amazon scraper to extract reviews from Amazon products. Scrape and download detailed reviews without using the Amazon API, including rating score, review description, reactions and images. Download your data as HTML table, JSON, CSV, Excel, XML.

Junglee

3.9k

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

Facebook marketplace scraper

curious_coder/facebook-marketplace

Scrape facebook marketplace listings and export data to CSV, JSON or use as API

Curious Coder

750

Tiktok Shop Scraper

excavator/tiktok-shop-scraper

This is the Actor for crawling data from the TikTok shop product URLs. For example: https://shop.tiktok.com/view/product/XXXXXXXXXX These URLs are only available for TikTok Shop US. You can test it here: https://apify.com/excavator/tiktok-shop-product

Excavator

🔥Vinted Scraper

bebity/vinted-premium-actor

🚀 Vinted Data Scraper: Fast & Robust! 🔥 🛒 Items and catalogs 👥 User profiles with stats and balances 🏷️ Brands 🌟 Seamlessly integrate with Apify for unparalleled performance & insights. Elevate your business now!🌟 🔥 Power of direct API access for ultra-fast data extraction in a flash! ⚡

Bebity

184

Google Ads Scraper

silva95gustavo/google-ads-scraper

Extract text, image and video ads from Google Ads, scraped from the ad library provided by Google Ads Transparency Center. Gain access to ad details, ad copy, locations, and more. Dive deeper into the Google Ads Transparency Center for a competitive edge.