Google Shopping

Features

Our Google Shopping Scraper crawls Google Shopping Search Results Pages and extracts data from the HTML in a structured format such as JSON, XML, CSV, or Excel.

The following data can be extracted from each Google Shopping results:

• Google Shopping Results
• Google Shopping Related Searches
• Google Shopping Filter Categories

Google Shopping Scraper

Our Google Shopping Scraper provides real-time results optimized for structured JSON output that you can download and use any way you want.

Why use a Google Shopping Scraper?

• ⚡️ Scrape Google shopping results fast and reliable.
• 👏 Scrape rich data(Almost all data on the screen and compare with other Actors)
• 💪 Actively maintaining. Fix all bugs within two days of business. Please email scrapeit37@gmail.com
• 🙌 Any feature requests, please email scrapeit37@gmail.com. We will implement for you.

Cost of usage

To scrape SERPs effectively, you should use Apify Proxy and you need to set a sufficient limit for Google Shopping Scraper queries (you can see the limit on your Account page).

New Apify users have a free trial of Apify Proxy, so you can use the actor for free at the beginning.

Once the Apify Proxy trial expires, you'll need to subscribe to a paid plan in order to keep using the actor. If you need to increase your Google Shopping Scraper limit on Apify Proxy or have any questions, please email support@apify.com

In terms of platform usage credits, it is our experience that you will get 1,000 results for about $0.25.

Number of results

The scraper will consume one Apify proxy per request, so you will make the best use of your proxies by getting the maximum 150 results per request.

The default number of results per page is 60. You can set resultsPerPage to get more results for each query.

Input settings

The actor gives you fine-grained control over what kind of Google Shopping results you'll get.

You can specify the following settings:

• Query phrases or URLs
• Country: the Google Shopping results data will be based on the country configuration.
• Language
• Device: Can be "desktop", "mobile" or "tablet".(No Actor offer this configuration)
• Filter Value: Can filter Google Shopping results by price, band... or sort by price,...
• Results Offset
• Results Per Page
• Save HTML: Include the Google Shopping HTML in JSON response

For a complete description of all settings, see input specification.

Results

The actor stores its result in the default dataset associated with the actor run, from which you can export it to various formats, such as JSON, XML, CSV, or Excel.

The results can be downloaded from the Get dataset items API endpoint:

https://api.apify.com/v2/datasets/[DATASET_ID]/items?format=[FORMAT]

where [DATASET_ID] is the ID of the dataset and [FORMAT] can be csv, html, xlsx, xml, rss or json.

For each Google Shopping results page, the dataset will contain a single record, which in JSON format looks as follows. Bear in mind that some fields have example values:

1{
2  "searchQuery": {
3    "query": "iphone",
4    "googleDomain": "google.com.au",
5    "countryCode": "au",
6    "resultsOffset": 60,
7    "resultsPerPage": 60
8  },
9  "url": "https://www.google.com/search?tbm=shop&q=iphone&oq=iphone&gl=au&num=60&sourceid=chrome&start=60&ie=UTF-8",
10  "googleShoppingResults": [
11    {
12      "title": "Apple iPhone 12 (64GB) - White",
13      "rank": 1,
14      "link": "https://www.amazon.com.au/Apple-iPhone-12-64GB-White/dp/B08L89SSXT?source=ps-sl-shoppingads-lpcontext&ref_=fplfs&psc=1&smid=ANEGB3WVEVKZB",
15      "itemSource": "Amazon.com.au",
16      "price": "$1,047.00",
17      "priceInNumber": 1047,
18      "rating": 4.5,
19      "reviews": 21482,
20      "extras": [
21        "Smartphone",
22        "Single SIM",
23        "5G"
24      ],
25      "badge": "Trusted store",
26      "thumbnail": "https://encrypted-tbn0.gstatic.com/shopping?q=tbn:ANd9GcQOnMuLp-VQkBA5xEEKvmjm4CLHClTWa-oNrCwbbK22JsGwaubO3mf1SQ8B_wVIm3bQWkzb64yz_vbSNnehuMac4OPa5oV1cznnuGOiY51O631rPo4JOK-s&usqp=CAE",
27      "delivery": "Free delivery"
28    },
29    {
30      "title": "Apple iphone 12 (64 GB ) Unlocked Green Pristine Condition",
31      "rank": 2,
32      "link": "https://www.smartcellular.com.au/apple-iphone-12-64-gb-unlocked-green-pristine",
33      "itemSource": "Smart Cellular AU",
34      "price": "$734.99",
35      "priceInNumber": 734.99,
36      "itemCondition": "refurbished",
37      "extras": [
38        "Smartphone",
39        "Single SIM",
40        "5G"
41      ],
42      "badge": "Trusted store",
43      "thumbnail": "https://encrypted-tbn3.gstatic.com/shopping?q=tbn:ANd9GcSaH-JHPIXh7Iv0FvbnQFKZaRuC-5HozZDcMx3MPjLFNI2l6hyLR8iq88j942wFamniu4fccmXVSLi1ml240YuewpmcnOM-2GNjF7uX1mg&usqp=CAE",
44      "delivery": "Free delivery and free 30-day returns"
45    },
46    {
47      "title": "Iphone 14 Cell Phones & Accessories | Iphone 14 256gb | Color: Blue | Size: Osau ...",
48      "rank": 3,
49      "link": "https://poshmark.com.au/listing/iPhone-14-256gb-63b0b89e83cbecbfc57a28cf#utm_source=gdm_unpaid",
50      "itemSource": "Poshmark Australia - Poshmark",
51      "price": "$800.00",
52      "priceInNumber": 800,
53      "itemCondition": "used",
54      "extras": [
55        "Smartphone",
56        "Single SIM"
57      ],
58      "thumbnail": "https://encrypted-tbn3.gstatic.com/shopping?q=tbn:ANd9GcRK-_2quDcfhOBEQpDVQTfOesuVNXgeygHaDpaq18slYV5Rx5pqkZELHGaAdklNAuQnYW3PRsD624hq1CYae_jbRKIkM3WvYJ36J9vdhtKI&usqp=CAE",
59      "delivery": "Free delivery"
60    },
61    {
62      "title": "Apple iPhone 13 Pro Max 1TB (Sierra Blue)",
63      "rank": 4,
64      "link": "https://www.phoneinc.com.au/products/mct-194252702024",
65      "shoppingItemLink": "https://www.google.com/shopping/product/7644620553108964193",
66      "shoppingItemId": "7644620553108964193",
67      "numberOfComparisons": "5+",
68      "comparisonLink": "https://www.google.com/shopping/product/7644620553108964193/offers?ie=UTF-8&sourceid=chrome&num=60&q=iphone&gl=au&prds=eto:17979002680265261239_0,pid:12014811213300533044,rsk:PC_8217023720749633348&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDergQI1Q4",
69      "itemSource": "Phoneinc",
70      "price": "$2,719.00",
71      "priceInNumber": 2719,
72      "rating": 4.7,
73      "reviews": 9842,
74      "extras": [
75        "Smartphone",
76        "Dual SIM",
77        "5G"
78      ],
79      "thumbnail": "https://encrypted-tbn1.gstatic.com/shopping?q=tbn:ANd9GcT2MDSQXQLHzoMevG790kDxUrrIEfKTFd7onY5yQchHNOIS-1uAvFTuaABkE8Fwa6NZuuNkCHlPtPYtOiT8N9R-CqbmqHSIX_2CY7ZmYacokrC_mgxGg5cE&usqp=CAE",
80      "delivery": "$11.95 delivery"
81    },
82    {
83      "title": "Apple iPhone 11 Pro - 4G smartphone - dual-SIM / Internal Memory 64 GB - OLED ...",
84      "link": "https://shop.belong.com.au/products/apple-iphone-11-pro",
85      "shoppingItemLink": "https://www.google.com/shopping/product/17354909519048587161",
86      "shoppingItemId": "17354909519048587161",
87      "numberOfComparisons": "10+",
88      "comparisonLink": "https://www.google.com/shopping/product/17354909519048587161/offers?ie=UTF-8&sourceid=chrome&num=60&q=iphone&gl=au&prds=eto:6961715401196997700_0,pid:4911945828394529540,rsk:PC_4343141063645219104&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDergQI6Q4",
89      "itemSource": "Belong",
90      "price": "$609.00",
91      "priceInNumber": 609,
92      "itemCondition": "refurbished",
93      "rating": 4.6,
94      "reviews": 9293,
95      "extras": [
96        "Smartphone",
97        "Dual SIM",
98        "4G"
99      ],
100      "badge": "Trusted store",
101      "thumbnail": "https://encrypted-tbn0.gstatic.com/shopping?q=tbn:ANd9GcQTXoUEr8SmhwVJHhgO-bao5HqMZVlE7vzAB7WvDC7zAg7rD9Hm9NQhIn-eaJZ8888Va_5wfWZlWW9TeZhwId6amsehjeb0J2dG477UsueE61BqdoV2uYU1&usqp=CAE",
102      "delivery": "Free delivery"
103    },
104  ],
105  "googleShoppingRelatedSearches": [
106    {
107      "text": "iphone amazon",
108      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+amazon&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiLFw"
109    },
110    {
111      "text": "iphone verizon",
112      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+verizon&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiNFw"
113    },
114    {
115      "text": "iphone new",
116      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+new&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiPFw"
117    },
118    {
119      "text": "iphone mobile",
120      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+mobile&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiRFw"
121    },
122    {
123      "text": "iphone refurbished",
124      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+refurbished&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiTFw"
125    },
126    {
127      "text": "iphone - apple",
128      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+-+apple&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiVFw"
129    },
130    {
131      "text": "iphone 1",
132      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+1&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiXFw"
133    },
134    {
135      "text": "iphone models",
136      "link": "https://www.google.com/search?gl=au&tbm=shop&q=iphone+models&sa=X&ved=0ahUKEwi9s7ao3-L9AhVkKFkFHVPiC0o4PBDbCwiZFw"
137    }
138  ]
139}

When using a tabular format such as csv or xls, you'll get a table where each row contains just one google shopping result. For more details about exporting and formatting the dataset records, please see the documentation for the Get dataset items API endpoint.

Personal data

You should be aware that search results can contain personal data. Personal data is protected by GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. You can also read our blog post on the legality of web scraping.

Changelog

v0.1- Launch

• Google Shopping Scraper is well-tested. We guarantee fixing all bugs within 2 days of business.