# Google Trends & Shopping Scraper — Search Data & Prices (`oneary/google-trends-google-shopping-price-intelligence`) Actor Scrape Google Trends for rising search queries and hot topics, plus Google Shopping for product prices and merchant data. Ideal for market research and competitive pricing analysis. - **URL**: https://apify.com/oneary/google-trends-google-shopping-price-intelligence.md - **Developed by:** [Luan M.](https://apify.com/oneary) (community) - **Categories:** SEO tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Google Trends & Google Shopping Price Intelligence Google Trends + Shopping — search trends & price intelligence ### Overview 📊 Dual-mode intelligence tool — scrape Google Trends for search interest, related queries, regional data, and rising terms. Switch to Google Shopping mode for product prices, merchant names, ratings, shipping info, and price range comparisons. ### Key Features - **Full Data Extraction** -- Complete structured data from target web pages - **Proxy Support** -- Built-in Apify proxy for reliable, geotargeted scraping - **Cookie Consent** -- Automatic cookie consent dialog dismissal - **Error Handling** -- Robust retry logic with configurable retry limits - **Structured Output** -- Clean JSON/CSV output via Apify dataset - **Scheduled Runs** -- Compatible with Apify schedule and webhook system ### Quick Start #### Input Parameters | Parameter | Type | Required | Default | Description | |-----------|------|----------|---------|-------------| | startUrls | Array of Objects | No | [] | Initial URLs to start scraping from | | maxResults | Number | No | 100 | Maximum items to return | | proxyConfiguration | Object | No | Apify proxy | Proxy configuration for geotargeting | #### Example Input ```json {"startUrls": [], "maxResults": 100, "proxyConfiguration": {}} ```` #### Output Format Results are stored in the Apify default dataset as structured JSON, with each record containing scraped data fields. Export to JSON, CSV, Excel, or XML from the Apify Console. ### Pricing - **$0.50 per 1,000 results** - New accounts get $5 free platform credit - Volume discounts available on Scale ($199/mo) and Business ($999/mo) plans - Pay only for what you use -- no monthly commitments required ### Anti-Blocking & Reliability - Built-in Apify proxy network with residential and datacenter IPs - Automatic retry on failure (up to 3 retries with exponential backoff) - Cookie consent dialog dismissal for clean page rendering - Headless browser fingerprint randomization ### Output & Integrations - **Export formats:** JSON, CSV, Excel, XML - **Integrations:** Zapier, Make (Integromat), webhooks, Google Sheets - **Scheduling:** Run on cron schedules via Apify Console - **Webhooks:** Real-time data delivery on completion ### Technical Details - **Runtime:** Node.js 18+ - **Engine:** Crawlee v3 + Playwright - **Browser:** Chromium (headless) - **Deployment:** Ready to run on Apify platform - **License:** Apache-2.0 *** *Built with <3 for the Apify ecosystem | Apify Store: https://apify.com/oneary* # Actor input Schema ## `mode` (type: `string`): Select data source: 'shopping' for Google Shopping price intelligence, 'trends' for Google Trends data ## `searchQuery` (type: `string`): Product or keyword to search (e.g., 'laptop', 'iPhone 15', 'Nike sneakers') ## `maxResults` (type: `integer`): Maximum number of products or trend data points to scrape ## `country` (type: `string`): Google country code for localized results (e.g., 'us', 'uk', 'de', 'fr') ## `language` (type: `string`): Search language (e.g., 'en', 'es', 'de') ## `includeMerchantDetails` (type: `boolean`): Include merchant names, ratings, and shipping info (Shopping mode only) ## `includePriceHistory` (type: `boolean`): Attempt to extract price history data if available ## `trendsTimeRange` (type: `string`): Time range for Google Trends data (e.g., 'today 12-m', 'today 3-m', 'today 1-m', 'now 7-d', 'now 1-d') ## `trendsCategory` (type: `string`): Google Trends category ID (e.g., 'all' for all categories, '0' for default) ## `proxyConfiguration` (type: `object`): Proxy configuration for scraping ## Actor input object example ```json { "mode": "shopping", "searchQuery": "laptop", "maxResults": 50, "country": "us", "language": "en", "includeMerchantDetails": true, "includePriceHistory": false, "trendsTimeRange": "today 12-m", "trendsCategory": "all" } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("oneary/google-trends-google-shopping-price-intelligence").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("oneary/google-trends-google-shopping-price-intelligence").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call oneary/google-trends-google-shopping-price-intelligence --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=oneary/google-trends-google-shopping-price-intelligence", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Google Trends & Shopping Scraper — Search Data & Prices", "description": "Scrape Google Trends for rising search queries and hot topics, plus Google Shopping for product prices and merchant data. Ideal for market research and competitive pricing analysis.", "version": "0.1", "x-build-id": "t1LWz8DLRgP3grV4n" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/oneary~google-trends-google-shopping-price-intelligence/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-oneary-google-trends-google-shopping-price-intelligence", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/oneary~google-trends-google-shopping-price-intelligence/runs": { "post": { "operationId": "runs-sync-oneary-google-trends-google-shopping-price-intelligence", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/oneary~google-trends-google-shopping-price-intelligence/run-sync": { "post": { "operationId": "run-sync-oneary-google-trends-google-shopping-price-intelligence", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchQuery", "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "shopping", "trends" ], "type": "string", "description": "Select data source: 'shopping' for Google Shopping price intelligence, 'trends' for Google Trends data", "default": "shopping" }, "searchQuery": { "title": "Search Query", "type": "string", "description": "Product or keyword to search (e.g., 'laptop', 'iPhone 15', 'Nike sneakers')", "default": "laptop" }, "maxResults": { "title": "Max Results", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of products or trend data points to scrape", "default": 50 }, "country": { "title": "Country Code", "type": "string", "description": "Google country code for localized results (e.g., 'us', 'uk', 'de', 'fr')", "default": "us" }, "language": { "title": "Language", "type": "string", "description": "Search language (e.g., 'en', 'es', 'de')", "default": "en" }, "includeMerchantDetails": { "title": "Include Merchant Details", "type": "boolean", "description": "Include merchant names, ratings, and shipping info (Shopping mode only)", "default": true }, "includePriceHistory": { "title": "Include Price History", "type": "boolean", "description": "Attempt to extract price history data if available", "default": false }, "trendsTimeRange": { "title": "Trends Time Range", "type": "string", "description": "Time range for Google Trends data (e.g., 'today 12-m', 'today 3-m', 'today 1-m', 'now 7-d', 'now 1-d')", "default": "today 12-m" }, "trendsCategory": { "title": "Trends Category", "type": "string", "description": "Google Trends category ID (e.g., 'all' for all categories, '0' for default)", "default": "all" }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Proxy configuration for scraping" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```