Google Search Scraper

Extract standard Google web search results through the google-search116.p.rapidapi.com provider and save them as structured Apify dataset records.

This Actor supports only the provider's single basic search endpoint. It does not offer dedicated Images, Shopping, Scholar, Maps, Places, News, Videos, Autocomplete, or Patents searches.

What it extracts

By default, the dataset contains only:

• organic — regular Google results, including position, URL, title, description, date, and sitelinks when available

Enable includeRelatedKeywords to additionally store:

• related_keyword — related searches
• spelling_suggestion — a corrected query when present

Ads, top stories, and knowledge panels are not pushed to the dataset.

Every dataset item includes recordType, query, page, and raw. Common fields are also promoted to top-level columns for convenient CSV, Excel, and table exports. The untouched provider object in raw preserves fields that may be added by the API later.

Input

{
    "query": "Nike",
    "country": "US",
    "maxResults": 200,
    "parseAllResults": false,
    "includeRelatedKeywords": false,
    "hl": "en",
    "tbs": "qdr:m"
}

Field	Required	Description
query	Yes	Search query, including Google operators such as site:
maxResults	No	Maximum organic results to store, from 1 to 10,000; default 100
parseAllResults	No	Ignore maxResults and continue until the provider has no more results; default false
includeRelatedKeywords	No	Also store related keywords and spelling suggestions; default false
country	No	ISO 3166-1 alpha-2 country code; the provider derives gl and proxy_location unless overridden
gl	No	Explicit two-letter Google result country
hl	No	Google UI language such as en, fr, or zh-CN
tbs	No	Time filter such as qdr:d, qdr:w, or a Google custom date range
lr	No	Language restriction such as lang_en
cr	No	Country restriction such as countryUS
proxy_location	No	Explicit provider proxy region: us or ca

Pagination is automatic. The Actor selects an efficient provider page size, follows next_page or next_start, and trims the final page so capped runs never exceed maxResults. With parseAllResults: true, it continues until the provider returns no organic results or no next cursor. Repeated-cursor detection prevents accidental loops.

Output example

{
    "recordType": "organic",
    "query": "Nike",
    "page": 0,
    "position": 1,
    "url": "https://www.nike.com/",
    "title": "Nike. Just Do It. Nike.com",
    "description": "Inspiring the world's athletes, Nike delivers innovative products, experiences and services.",
    "sitelinks": [{ "title": "Women", "url": "https://www.nike.com/women" }],
    "raw": {
        "position": 1,
        "url": "https://www.nike.com/",
        "title": "Nike. Just Do It. Nike.com",
        "description": "Inspiring the world's athletes, Nike delivers innovative products, experiences and services.",
        "sitelinks": [{ "title": "Women", "url": "https://www.nike.com/women" }]
    }
}

By default, the dataset contains only organic results, so its item count matches the collected result count. If includeRelatedKeywords is enabled, related keyword records are added after each response. The OUTPUT key in the default key-value store contains a small run summary with processed page and record counts.

Reliability

Requests time out after 30 seconds. Network errors, timeouts, HTTP 408/409/425/429 responses, and common 5xx responses are retried up to five attempts with exponential backoff and jitter. The Actor honors the provider's Retry-After header (capped at 30 seconds). Permanent errors such as invalid credentials fail immediately so runs do not waste time or API quota.

The Actor validates all input before making an API request and handles Apify abort events so shutdown can complete promptly.

Configuration

Set the RapidAPI credential as the RAPIDAPI_KEY environment variable. It is sent only in the x-rapidapi-key request header and is never logged.

For local development:

$apify run

Local output is written under storage/; it is not uploaded to Apify Console. Cloud output is available after deploying and running the Actor on Apify.

Responsible use

Collect only publicly available data and comply with applicable laws, Google terms, and the RapidAPI provider's terms and quotas. Avoid collecting or using personal data without a lawful purpose.