google search

# Google Search Scraper — SERP Results, Featured Snippets, People Also Ask

[![Apify Actor](https://img.shields.io/badge/Apify-Actor-1B82E6)](https://apify.com/your-username/google-search-scraper) [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)

A powerful and flexible Google Search scraper that extracts organic results, featured snippets, "People Also Ask" questions, and related searches. Perfect for SEO analysis, keyword research, and competitive intelligence.

## 🚀 Features

- **Organic Search Results** – Title, URL, domain, meta description, and displayed URL.
- **Featured Snippets** – Extracted when available (including position 0 results).
- **People Also Ask (PAA)** – Questions and links (future expansion can include answers).
- **Related Searches** – "Searches related to [keyword]" at the bottom of the page.
- **Pagination Support** – Scrape multiple pages via `max_results` parameter.
- **Language & Country Targeting** – Specify `language` (hl) and `country` (gl) for localised SERPs.
- **Residential Proxies** – Built-in Apify proxy with residential groups to avoid blocking.
- **Clean JSON Output** – Structured data ready for further processing.

## 📥 Input Schema

The actor accepts the following input via a JSON object:

| Field              | Type    | Required | Default          | Description                                                                                             |
| ------------------ | ------- | -------- | ---------------- | ------------------------------------------------------------------------------------------------------- |
| `proxyConfiguration` | object  | Yes      | Apify residential | Proxy settings – we strongly recommend using Apify proxy with `RESIDENTIAL` groups.                     |
| `query`            | string  | Yes      | –                | The search term to query Google with.                                                                   |
| `max_results`      | integer | No       | 10               | Maximum number of organic results to return (across pages). Rounds up to the nearest multiple of 10.   |
| `language`         | string  | No       | `en`             | Google interface language (hl parameter), e.g. `en`, `fr`, `de`.                                        |
| `country`          | string  | No       | `us`             | Country code for geolocation (gl parameter), e.g. `us`, `gb`, `in`.                                     |
### Example Input

```json
{
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  },
  "query": "best CRM software 2024",
  "max_results": 10,
  "language": "en",
  "country": "us"
}

📤 Output Format

The scraper returns an array of result objects. The first element is a summary object (type "summary") containing meta information about the search. The following elements are organic search results (type "organic" unless stated otherwise).

Summary Object

Field	Type	Description
type	string	Always "summary".
query	string	The search query used.
total_results	string	Estimated total number of results (as shown by Google).
featured_snippet	object | null	Featured snippet data if present (see below).
people_also_ask	array	List of "People Also Ask" questions (may include links/answers).
related_searches	array	List of related search phrases.

Featured Snippet Structure

When a featured snippet exists, it may contain:

Field	Type	Description
title	string	Title of the featured result.
url	string	Source URL.
domain	string	Domain name.
snippet	string	The extracted text snippet.
position	number	Always 0 (position zero).

Organic Result Object

Field	Type	Description
type	string	Usually "organic". May be omitted in output.
title	string	Title of the search result.
url	string	Direct link to the page.
domain	string	Domain extracted from the URL.
description	string	Meta description or snippet shown below the title.
displayed_url	string	The URL as displayed in green on the SERP (often shortened).
position	integer	Rank on the page (starting at 1).
page	integer	Page number (starting at 1).
query	string	The query that produced this result.

Example Output (truncated)

[
  {
    "type": "summary",
    "query": "best CRM software 2024",
    "total_results": "About 85,800,000 results (0.43s)",
    "featured_snippet": null,
    "people_also_ask": [],
    "related_searches": [
      "Best crm software 2024 reddit",
      "Best crm software 2024 free",
      "Top 10 CRM software",
      "Top 50 CRM software",
      "CRM software examples",
      "Top 100 CRM software",
      "Zoho CRM software",
      "Top 5 CRM software"
    ]
  },
  {
    "title": "The Best CRM Software We've Tested for 2025",
    "url": "https://www.pcmag.com/picks/the-best-crm-software",
    "domain": "pcmag.com",
    "description": "Feb 17, 2026 — Our Editors' Choice winner, Zoho CRM, is a full-featured and highly customizable solution...",
    "displayed_url": "https://www.pcmag.com › ... › CRM Software",
    "position": 1,
    "page": 1,
    "query": "best CRM software 2024"
  },
  {
    "title": "Top 13 CRM Software Tools in 2024 - Yellow.ai",
    "url": "https://yellow.ai/crm-software/",
    "domain": "yellow.ai",
    "displayed_url": "https://yellow.ai › crm-software",
    "position": 2,
    "page": 1,
    "query": "best CRM software 2024"
  },
  {
    "title": "World's #1 CRM | Salesforce IN",
    "url": "https://www.salesforce.com/in/crm/worlds-number-one-crm/",
    "domain": "salesforce.com",
    "displayed_url": "https://www.salesforce.com › worlds-number-one-crm",
    "position": 3,
    "page": 1,
    "query": "best CRM software 2024"
  }
  // ... up to max_results
]

🛠 Usage on Apify

1. Create a new task with this actor.
2. Provide input as shown above.
3. Run the actor – it will automatically use Apify proxy to avoid IP blocks.
4. Download results as JSON, CSV, or XML from the storage.

Running via API

You can also trigger runs programmatically using the Apify API. Example with cURL:

curl -X POST "https://api.apify.com/v2/acts/your-username~google-search-scraper/runs" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer YOUR_API_TOKEN" \
  -d '{
    "proxyConfiguration": {
      "useApifyProxy": true,
      "apifyProxyGroups": ["RESIDENTIAL"]
    },
    "query": "best CRM software 2024",
    "max_results": 10,
    "language": "en",
    "country": "us"
  }'

⚠️ Notes & Limitations

• Google rate limiting – Even with residential proxies, aggressive scraping may trigger CAPTCHAs. We recommend adding delays between requests (not yet implemented in this actor – contributions welcome!).
• Legal compliance – Ensure your use of scraped data complies with Google's Terms of Service and applicable laws. This actor is intended for educational and research purposes.
• Output variability – Google's SERP layout changes frequently. Some fields (e.g., description) may occasionally be missing.

📦 Changelog

v1.0.0 (2024-03-14)

• Initial release
• Supports organic results, summary stats, related searches
• Featured snippets and People Also Ask placeholders

📄 License

This actor is licensed under the MIT License. See the LICENSE file for details.

---

Maintained by [Your Name/Organization]
For issues or feature requests, please open an issue on GitHub or contact your-email@example.com.