Google Search Results Scraper

Extract Google search results automatically for SEO research, competitor analysis, and content creation. Get titles, URLs, full page content, and contact information.

What

A robust web scraper that extracts search results from Google Search, designed for SEO research, competitor analysis, and content preparation. Supports extraction of up to 100 results per query, automatically gathering full page content and contact information from each result.

When to Use

• SEO Article Material Preparation - Gather top-ranking content for your target keywords
• Competitor Analysis - Identify who ranks for your target queries and analyze their content
• Content Research - Discover trending topics and popular content in your niche
• SERP Monitoring - Track search engine results page positions over time
• Lead Generation - Extract contact information from search results

Features

• ✅ Top 10 or Top 100 Results - Alternative solution after Google discontinued num=100 parameter
• ✅ Multi-Region Support - Geo-target search results with country codes (US, GB, TW, etc.)
• ✅ Full Page Content - Automatically extracts complete text, metadata, and contact information
• ✅ Contact Extraction - Auto-detects emails, phone numbers, and social media links

Inputs

Parameter	Type	Required	Default	Description
queries	array of strings	Yes	-	List of search keywords to scrape
maxResults	string	No	"10"	Number of results per query: choose "10" for quick results or "100" for comprehensive data
countryCode	string	No	"US"	Two-letter country code (e.g., "US", "GB", "TW") for geo-targeted search results

Input Example

{
  "queries": ["best seo tools 2025", "content marketing strategies"],
  "maxResults": 10,
  "countryCode": "US"
}

Outputs

{
  "query": "best seo tools 2025",
  "rank": 1,
  "title": "10 Best SEO Tools for 2025...",
  "url": "https://example.com/seo-tools",
  "displayedUrl": "example.com › seo-tools",
  "searchParameters": {
    "countryCode": "US",
    "languageCode": "en",
    "maxResults": 10
  },
  "collectedAt": "2025-10-06T12:00:00.000Z",
  "fullText": "Complete page text content...",
  "emails": ["contact@example.com"],
  "phones": ["+1-234-567-8900"],
  "socialMedia": {
    "facebook": "https://facebook.com/example",
    "twitter": "https://twitter.com/example",
    "linkedin": "https://linkedin.com/company/example",
    "instagram": "https://instagram.com/example"
  },
  "metadataTitle": "Page title from meta tag",
  "metadataDescription": "Meta description - provides page summary",
  "metadataKeywords": "meta, keywords, list"
}

Quick Start

Run on Apify Platform

1. Open the Actor in Apify Console
2. Configure your input parameters
3. Click "Start" to begin scraping
4. Download results when complete

Notes & Limitations

• CAPTCHA Risk - May encounter CAPTCHA after 10-20 queries. Actor will pause and save progress

Troubleshooting

CAPTCHA Detected

Issue: Actor stops with "CAPTCHA detected" error

Solution:

• Reduce the number of queries
• Wait several hours before retrying

Empty Contact Information

Issue: Email or phone arrays are empty even though contact info exists on the page

Possible Reasons:

• Contact information displayed as images or protected by JavaScript (cannot be extracted)
• Email addresses using form submissions instead of mailto: links
• Phone numbers formatted in non-standard ways

What Gets Detected:

• ✅ Emails in text content or mailto: links
• ✅ Phone numbers in common formats (international or local)
• ✅ Social media profile URLs (Facebook, Twitter, LinkedIn, Instagram)
• ❌ Contact forms, images of emails, or JavaScript-protected content

Best Practices

1. Start Small - Test with 1-2 queries and maxResults=10 before scaling
2. Monitor Rate Limits - Space out large scraping jobs over multiple runs
3. Use Schedules - Set up scheduled runs for regular SERP monitoring
4. Export Data - Download results as CSV/JSON for analysis
5. Respect Robots.txt - Use data responsibly and in compliance with terms of service

Reliability

• Automatically retries failed requests
• Regularly tested and updated for accuracy