Google Search Scraper 🔍

Effortlessly scrape organic web search results and SERP features from Google with this powerful Apify Actor! 🚀

Features ✨

• 🔍 Scrape organic Google search results with maximum field extraction (20+ fields per result)
• 🧠 Extract Knowledge Panel (title, description, facts, social profiles, related entities)
• 📰 Extract Top Stories (title, link, source, date, thumbnail)
• 🎥 Extract Video Results (title, link, channel, duration, date)
• 💡 Extract Featured Snippets (paragraph, list, table types with source info)
• ❓ Extract People Also Ask questions
• 🖼️ Extract Image Pack results
• 🔗 Extract Related Searches
• 🌐 Uses localized Google domains (google.co.in, google.co.uk, etc.)
• 📢 Retrieve up to 50,000 results per run
• 🌍 Support for 200+ countries and languages
• ⏳ Time-based filtering (last hour, day, week, month, year, custom range)

Use Cases 💡

• 📊 SEO research and keyword ranking analysis
• 🏢 Competitor research and market analysis
• 📈 SERP monitoring and tracking
• 🔗 Link building research
• 📰 Content research and ideation
• 🧠 Knowledge graph data extraction

How It Works 🛠️

1. Set your search query and parameters in the input
2. The Actor searches Google using localized domains
3. All organic results and SERP features are extracted with maximum detail
4. Each result type is pushed as individual dataset items
5. All data is saved to your Apify dataset

Input Parameters 📝

Parameter	Type	Description	Default
query	string	Your search term	"Elon Musk"
maxItems	integer	Maximum organic results to collect (10-50000)	10
gl	string	Google country code (e.g., "us", "in", "uk")	-
hl	string	UI language (e.g., "en", "hi", "fr")	-
lr	string	Language of results (e.g., "lang_en")	-
cr	string	Country restriction for results	-
time_period	string	Time filter (last_hour/day/week/month/year/custom)	-
nfpr	integer	Disable auto-correction (0 or 1)	-
filter	integer	Filter similar results (0 or 1)	-

Output 📊

Organic Results (type: "organic")

Field	Description
position	Result position (1, 2, 3...)
title	Page title
link	Full URL
domain	Domain name
siteName	Site name (e.g., "Wikipedia", "Forbes")
displayedUrl	URL as displayed in Google
favicon	Favicon image URL
breadcrumbs	URL breadcrumb path segments
snippet	Description snippet
snippetHtml	Full HTML of the snippet
emphasis	Bold/emphasized words in snippet
date	Date if present in snippet
rating	Star rating if present
ratingCount	Number of reviews
price	Price if present
thumbnail	Thumbnail image URL
richResultType	Rich result type (review, recipe, video, faq)
additionalInfo	Extra info line
cacheLink	Google cache URL
sitelinks	Sitelink sub-results
searchQuery	The search query used
searchPage	Page number
scrapedAt	ISO timestamp

Knowledge Panel (type: "knowledgePanel")

Field	Description
title	Entity name
subtitle	Entity type/category
description	Wikipedia description
descriptionSource	Source of description
descriptionLink	Link to source
image	Entity image URL
facts	Key-value facts (Born, Spouse, etc.)
socialProfiles	Social media links
peopleAlsoSearchFor	Related entities
website	Official website

Top Stories (type: "topStory")

Field	Description
title	Article headline
link	Article URL
source	Publisher name
date	Publication date
thumbnail	Article thumbnail

Video Results (type: "video")

Field	Description
title	Video title
link	Video URL
source	Video platform
channel	Channel name
date	Upload date
duration	Video length
thumbnail	Video thumbnail

Other SERP Features

• Featured Snippet (type: "featuredSnippet"): Answer box with text, sourceUrl, snippetType
• People Also Ask (type: "peopleAlsoAsk"): Array of related questions
• Image Pack (type: "image"): Thumbnail, alt text, source URL
• Related Searches (type: "relatedSearch"): Query text and search link
• Search Metadata (type: "searchMetadata"): Summary with counts of all features

Example Output 📋

Organic Result

{
  "position": 1,
  "title": "Elon Musk - Wikipedia",
  "link": "https://en.wikipedia.org/wiki/Elon_Musk",
  "displayedUrl": "https://en.wikipedia.org › wiki › Elon_Musk",
  "domain": "en.wikipedia.org",
  "siteName": "Wikipedia",
  "snippet": "Elon Reeve Musk is a businessman known for his leadership of Tesla, SpaceX, and xAI.",
  "emphasis": ["Elon", "Musk"],
  "richResultType": "faq",
  "type": "organic",
  "searchQuery": "Elon Musk",
  "searchPage": 1,
  "scrapedAt": "2025-02-24T12:02:43.145Z"
}

Knowledge Panel

{
  "type": "knowledgePanel",
  "searchQuery": "Elon Musk",
  "title": "Elon Musk",
  "subtitle": "CEO of Tesla Motors",
  "description": "Elon Reeve Musk is a businessman and entrepreneur...",
  "descriptionSource": "Wikipedia",
  "facts": {
    "Born": "June 28, 1971, Pretoria, South Africa",
    "Children": "12",
    "Organizations founded": "SpaceX, Tesla, The Boring Company, xAI"
  },
  "socialProfiles": [
    { "name": "X (Twitter)", "url": "https://x.com/elonmusk" }
  ],
  "scrapedAt": "2025-02-24T12:02:43.537Z"
}

Top Story

{
  "type": "topStory",
  "searchQuery": "Elon Musk",
  "title": "Elon Musk signs agreement with the Department of Defense",
  "link": "https://www.example.com/news/...",
  "source": "NEWS.COM",
  "date": "21 minutes ago",
  "scrapedAt": "2025-02-24T12:02:43.653Z"
}

Video Result

{
  "type": "video",
  "searchQuery": "Elon Musk",
  "title": "The Duality of Elon Musk",
  "link": "https://www.youtube.com/watch?v=example",
  "source": "youtube.com",
  "channel": "Dieck Docs",
  "date": "24 jun 2025",
  "duration": "27:38",
  "scrapedAt": "2025-02-24T12:02:43.834Z"
}

Search Metadata

{
  "type": "searchMetadata",
  "searchQuery": "Elon Musk",
  "totalResults": null,
  "organicResultsCount": 8,
  "featuredSnippetPresent": false,
  "knowledgePanelPresent": true,
  "topStoriesCount": 7,
  "videoResultsCount": 3,
  "imagePackCount": 3,
  "peopleAlsoAskCount": 5,
  "relatedSearchesCount": 8,
  "scrapedAt": "2025-02-24T12:02:44.376Z"
}

Proxy Configuration 🌐

For best results, use RESIDENTIAL proxy group:

{
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}