Google Search Crawler

Turn any Google search into structured, clean Markdown content — automatically.

---

What it does

Google Search Content Extractor crawls Google search results for any keyword and visits each result page to extract its full content as clean Markdown. No login required. No API key needed. Just a keyword — and get back structured, ready-to-use content in seconds.

Built for researchers, content strategists, SEO analysts, and developers who need to aggregate web content at scale without the manual copy-paste grind.

---

Key Features

• Google SERP crawling — fetches the top results for any keyword, country, language, and date range
• Full page content extraction — visits each result URL and returns clean Markdown (navigation, ads, and menus automatically removed)
• Parallel crawling — up to 10 pages scraped simultaneously for maximum speed
• Smart filtering — automatically skips CDN assets, image URLs, login-walled pages, and Google-internal links
• Proxy support — compatible with Apify Datacenter and Residential proxies for high-volume runs
• Structured output — every result includes title, URL, content, and source tag

---

Use Cases

• Content research — aggregate what's being published on any topic in real time
• SEO analysis — understand what content ranks for your target keywords
• Competitive intelligence — monitor what your competitors publish
• AI training data — collect clean Markdown content for LLM fine-tuning or RAG pipelines
• Dashboard automation — schedule regular runs and pipe results into Google Sheets, Notion, or any database

---

Input Example

{
  "keyword": "best AI tools for marketing 2024",
  "country": "us",
  "language": "en",
  "date_range": "week",
  "max_results": 10,
  "scrape_pages": true,
  "concurrency": 5
}

Field	Type	Default	Description
keyword	string	required	Search query
country	string	us	Google country code (fr, gb, de…)
language	string	auto	Result language (en, fr, ar…)
date_range	enum	week	hour / day / week / month / year
max_results	integer 1–20	5	Number of pages to extract
scrape_pages	boolean	true	Visit each URL for full content
concurrency	integer 1–10	5	Parallel page crawls
proxyConfiguration	object	none	Apify proxy picker

---

Output Example

{
  "keyword": "best AI tools for marketing 2024",
  "title": "10 Best AI Marketing Tools to Try in 2024",
  "url": "https://www.example.com/ai-marketing-tools",
  "content_md": "# 10 Best AI Marketing Tools\n\nArtificial intelligence is transforming how marketers work...\n\n## 1. ChatGPT\nChatGPT allows marketers to generate copy, summarize reports...",
  "source": "post_page"
}

Field	Description
keyword	The search query used
title	Page title as shown on Google SERP
url	Full page URL
content_md	Clean page content in Markdown format
source	post_page = full page scraped / google = SERP snippet only

---

Performance

Config	Pages scraped	Estimated time
5 results, concurrency 5	5 pages	~45 sec
10 results, concurrency 10	10 pages	~60–90 sec
20 results, concurrency 10	20 pages	~2–3 min