Google Forums API - Forum Threads, Q&A and Discussion Scraper

Extract forum threads, Q&A, and community discussions from Google Search's "Forums" tab. Supports 40+ countries, custom localization (GL/HL), and pagination. Get structured JSON from Reddit, LinkedIn, Quora, and niche forums for sentiment analysis, market research, AI training, and SEO research.

This Apify Actor wraps the Google Forums search experience as a clean JSON API. One dataset item is returned per page of results, with stable field names, deterministic pagination, and pay-per-event pricing.

---

What this Actor returns

Each dataset item is one page of Google Forums results and contains:

• search_parameters - the effective query, location, country (gl), language (hl), filters, device, and max_pages used.
• search_metadata - total_results, forums_count, pages_processed, max_pages_set, pagination_limit_reached.
• search_information - the displayed query and the organic-results state from Google.
• search_timestamp - ISO-8601 timestamp of the extraction.
• page_number - 1-based page index.
• forum_results - an array of forum entries with position, title, link, displayed_meta (comments and recency), source (site or subreddit), snippet, and date.

What sets it apart:

• One stable JSON contract for every supported country and language.
• Localization with both gl (country) and hl (language); regional language variants like en-gb are normalized to base codes automatically.
• Filters for auto-corrected queries (nfpr) and duplicate content (filter).
• Device emulation (desktop, mobile, tablet).
• Honest, transparent pay-per-event pricing - setup plus one charge per page actually pushed.

---

Use cases

• Monitor brand or product sentiment across Reddit, Quora, LinkedIn, and niche forums for a given keyword.
• Build training data or RAG corpora from real-world discussions about a topic.
• Track localized community conversations by country and language (e.g. coffee brewing discussions in Austin, US; AI jobs discussions in Tokyo, JP).
• Compare technology, product, or career questions across regions (e.g. "python vs java" in US vs IN vs DE).
• Extract thread metadata for indexing, NLP pipelines, competitive intelligence, and editorial research.

---

Input parameters

The full input schema lives in .actor/input_schema.json and renders automatically in the Apify UI. Key fields:

Field	Type	Required	Default	What it does
q	string	yes	-	Forum search query (e.g. python vs java, best coffee brewing methods).
location	string	no	-	Human-readable location string for localized results (e.g. Austin, TX, Texas, United States).
gl	string (enum)	no	-	Country code (ISO 3166-1 alpha-2, lowercase). Top 40 high-traffic markets exposed in the UI.
hl	string (enum)	no	-	Interface language code (ISO 639-1, lowercase). Regional variants like en-gb normalize to en.
lr	string	no	-	Result-language restriction (e.g. lang_en, lang_es).
safe	string (enum)	no	off	active to filter explicit results, off to disable filtering.
nfpr	string (enum)	no	0	0 includes auto-corrected results, 1 excludes them.
filter	string (enum)	no	0	0 includes duplicates, 1 filters them.
device	string (enum)	no	desktop	desktop, mobile, or tablet.
max_pages	integer	no	1	Number of pages to fetch. 0 means no limit. Each processed page is one billable event.
output_file	string	no	auto	Optional filename for the combined JSON in the default key-value store.

---

Example inputs

1. Basic forums search

{
  "q": "what is the best programming language",
  "max_pages": 1
}

2. Localized forums search

{
  "q": "best coffee brewing methods forum",
  "location": "Austin, TX, Texas, United States",
  "gl": "us",
  "hl": "en",
  "max_pages": 1
}

3. Multi-page search with filters

{
  "q": "technology trends 2026",
  "gl": "us",
  "hl": "en",
  "nfpr": "1",
  "filter": "1",
  "device": "desktop",
  "max_pages": 2
}

4. All available pages

{
  "q": "python vs java web development",
  "gl": "us",
  "hl": "en",
  "max_pages": 0
}

---

Example output

{
  "search_parameters": {
    "q": "what is the best programming language",
    "location": null,
    "gl": "us",
    "hl": "en",
    "lr": null,
    "nfpr": 1,
    "filter": 1,
    "device": "desktop",
    "max_pages": 2
  },
  "search_metadata": {
    "total_results": 42,
    "forums_count": 20,
    "pages_processed": 2,
    "max_pages_set": 2,
    "pagination_limit_reached": true
  },
  "search_information": {
    "query_displayed": "what is the best programming language",
    "organic_results_state": "Results for exact spelling"
  },
  "search_timestamp": "2026-05-11T10:30:00.123456",
  "page_number": 1,
  "forum_results": [
    {
      "position": 1,
      "title": "For you what is the best programming language?",
      "link": "https://www.reddit.com/r/learnprogramming/comments/14o4uqz/for_you_what_is_the_best_programming_language_w/",
      "displayed_meta": "70+ comments . 2 years ago",
      "source": "Reddit . r/learnprogramming",
      "snippet": "C++ It's the biggest language in the world until now...",
      "date": "2 years ago"
    }
  ]
}

See .actor/dataset_schema.json for the full schema.

---

Pricing

Pay-per-event:

• Setup - one-time fee per Actor run. Covers initialization.
• Page Processed - one event per successfully pushed page of forum results (about 10 results per page).

At the start of each run, the Actor estimates the maximum possible cost (setup + page_price * pages_to_check) and aborts with a friendly InsufficientFunds dataset entry if the projected cost exceeds your remaining budget. No partial charges. If a page fails to push, it is not charged.

When the PRODUCTION environment variable is not set to true, the Actor runs in local-testing mode and only logs what it would charge.

---

How to get started

1. Open the Actor in the Apify Store: https://apify.com/johnvc/google-forums-search-api
2. Click "Try for free", paste an input like the examples above, and run it.
3. Read results from the default dataset (table, JSON, or CSV export).
4. To run from the API, copy the run-via-API snippet in the Apify console.

For agents, this Actor is also discoverable through the Apify MCP server - search for "google forums" and call it as a tool.

To run locally:

cd ApifyGoogleForums
apify run --input '{
  "q": "what is the best programming language",
  "gl": "us",
  "hl": "en",
  "max_pages": 1
}'

For production charging, set PRODUCTION=true in the Actor's environment.

---

FAQ and troubleshooting

I got an empty forum_results array. Why? The query may be too niche, or Google Forums had nothing to return for that location and language combination. The search_metadata.forums_count will be 0 and the run still completes cleanly. The setup fee is charged once; no page events are billed.

My country code is not in the dropdown. Only the top 40 highest-traffic markets are exposed in the UI for clarity and MCP-compatibility. To use any other ISO 3166-1 alpha-2 code, omit gl and pass a more specific location string instead - Google Forums localizes well from a city or region name.

I want regional English (en-gb, en-us, en-au). The underlying API supports base language codes reliably. The Actor automatically normalizes regional variants to their base code (e.g. en-gb becomes en) and logs a warning when it does so. For region targeting, combine the base hl with a gl country code or a location string.

My run aborted with "Insufficient funds". The Actor pre-checks the maximum projected cost (setup + page_price * max_pages) against your account's remaining charge limit. Either raise the account or run-level charge limit, or lower max_pages.

Charging seems off. In local testing mode (no PRODUCTION=true), nothing is charged - the log lines describe what would be charged in production. In production, only successfully pushed pages count toward page_processed; failed pages do not bill.

The actor returned "Error" but I still got some data. Google Forums occasionally stops returning further results during pagination. The Actor pushes the partial results it did get, logs the error, and writes a structured error entry to the dataset so downstream consumers can see what happened.

---

Links

• Apify Store page: https://apify.com/johnvc/google-forums-search-api
• Apify MCP integration: https://docs.apify.com/platform/integrations/mcp
• Apify Actor definition reference: https://docs.apify.com/platform/actors/development/actor-definition/actor-json
• Quality Score and pricing transparency: https://docs.apify.com/platform/actors/publishing/quality-score

---

Last Updated: 2026.05.11