Related Search Query Extractor

Extract related searches, refinements, autocomplete-style suggestions where visible, and query modifiers from search result snapshots

Who it is for

Related Search Query Extractor helps seo researchers, content planners, ppc/seo teams, agencies extract related searches, refinements, autocomplete-style suggestions where visible, and query modifiers from search result snapshots. It produces schema-valid dataset rows, evidence-backed KVS reports, safe diagnostics, and capped pay-per-event pricing for predictable Apify Store runs.

Collect visible related searches and refinements, then combine them with autocomplete strings you explicitly provide. Rows distinguish each source type and add deterministic modifier, intent, rank, and duplicate-group fields for keyword expansion work.

Evidence contract

The actor emits only facts visible in supplied HTML, explicit input records, or a permitted public URL response. It never creates rankings, questions, modules, suggestions, titles, snippets, or page metadata to fill an evidence gap. A missing source produces a schema-valid status row explaining what input is needed.

Network access is conservative. Only HTTP and HTTPS URLs are accepted; localhost, loopback addresses, private IPv4 ranges, and disallowed domains are rejected. The runtime does not follow links discovered in a page. Challenge and access-denied pages are recorded as blocked evidence and are not solved or circumvented.

Input modes

• Pass search-page HTML through serpHtmlInputs or htmlInputs.
• Pass autocompleteSuggestions separately; the actor labels these as autocomplete rather than implying they came from the HTML.
• Use includeRefinements and includeAutocompleteIfProvided to select evidence sources.
• Use dedupeSuggestions and maxRelatedQueriesPerQuery for bounded output.

Example input

{
  "queries": [
    "project management software"
  ],
  "serpHtmlInputs": [
    {
      "sourceUrl": "https://example.com/serp",
      "query": "project management software",
      "html": "<a class=\"related-search\">best project management software</a><a class=\"refinement\">project management software pricing</a>"
    }
  ],
  "autocompleteSuggestions": [
    "project management software for startups"
  ],
  "maxRelatedQueriesPerQuery": 25,
  "maxChargeUsd": 50
}

Dataset output

Each dataset item is one JSON object, which makes the result directly usable in Apify integrations, exports, webhooks, and downstream data pipelines.

• seed query and suggested query
• suggestion type: related search, refinement, or supplied autocomplete
• position, recognized modifier, and intent hint
• duplicate-group identifier and source-engine label
• source status, evidence excerpt, and recommendation

Common evidence fields include sourceUrl, sourceType, pageTitle, issueCode, severity, evidenceSnippet, recommendation, httpStatus, and scannedAt. Fields without source evidence are null rather than guessed.

Reports and retained evidence

When includeReport is true, the actor writes a Markdown summary, CSV records, JSON issue rows, evidence excerpts, and run metadata to key-value storage. Set includeRawSnapshots only when retaining capped HTML is appropriate for your workflow; it is off by default.

The report metadata records the actor, timestamp, row count, issue codes, severity totals, consumed input fields, pricing mode, platform-usage setting, and maximum-charge default. This provides a compact audit trail for scheduled comparisons.

Pricing

This actor uses pay per event. Apify platform-usage pass-through is off. Charges are accepted before the corresponding paid dataset row or report is written.

Event	Price
actor-start	$0.08000
query-snapshot-scanned	$0.01000
live-serp-page-rendered	$0.02750
related-query-extracted	$0.00950
report-generated	$0.18000

maxChargeUsd is a strict pre-output budget. A value of zero prevents the first charge and therefore prevents paid output. If Apify rejects a charge, partially accepts it, or reports an event limit, the actor stops before writing the affected output and records billing status.

Higher-tier Store discounts are expected where supported. The event prices above remain the locked base prices.

Limits and predictable runs

• maxPages, maxSnapshots, and actor-specific record caps limit work before analysis.
• maxQueries limits distinct search contexts.
• Public fetches are additionally constrained by allowedDomains, timeoutMs, requestDelayMs, and a fetch cap.
• Reports are optional and raw HTML retention is opt-in.
• Query-only input produces an explicit source-required row instead of an empty or fabricated result.
• Dataset rows and report files follow the declared Actor schemas.

Responsible use

Process only public content or material you are authorized to analyze. Respect website terms, rate limits, privacy obligations, intellectual-property rights, and applicable law. Avoid sending personal or confidential information in HTML or input records unless your workflow is authorized to process it.