AI Brand Accuracy Monitor (Wrong Facts)

Is ChatGPT telling people the WRONG things about your brand? Find out before it costs you deals.

Most "AI visibility" tools only tell you whether you're mentioned. This one checks whether what the AI says is true. It asks an AI answer engine (with live web search) a set of buyer questions, extracts every factual claim the answer makes about your brand — pricing, features, availability, founding, ownership, numbers — and grades each one against your ground‑truth facts:

correct · outdated · wrong · hallucinated · unverifiable

…and flags which cited sources are feeding the errors, so you know exactly what to go fix. Run it on a schedule to catch drift as AI models re‑index the web.

Quick start

1. Fill in the input — set the fields in the input tab (prefilled with a working example).
2. Click Start — the Actor runs and writes one record per item to the dataset.
3. Get your data — export to JSON, CSV or Excel, or pull it via the API.

// input
{
  "brand": "Acme CRM",
  "domain": "acmecrm.com",
  "facts": ["Paid plans start at $19/user/month", "There is a free plan", "Founded in 2019", "Has a native iOS app"],
  "competitors": [],
  "topic": "CRM software"
}

// per-prompt output
{
  "prompt": "Is Acme CRM free, and what does it cost?",
  "issueCount": 1,
  "claims": [
    { "claim": "Acme CRM has a free plan", "verdict": "correct", "explanation": "Matches your facts.", "sourceUrl": "acmecrm.com" },
    { "claim": "Paid plans start at $29/user/month", "verdict": "wrong", "explanation": "Your facts say $19/user/month.", "sourceUrl": "someblog.com" }
  ],
  "citedDomains": ["acmecrm.com", "someblog.com"]
}

Plus an aggregate in the run SUMMARY: accuracyScore, counts per verdict, topIssues, and sourcesFeedingErrors.

---

Why this matters

• 43% of business owners have found wrong AI info about their business, and most consumers avoid a business over bad info. A wrong price or "feature X doesn't exist" in an AI answer silently kills deals.
• Visibility ≠ accuracy. You can be mentioned and misrepresented. This catches the misrepresentation.
• Actionable — sourcesFeedingErrors tells you which pages/sites to correct or get updated.
• Recurring — AI answers drift; schedule weekly to stay ahead.

---

Use cases

• Brand protection / GEO — monitor factual accuracy of your brand in AI answers over time.
• Product launches & price changes — verify AI picked up the new reality (and find the stale sources that didn't).
• Agencies — offer AI‑accuracy audits to clients as a recurring service.
• Agent tool — via the Apify MCP server, an agent can fact‑check what AI says about any brand on demand.

---

Input

Field	Type	Default	Description
brand	string	— (required)	Brand to monitor.
facts	string[]	—	Your ground‑truth facts to check against (strongly recommended).
domain	string	—	Your domain — helps attribute error sources.
topic	string	—	Category; used to auto‑generate prompts.
prompts	string[]	—	Your own questions; leave empty to auto‑generate.
promptCount	integer	5	Prompts to generate when none supplied.
model	string	gpt-4o-mini	OpenAI model.

---

Output

One dataset item per prompt with graded claims[], plus a run SUMMARY with the accuracy score, verdict breakdown, top issues and the sources feeding errors.

---

Pricing

Pay-per-event: one fact-checked event per question analysed (web‑search answer + fact‑check).

Environment variables

Variable	Required	Purpose
OPENAI_API_KEY	Yes	Powers web‑search answers and fact‑checking.

Notes

• Answers come from an AI with live web search, reflecting real answer‑engine behaviour — results vary over time, which is the point of monitoring.
• Provide facts for precise grading; without them, the model flags implausible/contradictory claims using general knowledge.
• Use consistent prompts across runs to track a clean trend.

Run it locally

npm install
export OPENAI_API_KEY=...
apify run

License

ISC.

Related actors

• AI Brand Visibility Tracker (GEO/AEO) — Track how visible your brand is in AI answer engines — are you recommended when people
• AI Share of Voice — Multi-Engine GEO Tracker — Track your brand's visibility and share of voice across AI answer engines, with
• AI Citation Source Miner (GEO/AEO) — Discover which websites AI answer engines cite for your category — so you know where to