AI Can Mention Your Company and Still Get It Wrong
· Signal Harbor · Originally published in Signal Harbor Weekly
The Signal Harbor Journal
Research and perspectives from Signal Harbor
By Sebastian Miller
Co-Founder, Signal Harbor
AI Can Mention Your Company and Still Get It Wrong
An AI assistant can include your company in an answer and still give a buyer the wrong impression.
It may list a discontinued service, leave out the capability the buyer actually needs, mix your company up with another business, or attach a real citation to a claim the source does not support.
A basic AI visibility report asks whether your name appeared. Signal Harbor also measures whether the answer represents the company accurately and in the right buying context. Those errors deserve different fixes.
A Factual Error Can Change the Shortlist
The clearest mistake is a false statement: an incorrect location, a product feature that does not exist, a certification the company does not hold, or a service it no longer offers. People often call these AI hallucinations.
A 2026 study published in Nature examined how accuracy-based evaluations can reward AI systems for guessing rather than expressing uncertainty. A confident answer, therefore, still needs to be checked against facts the company can verify.
Signal Harbor investigates whether an old page, business listing, third-party article, or similarly named company appears alongside an incorrect claim. We identify the error and the public information the marketing team should check first.
We do not assume a citation reveals exactly why a model made a claim. It gives us a source to examine.
Outdated Facts Need Their Own Review
Some wrong statements used to be true. A provider may have changed its pricing, geographic coverage, product, or policy while old information remains on review sites and comparison pages.
In a 2025 study of AI answers that retrieve outside information, Jie Ouyang and colleagues found that outdated material could reduce answer accuracy even when current information was available. That study does not establish how often this happens in every commercial AI platform, but it shows why old sources deserve attention.
Freshness is therefore separate from general accuracy. We check whether a claim is correct now, identify conflicting public descriptions, and retest after the relevant information is updated.
For an agency managing several brands, a practical review may begin with the products or terms that have changed recently. The same outdated statement repeated across AI platforms can create avoidable work for sales teams and confusion for prospective customers.
An Omission Can Matter as Much as a False Claim
An answer may correctly call a company a manufacturer while leaving out its documented ability to handle a particular material, production requirement, or certification. For the buyer seeking that capability, the description is too incomplete to be useful.
We call that a representation gap. It differs from a factual error because the answer may contain no false sentence at all. Research on evaluating AI factuality makes a related point: checking whether stated facts are correct does not, by itself, capture important facts an answer leaves out.
Signal Harbor checks the company’s verified capabilities against what the tested answer includes. We investigate whether important information is buried on the website, expressed inconsistently, or absent from useful public sources. The marketing priority may be a clearer service page, a specific use case, or stronger proof.
Category Confusion Sends Buyers to the Wrong Place
AI may put a company in the wrong category or mix it with a similarly named business. A consulting firm can be described as software; a broker can be described as a carrier.
We measure whether those patterns recur across relevant questions and platforms. Then we inspect the company descriptions and outside listings available to the system. Clearer positioning and consistent facts give both buyers and AI better material to work with.
A category error is especially costly on unbranded prompts, where the buyer describes a need without naming the company. If AI misunderstands what a business does, the company may never enter the answer.
A Citation Can Be Real and Still Be Weak Evidence
Citation analysis examines the pages displayed with an AI response. A source may be real but fail to support the claim attached to it. An article about an industry does not prove one company is “the best” in that industry. A company announcement is not independent evidence of superiority.
A 2025 study on citations in AI answers found substantial room to improve how precisely answers connect statements to supporting text. That is why we check the claim and the cited page together, rather than treating the presence of a link as proof.
Signal Harbor checks whether the cited page supports the specific statement, whether it is current, and whether it concerns the right company. A citation gap may mean the company lacks useful public documentation or credible third-party evidence for an important claim. Citation share, the portion of citations associated with a source or domain, is a different metric from this investigation.
Give Each Problem Its Own Fix
These issues should not disappear inside one accuracy score. A false address, an omitted service, a category mix-up, and a source mismatch affect the buyer in different ways.
Our review separates inclusion, accuracy, freshness, completeness, buyer fit, and source support. We show the marketing team which gaps matter to the people it wants to reach and what evidence to improve. After changes are published, we retest the relevant questions.
When CRM and website data are available, we examine whether better representation relates to qualified inquiries and pipeline. A changed answer alone does not prove a sale.
Signal Harbor measures whether AI gets a company into the answer and whether that answer gives a qualified buyer a sound reason to consider it.
Sebastian Miller
Co-Founder, Signal Harbor
signalharborai.com
sebastian.miller@signalharborconsulting.com
402-306-2213
This article first appeared in Signal Harbor Weekly, the Signal Harbor newsletter on AI visibility.
