{"id":60323,"date":"2026-09-13T00:28:34","date_gmt":"2026-09-13T07:28:34","guid":{"rendered":"https:\/\/svch.io\/silicon-valley-certification-hub-chief-ai-officer-ai-answer-visibility-causal-measurement\/"},"modified":"2026-09-13T00:28:34","modified_gmt":"2026-09-13T07:28:34","slug":"silicon-valley-certification-hub-chief-ai-officer-ai-answer-visibility-causal-measurement","status":"publish","type":"post","link":"https:\/\/svch.io\/es\/silicon-valley-certification-hub-chief-ai-officer-ai-answer-visibility-causal-measurement\/","title":{"rendered":"Your AI Visibility Dashboard Is Probably Lying to You \u2014 Silicon Valley Certification Hub Chief AI Officer Research"},"content":{"rendered":"
\n
SVCH Research Review — September 2026<\/div>\n

Your AI Visibility Dashboard Is Probably Lying to You — Silicon Valley Certification Hub Chief AI Officer Research<\/h1>\n
\n 📄 arXiv: 2609.11915<\/span>
\n 🏢 Meiji University & Independent Researchers<\/span>
\n 📅 September 2026<\/span>\n <\/div>\n
Researchers:<\/strong> Masahiro Kato · Daiki Honma · Taka Kato<\/div>\n<\/div>\n

If you measure the impact of showing up in ChatGPT answers the obvious way, you will overstate the result by more than half. That is not a guess. It is a number from a new paper, and it lands on the desk of every marketing leader who has been asked to prove that generative search is paying off.<\/p>\n

Here is the setup. Your brand starts appearing inside AI-generated answers more often. Branded search ticks up. Traffic improves. You claim the lift. Then someone asks the uncomfortable question: would that traffic have grown anyway, because everyone is using AI answers more? The paper’s answer is sharp. A naive before-and-after read put the effect at 0.225. The true effect was 0.143. Nearly 40% of the credit was a rising tide with nothing to do with your work.<\/p>\n

The three researchers behind this, Masahiro Kato, Daiki Honma, and Taka Kato, built a causal framework for exactly this measurement problem. They call it Generative Marketing Mix Modeling, or GMMM. It is the first serious attempt to answer a question boards are now asking out loud: did our visibility inside AI answers actually drive revenue, or does it just look like it did?<\/p>\n

\"Silicon<\/p>\n

\n
1.58 vs 0.70<\/div>\n
The total effect of AI-answer visibility looks twice as big as the direct effect, for the same campaign.<\/div>\n
Context: the total-effect model reports 1.58 when the real direct effect is 0.70. Most of the apparent gain is traffic you would have captured through branded search anyway.<\/div>\n<\/div>\n

Why This Paper Matters<\/h2>\n

Every marketing team is now measured on a channel that standard analytics cannot see. Generated answers produce no impression log. Nobody clicks a link when the model just says your name. So the generative channel arrives with no attribution rail, and most companies are improvising.<\/p>\n

The improvisation takes two forms. Either you track mentions and treat them as engagement, or you run a simple before-and-after and bank the difference. Both feel reasonable. The paper shows why both can be badly wrong.<\/p>\n

This is where a Chief AI Officer earns their seat. Whether generative visibility drives revenue is a capital allocation question now, and it needs the same rigor as any other investment claim. An AI Assessment for companies that ignores the generative layer is incomplete by definition.<\/p>\n

Methodology, Explained Simply<\/h2>\n

GMMM splits the generative channel into two things that executives keep confusing. GEO, Generative Engine Optimization, is earning your way into an answer. You do not pay for the mention. GEM, Generative Engine Marketing, is buying a sponsored placement inside a generative engine. Different economics, different measurement, and they should not share a line item without a reason.<\/p>\n

To measure GEO, the framework combines four inputs. Repeated generated answers show what the models actually say. Question counts show how often buyers ask the questions you care about. Share-of-use shows how the traffic splits across ChatGPT, Gemini, Claude and the rest. And notice probability captures the honest truth that a mention is not the same as a read. That last input is the one most teams skip, and it is the one that keeps your numbers from being fiction.<\/p>\n

For GEM, the model pairs sponsored-placement records with the same notice probabilities. Then it does something clever. Instead of asking “what happened after we spent the money,” it compares expected business outcomes under alternative sequences of action. What happens if you run GEO for two quarters and then add GEM? What happens in the reverse order? The difference is the causal effect, and the paper sets out the conditions under which you can actually identify it.<\/p>\n

That word, identify, is doing real work. It means the math only gives you a trustworthy answer if the measurement design meets a standard. No control group, no clean answer.<\/p>\n

\"Silicon<\/p>\n

Results and Practical Insights<\/h2>\n

The first chart compares three ways of measuring the same GEO campaign against the true effect. Treated pre-post, the naive method, reports 0.225. The true effect is 0.143. Difference-in-differences, which subtracts the growth your untreated competitors also enjoyed, lands exactly on 0.143. The naive number is not a rounding error. It would have you defending a budget on evidence that does not survive a skeptical CFO.<\/p>\n

\n \"Silicon
Naive before-and-after reads 0.225. Difference-in-differences reads 0.143, which is the true GEO effect.<\/figcaption><\/figure>\n
\n
\n
0.143<\/div>\n
Difference-in-differences (true effect)<\/div>\n<\/p><\/div>\n
\n
0.225<\/div>\n
Naive treated pre-post<\/div>\n<\/p><\/div>\n
\n
1.58<\/div>\n
Total-effect model<\/div>\n<\/p><\/div>\n
\n
0.70<\/div>\n
Direct effect (brand search controlled)<\/div>\n<\/p><\/div>\n<\/div>\n

The second chart answers a different question, and it is the one that decides how you spend. When GEO exposure is measured without controlling for branded search, the total effect comes out at 1.58. Control for branded search, and the direct effect is 0.70. More than half of the apparent benefit is a relabeling of demand that would of arrived through your brand anyway. If you report the 1.58 to the board and your CFO separately reports a branded-search lift, you have double counted the same dollar twice.<\/p>\n

\n \"Silicon
Total GEO effect reads 1.58. The direct effect, with brand search held constant, is 0.70.<\/figcaption><\/figure>\n

I didn’t expect the split to matter this much. Turns out, the design you pick determines which number you get, and both are defensible. The paper’s real contribution is making you declare which one you’re reporting before anyone asks.<\/p>\n

\n
Chief AI Officer Certification<\/div>\n

Can you tell your board how much of your AI-answer visibility lift was real, and how much was the market growing around you?<\/h3>\n

At Silicon Valley Certification Hub, we help marketing and revenue leaders evaluate and deploy AI that fits their actual business processes, including how to govern the measurement behind it.<\/p>\n

Book a Strategy Call →<\/a>\n<\/div>\n

Key Takeaways for Marketing and Revenue Leaders<\/h2>\n
\n
\n
1<\/div>\n
Keep an untreated control cohort.<\/strong> The naive before-and-after overstated the GEO effect by more than half because it captured platform-wide growth. Hold back a comparable set of questions or markets and compare against them. Without a control, you cannot separate your work from the market’s.<\/div>\n<\/p><\/div>\n
\n
2<\/div>\n
Decide up front whether you are reporting total or direct effect.<\/strong> The paper shows 1.58 total versus 0.70 direct. Both are legitimate, but they answer different questions. Agree with finance which one belongs in the marketing-mix model before the numbers land.<\/div>\n<\/p><\/div>\n
\n
3<\/div>\n
Instrument notice probability, not just mentions.<\/strong> A mention nobody reads is not visibility. The framework’s honesty comes from weighting appearances by the chance they were actually noticed. Most dashboards skip this, which flatters the channel.<\/div>\n<\/p><\/div>\n
\n
4<\/div>\n
Treat GEO and GEM as separate line items.<\/strong> Earned mentions and paid placements have different cost structures and different causal paths. Lumping them into one generative number hides which lever is actually working. Any AI Assessment for companies should score them apart.<\/div>\n<\/p><\/div>\n
\n
5<\/div>\n
Put a Chief AI Officer’s rigor behind the channel.<\/strong> Generative visibility is the fastest-growing discovery path your buyers use, and it is still measured with spreadsheets and vibes. The teams that get this right will fund the channel correctly. The teams that don’t will either overspend on a mirage or starve a real performer. So which one are you right now?<\/div>\n<\/p><\/div>\n<\/div>\n

Thanks to All Authors<\/h2>\n
\n
\n
\n
MK<\/div>\n
\n
Masahiro Kato<\/div>\n
Meiji University, Tokyo, Japan<\/div>\n<\/div><\/div>\n
\n
DH<\/div>\n
\n
Daiki Honma<\/div>\n
Independent Researcher, Tokyo, Japan<\/div>\n<\/div><\/div>\n
\n
TK<\/div>\n
\n
Taka Kato<\/div>\n
Independent Researcher, Tokyo, Japan<\/div>\n<\/div><\/div>\n<\/p><\/div>\n<\/div>\n
\n

Want to know how this applies to your company?<\/p>\n

At Silicon Valley Certification Hub, we help you align AI + Strategy. Our team works directly with your directors and teams to assess AI readiness, identify gaps, and build a clear path forward — tailored to your business context.<\/p>\n

Book a time with our CEO, Alejandro Cuauhtemoc-Mejia:<\/strong>
\n https:\/\/calendar.app.google\/2ihQf2JH3D9uJBe68<\/a><\/p>\n

Silicon Valley Certification Hub — 3000 El Camino Real, Building 4, Palo Alto, CA<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Silicon Valley Certification Hub reviews AI research for Chief AI Officers. Why your generative visibility lift is overstated, and how to measure what counts.<\/p>\n","protected":false},"author":155,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","_monsterinsights_skip_tracking":false,"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"jetpack_seo_schema_type":"","_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[24],"tags":[764,543,544,766,765,542,762,757,763,759,541,480],"class_list":["post-60323","post","type-post","status-publish","format-standard","hentry","category-research","tag-ai-answer-visibility","tag-ai-assessment","tag-ai-for-executives","tag-brand-demand-generation","tag-causal-inference-marketing","tag-chief-ai-officer","tag-generative-engine-marketing","tag-generative-engine-optimization","tag-geo-measurement","tag-marketing-mix-modeling","tag-silicon-valley-certification-hub","tag-svch"],"acf":[],"jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/posts\/60323","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/users\/155"}],"replies":[{"embeddable":true,"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/comments?post=60323"}],"version-history":[{"count":0,"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/posts\/60323\/revisions"}],"wp:attachment":[{"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/media?parent=60323"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/categories?post=60323"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/svch.io\/es\/wp-json\/wp\/v2\/tags?post=60323"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}