Google Resists Search Opt-Outs as Publisher Traffic Losses Mount

A Regulatory Clash Over the Web's Basic Bargain

Google is pushing back against regulators who want publishers to have a clean way to keep their content out of AI-generated search answers, warning that forcing such a split risks "breaking Search" and producing a fragmented, confusing experience for users 1. The warning came as the UK's Competition and Markets Authority pressed Google to give publishers real control over whether their material feeds AI Overviews and AI Mode, rather than the current all-or-nothing choice between being crawled for everything or vanishing from search entirely 1011. In June, the CMA imposed a formal conduct requirement — a global first — that will let publishers opt out of having their content used to power Google's AI search features, and separately opt out of having it used to fine-tune AI models, with Google given nine months to roll out compliance and required to publish reporting on its progress every six months 11.

Cloudflare, which says it helps run roughly a fifth of the web's infrastructure, argues the CMA didn't go far enough and wants Google compelled to separate its search crawler entirely from its AI crawler 1. That distinction sits at the heart of the fight: a conventional crawler builds an index of links that sends users elsewhere, while an AI system can absorb the same material and generate an answer that keeps the user inside Google's own interface.

From Blue Links to "AI Search Is Search"

The dispute follows two major product shifts. Google rolled out AI Overviews broadly in the United States in May 2024, placing AI-generated summaries above traditional results, then introduced the more expansive AI Mode in 2025 as a conversational alternative that can replace the results page altogether 14. At Google's developer conference, executives described the change as the most significant redesign of the search box in 25 years, with search chief Liz Reid framing AI Mode as an invitation to talk directly with Gemini rather than type a query 1315. Google went as far as declaring, on stage, that "Google Search is AI Search" 13.

Underpinning both features is a technique Google calls query fan-out, in which a single question is broken into subtopics and answered through multiple simultaneous searches, letting the system produce denser, more synthesized answers — sometimes with interactive graphics built on the fly 1213. Google has published guidance insisting there are no special technical requirements to appear in these AI features beyond being indexed and eligible for a normal search snippet, and it discourages publishers from restructuring content purely to please an algorithm 12.

Commentators have described the shift in sharply different terms. The BBC calls the emerging landscape the "machine web," warning of a possible collapse in the ad- and traffic-driven model that has funded websites for three decades 14. The New York Times quotes an analyst declaring "the open web is on its way out," with Google recasting itself as a consumer of "raw data" rather than a router of visitors 15. Platformer describes the same trend as Google's "broken link to the web," built around the slogan "let Google do the Googling for you" 16. Publisher-focused coverage from Press Gazette is more measured, quoting SEO leaders at outlets like the Daily Mail and Bauer Media who argue that "Google zero" narratives are overstated once branded search, direct traffic and Google Discover are factored in 17.

What the Traffic Data Actually Shows

The numbers vary widely depending on methodology, but they consistently point the same direction. Analysis from Authoritas, submitted as part of a legal complaint to the CMA, found clickthrough rates fell 47.5% on desktop and 37.7% on mobile when an AI Overview appeared, even though the feature showed up in only about 12% of the news-related queries studied 18. Ahrefs' review of roughly 300,000 keywords found a 34.5% drop in clicks to the top organic result when an Overview appeared, a figure that grew to 58% in a follow-up study 19.

The strongest evidence comes from a randomized field experiment covering more than 68,000 searches by over a thousand Chrome users, which found AI Overviews cut outbound organic clicks by 39.8% and pushed zero-click searches up by 34.5%, while leaving sponsored clicks and self-reported satisfaction essentially unchanged 1920. Removing the Overview lifted outbound clicks on affected queries from 0.37 to 0.62 per search, concentrated overwhelmingly in the top-ranked position of the page 19. The researchers behind that study, published on SSRN, concluded that AI Overviews divert traffic without measurably improving the user experience 20.

Google disputes the framing of such research, telling the BBC that it sends billions of clicks to websites daily and that AI features connect users to a wider variety of sites 14. Google also maintains that clicks generated through AI Overviews are "higher quality," with users spending more time on destination sites — a claim the field experiment's authors say their data does not support, since downstream engagement showed no measurable difference between groups 1920.

Publishers Are Not All Hit the Same Way

The damage is uneven. Daily Mail and Bauer Media executives told Press Gazette that overall traffic hits have been comparatively contained because so much of their audience arrives through branded searches, direct visits or Discover, even as AI Overviews devastate specific categories like celebrity queries, product recalls and car specifications 17. Independent publisher Candr Media Group described a starker picture, citing staff cuts tied directly to AI Overviews and calling the feature "another dagger" in a relationship with Google that has been deteriorating since the earlier rollout of featured snippets 17.

That unevenness has produced a companion legal track: the Authoritas findings were submitted to the CMA as part of a formal complaint from publisher groups, and separately the Independent Publishers Alliance, Movement for an Open Web and Foxglove filed antitrust complaints with the European Commission and the CMA alleging Google's use of publisher content for AI Overviews causes significant commercial harm 1819.

A Widening Regulatory and Competitive Map

The European Union has moved on a parallel track by formally classifying ChatGPT as a search engine, subjecting it to stricter oversight alongside platforms like Reddit and Roblox 7. That decision reflects a broader regulatory recognition that AI chatbots now function as alternative gateways to information, not just novelties layered atop search.

Research on the accuracy of that alternative gateway is mixed but notable: tests examining how AI chatbots handle foreign propaganda found that mainstream chatbots debunked false narratives more reliably than search engines did, though AI summaries placed above search results performed worse than the chatbots themselves 58. Separately, survey data from Morgan Stanley shows daily use of AI tools climbing among U.S. consumers, particularly younger and white-collar users, suggesting the behavioral shift toward AI-mediated answers is accelerating regardless of the publisher dispute 9.

The New Optimization Playbook

As clicks decouple from rankings, an industry vocabulary has emerged around answer engine optimization, or AEO, alongside related terms like generative engine optimization and large-language-model optimization, all aimed at getting content cited inside AI-generated answers rather than merely ranked as a link 36. Site speed and technical reliability are increasingly cited as differentiators, since AI systems retrieve and synthesize content in ways that reward fast, well-structured pages 4. Structured data and schema markup are also framed as tools for helping both search engines and language models verify a publisher as a trustworthy, citable entity 3.

Google, for its part, continues to insist there is no separate technical playbook required — that ordinary indexing eligibility is sufficient for inclusion in AI Overviews and AI Mode 12. That leaves publishers navigating a genuine tension: invest in a fast-evolving discipline aimed at winning citations inside AI answers, or accept Google's argument that fundamentals of quality and crawlability still govern visibility, even as the payoff from that visibility increasingly arrives without a click at all 26.

What remains unresolved is whether opt-out controls, transparency requirements and antitrust pressure will meaningfully redistribute value back toward the sites that produce the underlying information, or whether Google's warning about "breaking Search" will constrain how far regulators are ultimately willing to go.