Blocking Google-Extended does not hide your site from Google AI Overviews. This is one of the most widespread misunderstandings in AI search optimization, and getting it wrong can lead to a choice you did not intend.
Here is the short version: Google-Extended controls whether Google uses your content for certain generative-AI training purposes. It does not control the regular Googlebot crawler, your search rankings, or whether your pages can appear in AI Overviews. Those are governed by normal search indexing.
What Google-Extended actually controls
Google introduced Google-Extended as a distinct user-agent token so site owners could opt out of having their content used to improve Google's generative AI products — specifically Gemini apps and the Vertex AI generative APIs. Adding a Disallow rule for this agent tells Google you do not want your content used for those purposes.
The key word is training. This flag is about how Google *uses* crawled content for model development, not about whether Google can find, index, or rank your pages.
What it does NOT control
- Googlebot. The standard crawler that indexes the web for Search is a separate agent. A
Google-Extendedrule does not touch it. - Search rankings. Blocking
Google-Extendedhas no direct effect on where you rank in ordinary Google results. - AI Overviews inclusion. AI Overviews draw on the regular Google Search index. Whether a page can appear there depends on normal crawlability, indexability, and the same quality signals that affect Search — not on
Google-Extended.
Google has stated this distinction directly: the flag is an opt-out for specific AI training uses, and it does not change your presence in Search or AI Overviews.
The exact robots.txt rules
To opt out of the AI training uses:
User-agent: Google-Extended
Disallow: /
To explicitly allow them (equivalent to not mentioning the agent at all):
User-agent: Google-Extended
Allow: /
That is the whole configuration. There is nothing else to add.
Note that because crawlers are allowed by default, the absence of any Google-Extended rule means those uses are permitted. Adding Disallow: / is an affirmative opt-out.
So what should you actually do?
Separate the two decisions:
Decision 1 — training policy. Do you want your content used to improve Gemini and Vertex generative models? If no, block Google-Extended. If you have no objection, leave it allowed. This is a policy choice with no direct visibility cost.
Decision 2 — AI Overview visibility. If you want to appear in AI Overviews, focus on the things that actually influence that: make pages crawlable by Googlebot, avoid noindex, keep content fresh and answer-first, use clear headings and structured data, and build authority. Blocking or allowing Google-Extended is not part of this decision.
Conflating the two is what causes bad outcomes. A site owner who blocks Google-Extended hoping to *avoid* AI Overviews will be disappointed — it does not do that. A site owner who leaves it allowed hoping to *appear* in AI Overviews is also relying on a factor that does not drive inclusion.
How to verify your configuration
- Fetch
https://yoursite.com/robots.txtand find theGoogle-Extendedblock. - Run the free check at https://ai.ynnadmusic.uk, which reports the decision for
Google-Extendedalongside 18 other crawlers. - Separately confirm Googlebot can crawl your key pages: check that they return 200, are not
noindex, and appear in your sitemap.
For the wider distinction between training and search agents, see Every AI crawler in 2026. For practical steps to appear in AI Overviews, see how to get cited in Google AI Overviews.
Frequently asked questions
Will blocking Google-Extended remove my site from AI Overviews?
No. AI Overviews use the regular Google Search index, which is built by Googlebot. A Google-Extended rule does not affect that index or your eligibility to appear in it.
Does Google-Extended affect normal Google search rankings?
No. It is an opt-out for specific generative-AI training uses. Ordinary ranking in Google Search is governed by Googlebot crawling and standard ranking signals.
If I allow Google-Extended, am I guaranteed to be cited in Gemini?
No. Allowing it permits certain training uses; it does not guarantee citation in any generative answer. Citation depends on relevance, authority, and how well your content answers the specific question.
Is Google-Extended the same as OAI-SearchBot or GPTBot?
No. Those belong to OpenAI and are governed by their own rules in robots.txt. Each vendor's agents are controlled independently. See the AI crawler list for the full comparison.