Google-Extended
A setting that tells Google whether pages Googlebot collects may be used to train Gemini models and to feed facts into Gemini's answers.
- Run by
- Used for
- Setting for training
- Follows robots.txt
- It is a setting, not a crawler
- Shut out by
- 11% of top websites
What blocking it changes
Google stops using the pages to train Gemini and to feed facts into its answers in the Gemini app and in Google's tools for developers. It does not change Google Search, AI Overviews or AI Mode, which follow the rules for Googlebot.
"Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search."
Google, read 29 Oct 2026
The lines to copy
It has no crawler of its own: Googlebot reads the lines that name Google-Extended.
User-agent: Google-Extended
Disallow: /User-agent: Google-Extended
Allow: /A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.
More from Google
- Googlebot Crawls the web for Google Search, including AI Overviews and AI Mode.