Overview
Google-Extended is a robots.txt control token associated with Google.
No standalone HTTP request User-Agent. Google-Extended is a robots.txt product token; underlying crawling uses existing Google User-Agent strings.
Do not treat this token as proof that an HTTP request came from the operator. Verify the underlying crawler traffic using the operator’s documented methods.
Identity
- Aliases
- Google AI opt-out token
- HTTP Agent Examples
-
No standalone HTTP request User-Agent. Google-Extended is a robots.txt product token; underlying crawling uses existing Google User-Agent strings. - Robots Token
- Google-Extended
- Identity Type
- Control token
- Evidence Method
- Use `Google-Extended` as the documented robots.txt control token. Verify underlying crawler requests separately with Google documentation and network or request-level verification where available.
Classification
- Type
- Control token
- Kind
- Robots control
- Family
- Purpose
- AI training control
Behavior and handling
- Common Use
- Google-Extended is used for assistant-driven browsing, page retrieval, and automated web access on behalf of an AI product.
- Detection Notes
- Google-Extended is not a standalone HTTP request User-Agent. Do not detect network traffic by matching `Google-Extended` in request User-Agent strings unless independent current evidence documents such a request signature.
- Respects robots.txt
- Yes
- Spoofing Risk
- Google-Extended is a publisher control token, not an authenticated request identity. A request string containing the token is not proof of operator origin.
- Risk
- Safe
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: Google-Extended Disallow: /
Relationships
- Operator
- Google Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.