Overview
Applebot-Extended is a robots.txt control token associated with Apple.
No standalone HTTP request User-Agent. Applebot-Extended is a robots.txt control token; Apple states that it does not crawl webpages and applies to data crawled by Applebot.
Do not treat this token as proof that an HTTP request came from the operator. Verify the underlying crawler traffic using the operator’s documented methods.
Identity
- Aliases
- Apple AI opt-out token
- HTTP Agent Examples
-
No standalone HTTP request User-Agent. Applebot-Extended is a robots.txt control token; Apple states that it does not crawl webpages and applies to data crawled by Applebot. - Robots Token
- Applebot-Extended
- Identity Type
- Control token
- Evidence Method
- Use `Applebot-Extended` as the documented robots.txt control token. Verify underlying crawler requests separately with Apple documentation and network or request-level verification where available.
Classification
- Type
- Control token
- Kind
- Robots control
- Family
- Apple
- Purpose
- AI training control
Behavior and handling
- Common Use
- Applebot-Extended is a robots.txt control token that tells Apple whether content already crawled by Applebot may be used for specified generative-AI model purposes. It does not crawl webpages.
- Detection Notes
- Applebot-Extended is not a standalone HTTP request User-Agent. Do not detect network traffic by matching `Applebot-Extended` in request User-Agent strings unless independent current evidence documents such a request signature.
- Respects robots.txt
- Yes
- Spoofing Risk
- Applebot-Extended is a publisher control token, not an authenticated request identity. A request string containing the token is not proof of operator origin.
- Risk
- Safe
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: Applebot-Extended Disallow: /
Relationships
- Operator
- Apple Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.