About this bot
Claude-Web is a historical fetcher associated with Anthropic and used for historical ai web fetch.
It can be identified in HTTP traffic by the Claude-Web identity family.
Directory status: Legacy. Identity classification: Unverified with Low confidence. Identity type: historical-observed.
robots.txt behavior is not sufficiently established to claim compliance.
Treat Claude-Web as historical observation only; classify current Anthropic traffic using ClaudeBot, Claude-User, or Claude-SearchBot.
Details
- Kind
- Historical fetcher
- Family
- Anthropic
- Purpose
- Historical AI web fetch
- Common Use
- Historical or observed Claude-associated web retrieval traffic superseded by current canonical Anthropic web identities.
- Respects robots.txt
- Unknown
Verification
- Identity Type
- historical-observed
- Evidence Method
- Treat Claude-Web as historical observation only; classify current Anthropic traffic using ClaudeBot, Claude-User, or Claude-SearchBot.
- Detection Notes
- The current operator documentation does not list Claude-Web as a canonical active web identity.
Website controls
- Robots.txt Snippet
# No stable robots.txt token is established for this identity. Use server-side controls when restriction is required.