Overview
Claude-Web is an agent associated with Anthropic, used for assistant-driven browsing, page retrieval, and automated web access on behalf of an AI product.
Its primary user-agent pattern is Claude-Web.
Claude-Web is unverified with Low confidence. The identity type is Observed. This legacy or noncanonical identity is retained for historical log matching.
Robots.txt behavior for Claude-Web is not confirmed. Do not treat a user-agent-only rule as guaranteed enforcement.
This identity is not included in the operator’s current published crawler list.
Treat the user-agent or identity as a claim and corroborate it with published network data, reverse DNS, signed-request evidence, or current operator documentation when available.
Identity
- User-Agent
Claude-Web- Robots.txt Token
Claude-Web- Identity Type
- Observed
- Evidence Method
- Verify Claude-Web by matching `Claude-Web` to Anthropic evidence, then corroborating the request with source-network ownership, reverse DNS, signed request data, or current operator documentation.
Classification
- Type
- AI
- Kind
- Agent
- Family
- Anthropic
- Purpose
- ai-assistant
Behavior and handling
- Common Use
- Claude-Web is used for assistant-driven browsing, page retrieval, and automated web access on behalf of an AI product.
- Detection Notes
- Claude-Web traffic is primarily detected by `Claude-Web`. Treat these values as identification claims and corroborate them with source-network ownership, reverse DNS, signed request data, or current operator documentation.
- Respects robots.txt
- Unknown
- Spoofing Risk
- Claude-Web can be spoofed if identification relies only on a user-agent string; corroborate the request with stronger operator-controlled evidence when available.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
# Legacy or noncanonical identity. Confirm the current canonical token before relying on robots.txt.