Claude-SearchBot
Safe
Claude-SearchBot is Anthropic’s search-focused crawler for retrieving web content.
Operator and family: Anthropic
Type: Ai
Purpose: Ai Search
Verified robots.txt: Yes Block: Depends Official Documented
Claude-User
Neutral
Claude-User represents user-initiated Claude retrieval activity rather than broad background crawling.
Operator and family: Anthropic
Type: Ai
Purpose: Ai Assistant
Verified robots.txt: Unknown Block: Depends Official Documented
ClaudeBot
Neutral
ClaudeBot is Anthropic’s crawler used to discover and retrieve public web content for Claude-related systems.
Operator and family: Anthropic
Type: Ai
Purpose: Ai Crawl
Verified robots.txt: Yes Block: Depends Official Documented
