Claude-SearchBot
Safe
Claude-SearchBot is Anthropic’s search-focused crawler for retrieving web content.
Anthropic Anthropic Ai Ai Search
Verified robots.txt: Yes Block: Depends Official Documented
Claude-User
Neutral
Claude-User represents user-initiated Claude retrieval activity rather than broad background crawling.
Anthropic Anthropic Ai Ai Assistant
Verified robots.txt: Unknown Block: Depends Official Documented
ClaudeBot
Neutral
ClaudeBot is Anthropic’s crawler used to discover and retrieve public web content for Claude-related systems.
Anthropic Anthropic Ai Ai Crawl
Verified robots.txt: Yes Block: Depends Official Documented
