Bot intelligence record

Claude-User

Review first

Use the Claude-User identifier to separate Anthropic AI crawler, assistant, or AI search traffic from normal visitor requests in server logs.

Ai Ai Assistant Official Documented Confidence: High Verified: Yes robots.txt: Unknown
Operator
Anthropic
Family
Anthropic
Type
Ai
Source type
Official
Last checked
2026-05-20

User-Agent Pattern

Anthropic
Claude-User
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy 
User-agent: Claude-User Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

Depends

Use this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.

AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.

Record Details

Structured data
Operator
Anthropic
Family
Anthropic
Type
Ai
Purpose
Ai Assistant
Identity type
Official Documented
Confidence
High
Last verified
2026-04-01
Last checked
2026-05-20
Source type
Official
Verification
Anthropic does not currently publish dedicated IP ranges; use the official token and robots.txt controls.
Spoofing risk
User-agent strings for Claude-User can be spoofed. Treat user-agent detection as a classification signal, then verify with published IP ranges, reverse DNS, signatures, operator documentation, or published operator documentation, IP ranges, reverse DNS, signatures, or other verified identity signals before allow-listing.

Notes

Claude-User is listed in the Botcrawl directory as an AI agent from Anthropic. The primary identifier for log review is Claude-User.

Identification

  • User-agent pattern: Claude-User
  • Family: Anthropic
  • Type: AI
  • Kind: Agent

Common use

AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.

Verification and handling

Anthropic does not currently publish dedicated IP ranges; use the official token and robots.txt controls.

Directory guidance marks the risk level as Neutral and the blocking decision as Depends. Do not rely on the user-agent string alone because user-agent strings can be copied or spoofed.

Robots.txt handling: Unknown.

Evidence and Source

  • Anthropic does not currently publish dedicated IP ranges; use the official token and robots.txt controls.
  • Match `Claude-User` as a case-insensitive substring in HTTP user-agent logs. Review bot_aliases for alternate names or product labels. Do not treat a user-agent match alone as proof of identity for allow-listing.
  • AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.
  • User-agent strings for Claude-User can be spoofed. Treat user-agent detection as a classification signal, then verify with published IP ranges, reverse DNS, signatures, operator documentation, or published operator documentation, IP ranges, reverse DNS, signatures, or other verified identity signals before allow-listing.

https://privacy.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler

Same family: Anthropic

ClaudeBot Neutral

ClaudeBot

ClaudeBot is Anthropic’s crawler used to discover and retrieve public web content for Claude-related systems.

Operator and family: Anthropic Type: Ai Purpose: Ai Crawl
Verified robots.txt: Yes Block: Depends Official Documented
Claude-SearchBot Safe

Claude-SearchBot

Claude-SearchBot is Anthropic’s search-focused crawler for retrieving web content.

Operator and family: Anthropic Type: Ai Purpose: Ai Search
Verified robots.txt: Yes Block: Depends Official Documented

Same operator: Anthropic

Claude-Code Neutral

Claude-Code

Claimed Claude Code user-agent identifier associated with Anthropic developer-agent workflows.

Operator: Anthropic Family: Claude Type: Ai Purpose: Developer Agent Fetch
Not verified robots.txt: Unknown Block: Depends Observed

Similar purpose: Ai Assistant

TwinAgent Neutral

TwinAgent

TwinAgent is an AI fetcher from Twin used for AI-related crawling, retrieval, search, or assistant activity.

Operator and family: Twin Type: Ai Purpose: Ai Assistant
Verified robots.txt: No Block: Depends Verified Bot
SpyglassesBot Neutral

Spyglasses Bot

Spyglasses Bot evaluates website content to identify issues that would affect visibility by AI assistants.

Operator and family: Spyglasses Type: Ai Purpose: Ai Assistant
Verified robots.txt: No Block: Depends Verified Bot
Perplexity-User Neutral

Perplexity-User

Perplexity-User is an AI agent from Perplexity used for AI-related crawling, retrieval, search, or assistant activity.

Operator and family: Perplexity Type: Ai Purpose: Ai Assistant
Verified robots.txt: Unknown Block: Depends Verified Bot
Nava/ Neutral

Nava Labs ASP (Dev)

Bot to assist social workers in navigating safety net benefit websites.

Operator: Nava Labs Family: Nava Type: Ai Purpose: Ai Assistant
Verified robots.txt: No Block: Depends Verified Bot

Monitor This Bot In Edge

Botcrawl Edge

Use Botcrawl Edge to see matching traffic, create allow or block rules, and control this bot across connected sites.

Get Edge Now Open BotDB