Bot intelligence record

ClaudeBot

Review first

Use the ClaudeBot identifier to separate Anthropic AI crawler, assistant, or AI search traffic from normal visitor requests in server logs.

Ai Ai Crawl Official Documented Confidence: High Verified: Yes robots.txt: Yes
Operator
Anthropic
Family
Anthropic
Type
Ai
Source type
Official
Last checked
2026-05-20

User-Agent Pattern

Anthropic
ClaudeBot
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy
User-agent: ClaudeBot Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

Depends

Use this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.

AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.

Record Details

Structured data
Operator
Anthropic
Family
Anthropic
Type
Ai
Purpose
Ai Crawl
Identity type
Official Documented
Confidence
High
Last verified
2026-04-01
Last checked
2026-05-20
Source type
Official
Verification
Anthropic says it does not currently publish IP ranges and may use service-provider public IPs; rely on the official bot token and robots.txt controls.
Spoofing risk
User-agent strings for ClaudeBot can be spoofed. Treat user-agent detection as a classification signal, then verify with published IP ranges, reverse DNS, signatures, operator documentation, or published operator documentation, IP ranges, reverse DNS, signatures, or other verified identity signals before allow-listing.

Notes

ClaudeBot is listed in the Botcrawl directory as an AI crawler from Anthropic. The primary identifier for log review is ClaudeBot.

Identification

  • User-agent pattern: ClaudeBot
  • Family: Anthropic
  • Type: AI
  • Kind: Crawler

Common use

AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.

Verification and handling

Anthropic says it does not currently publish IP ranges and may use service-provider public IPs; rely on the official bot token and robots.txt controls.

Directory guidance marks the risk level as Neutral and the blocking decision as Depends. Do not rely on the user-agent string alone because user-agent strings can be copied or spoofed.

Robots.txt handling: Yes.

Evidence and Source

  • Anthropic says it does not currently publish IP ranges and may use service-provider public IPs; rely on the official bot token and robots.txt controls.
  • Match `ClaudeBot` as a case-insensitive substring in HTTP user-agent logs. Review bot_aliases for alternate names or product labels. Do not treat a user-agent match alone as proof of identity for allow-listing.
  • AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.
  • User-agent strings for ClaudeBot can be spoofed. Treat user-agent detection as a classification signal, then verify with published IP ranges, reverse DNS, signatures, operator documentation, or published operator documentation, IP ranges, reverse DNS, signatures, or other verified identity signals before allow-listing.

Monitor This Bot In Edge

Botcrawl Edge

Use Botcrawl Edge to see matching traffic, create allow or block rules, and control this bot across connected sites.