About this bot
AI Search External is a external search crawler associated with Cloudflare and used for external ai search indexing.
The primary identifying User-Agent token is Cloudflare-AI-Search-External. Representative HTTP request identity: Cloudflare-AI-Search-External (https://developers.cloudflare.com/ai-search; ai-search@cloudflare.com).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: http message signature.
This identity is recorded as honoring robots.txt under Cloudflare-AI-Search-External.
Risk classification: Neutral. Evaluate request context and site policy before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
Cloudflare-AI-Search-ExternalCloudflare-AI-Search-External (https://developers.cloudflare.com/ai-search; ai-search@cloudflare.com) - Also known as
- Cloudflare AI Search External
Details
- Kind
- External search crawler
- Family
- Cloudflare AI Search
- Purpose
- External AI search indexing
- Common Use
- retrieving external and cross-domain content referenced by Cloudflare AI Search indexes
- Respects robots.txt
- Yes
Verification
- Identity Type
- HTTP message signature
- Evidence Method
- Use `Cloudflare-AI-Search-External` to identify candidate traffic and validate the cryptographic request identity when a signed request is available.
- Detection Notes
- Match `Cloudflare-AI-Search-External` for discovery; prefer the signed request identity when present.
Website controls
- Robots.txt Snippet
User-agent: Cloudflare-AI-Search-External Disallow: /