Overview
Cloudflare AutoRAG is an AI search crawler from Cloudflare used for AI search indexing, answer retrieval, citation discovery, and page freshness checks.
Its primary user-agent pattern is Cloudflare-AutoRAG.
Cloudflare AutoRAG is Verified from current authoritative identity documentation reviewed on 2026-08-07. The identity type is Official Documented.
Cloudflare AutoRAG is marked as respecting robots.txt directives for crawler access control.
Cloudflare AutoRAG can usually be allowed after confirming the source and monitoring request volume.
Identity
- User-Agent
Cloudflare-AutoRAG- Robots.txt Token
Cloudflare-AutoRAG- Identity Type
- Official Documented
- Evidence Method
- Match `Cloudflare-AutoRAG` to the current operator documentation and corroborate the request with operator-controlled verification signals where available; User-Agent strings alone can be spoofed.
Classification
- Type
- AI
- Kind
- Crawler
- Family
- Cloudflare AutoRAG
- Purpose
- ai-search
Behavior and handling
- Common Use
- Cloudflare AutoRAG is used for AI search indexing, answer retrieval, citation discovery, and page freshness checks.
- Detection Notes
- Cloudflare AutoRAG traffic is primarily detected by the `Cloudflare-AutoRAG` user-agent pattern. Compare source IPs, reverse DNS, request paths, and crawl cadence with Cloudflare infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Cloudflare AutoRAG has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Safe
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
User-agent: Cloudflare-AutoRAG Disallow: /