Overview
Cloudflare Browser Rendering Crawler is an AI crawler from Cloudflare used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
Its primary user-agent pattern is Cloudflare Crawler; related patterns include cloudflare-browser-rendering-crawler; Cloudflare Crawler.
Cloudflare Browser Rendering Crawler is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Cloudflare Browser Rendering Crawler is marked as respecting robots.txt directives for crawler access control.
Cloudflare Browser Rendering Crawler can usually be allowed after confirming the source and monitoring request volume.
Identity
- User-Agent
Cloudflare Crawler- Aliases
- cloudflare-browser-rendering-crawler; Cloudflare Crawler
- HTTP Agent Examples
Cloudflare Crawler- Robots.txt Token
Cloudflare Crawler- Identity Type
- Observed
- Evidence Method
- Treat `Cloudflare Crawler` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- AI
- Kind
- Crawler
- Family
- Cloudflare
- Purpose
- browser rendering crawl
Behavior and handling
- Common Use
- Cloudflare Browser Rendering Crawler is used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
- Detection Notes
- Cloudflare Browser Rendering Crawler traffic is primarily detected by the `Cloudflare Crawler` user-agent pattern; related patterns include `cloudflare-browser-rendering-crawler; Cloudflare Crawler`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Cloudflare infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Cloudflare Browser Rendering Crawler has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Safe
- Recommended Handling
- No
Rules and controls
- Robots.txt Snippet
User-agent: Cloudflare Crawler Disallow: /