BotDB Record

Cloudflare Browser Run Crawl Endpoint

Review first

Cloudflare Browser Run Crawl Endpoint is a developer Platform from Cloudflare used for Cloudflare Browser Run Crawl Endpoint is used for Cloudflare Browser Run Crawl Endpoint is used by the Browser Run /crawl endpoint to crawl third-party websites on behalf of Cloudflare customers; it appears in server logs as `CloudflareBrowserRenderingCrawler/1.0`.

Developer Platform Browser Rendering Crawl Official Documented Confidence: High Verified: Yes robots.txt: Unknown
Operator
Cloudflare
Family
Cloudflare
Source type
Official
Last checked
2026-06-22

User-Agent Signal

Cloudflare
CloudflareBrowserRenderingCrawler/1.0
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy 
User-agent: CloudflareBrowserRenderingCrawler/1.0
Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

Depends

Use this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.

Cloudflare Browser Run Crawl Endpoint is used for Cloudflare Browser Run Crawl Endpoint is used by the Browser Run /crawl endpoint to crawl third-party websites on behalf of Cloudflare customers.

Intelligence Details

BotDB fields
Operator
Cloudflare
Family
Cloudflare
Type
Developer Platform
Purpose
Browser Rendering Crawl
Identity type
Official Documented
Confidence
High
Last verified
2026-06-22
Last checked
2026-06-22
Source type
Official
Verification
Verify Cloudflare Browser Run Crawl Endpoint by matching `CloudflareBrowserRenderingCrawler/1.0` to Cloudflare evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Spoofing risk
Cloudflare Browser Run Crawl Endpoint has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.

Notes

  • Cloudflare Browser Run Crawl Endpoint is a developer Platform from Cloudflare used for Cloudflare Browser Run Crawl Endpoint is used for Cloudflare Browser Run Crawl Endpoint is used by the Browser Run /crawl endpoint to crawl third-party websites on behalf of Cloudflare customers.
  • Its primary user-agent pattern is CloudflareBrowserRenderingCrawler/1.0; related patterns include Cloudflare Browser Rendering Crawler; Cloudflare Browser Run crawler; Cloudflare /crawl endpoint.
  • Cloudflare Browser Run Crawl Endpoint is verified with High confidence. The identity type is Official Documented, and the evidence basis is official operator documentation.
  • Cloudflare Browser Run Crawl Endpoint does not have confirmed robots.txt behavior in the available public evidence.
  • Cloudflare Browser Run Crawl Endpoint should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.

Evidence and Source

  • Verify Cloudflare Browser Run Crawl Endpoint by matching `CloudflareBrowserRenderingCrawler/1.0` to Cloudflare evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
  • Cloudflare Browser Run Crawl Endpoint traffic is primarily detected by the `CloudflareBrowserRenderingCrawler/1.0` user-agent pattern; related patterns include `Cloudflare Browser Rendering Crawler; Cloudflare Browser Run crawler; Cloudflare /crawl endpoint`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Cloudflare infrastructure before trusting the traffic.
  • Cloudflare Browser Run Crawl Endpoint is used for Cloudflare Browser Run Crawl Endpoint is used by the Browser Run /crawl endpoint to crawl third-party websites on behalf of Cloudflare customers.
  • Cloudflare Browser Run Crawl Endpoint has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.

https://developers.cloudflare.com/browser-run/reference/automatic-request-headers/

Same family: Cloudflare

Cloudflare-AI-Search-External Neutral

AI Search External

AI Search External is an AI search crawler from Cloudflare used for AI search indexing, answer retrieval, citation discovery.

Operator and family: Cloudflare Type: Ai Search Purpose: Ai Search Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
bushbaby/ Neutral

Cloudflare Bushbaby

Cloudflare Bushbaby is a security scanner from Cloudflare used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Cloudflare Type: Security Purpose: Certificate Management
Verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
Cloudflare-Validator/1.0 Neutral

Cloudflare Validator

Cloudflare Validator is a verification from Cloudflare used for markup validation, accessibility testing, structured-data review.

Operator and family: Cloudflare Type: Verification Purpose: Bot Directory Validation
Verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
CloudflareWebScanner Neutral

Cloudflare Web Scanner

Cloudflare Web Scanner is a scanner from Cloudflare used for Cloudflare Web Scanner is used for Cloudflare Web Scanner checks liveness, content type, robots.txt directives.

Operator and family: Cloudflare Type: Scanner Purpose: Web Property Scanning
Verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB

Same operator: Cloudflare

cloudflare-browser-rendering Neutral

Cloudflare Browser Run

Cloudflare Browser Run is an AI crawler from Cloudflare used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Cloudflare Family: Cloudflare Browser Run Type: Ai Purpose: Browser Rendering
Verified robots.txt: Unknown Block: Depends Signed Agent
View Record Open in Edge BotDB
cloudflare-csup Neutral

Cloudflare CSUP

Cloudflare CSUP is a diagnostics from Cloudflare used for Cloudflare CSUP is used for Cloudflare CSUP is used by Cloudflare customer support for diagnostic investigations of customer websites.

Operator and family: Cloudflare Type: Diagnostics Purpose: Support Diagnostics
Verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
Cloudflare-diagnostics Neutral

Cloudflare Support Diagnostics

Cloudflare Support Diagnostics is a diagnostics from Cloudflare used for Cloudflare Support Diagnostics is used for Cloudflare Support Diagnostics performs error checks and continuous monitoring used for support and dashboard alerts.

Operator and family: Cloudflare Type: Diagnostics Purpose: Support Diagnostics
Verified robots.txt: Unknown Block: Depends Official Documented
View Record Open in Edge BotDB
developers.cloudflare.com/security-center Neutral

Cloudflare Security Insights

Cloudflare Security Insights is a security scanner from Cloudflare used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Cloudflare Type: Security Purpose: Security Insights
Verified robots.txt: Unknown Block: Depends Official Documented
View Record Open in Edge BotDB

Use in Botcrawl Edge

Botcrawl Edge

Match this signal against live requests, related datacenter traffic, and rule actions in Edge.

Open Edge Open in Edge BotDB