Amazon Bedrock Web Crawler

Amazon Bedrock Web Crawler is an AI crawler from Amazon used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

SAFE Ai Verified

User-Agent

bedrockbot

Identity

Identity type: Official Documented
Detection confidence: High
Last verified: 2026-06-20
Respects robots.txt: Yes
Source type: Official
Status: Active

Operator & Purpose

Operator: Amazon
Family: Amazon Bedrock
Type: ai
Purpose: Site Owner Fetch
Aliases: bedrockbot-UUID, bedrockbot_UUID

Handling Guidance

Usually allow

Amazon Bedrock Web Crawler is used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Detection & Verification

Verification

Verify Amazon Bedrock Web Crawler by matching `bedrockbot` to Amazon evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.

Detection Basis

Amazon Bedrock Web Crawler traffic is primarily detected by the `bedrockbot` user-agent pattern; related patterns include `bedrockbot-UUID, bedrockbot_UUID`; a representative HTTP user-agent is `bedrockbot_UUID`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Amazon infrastructure before trusting the traffic.

Observed User-Agent

bedrockbot_UUID

Spoofing Risk

Amazon Bedrock Web Crawler has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.

Robots.txt

Use as a public reference. Confirm enforcement decisions with live traffic evidence.

User-agent: bedrockbot
Disallow: /

Use in Botcrawl Edge

Use this record in Botcrawl Edge to match live traffic, create rules, monitor request history, and enforce bot policy across connected sites.

Primary source Operator URL Open in Edge BotDB