Overview
Amazon Quick Web Crawler is a crawler associated with Amazon Web Services, used for crawling and indexing website content for Amazon Quick knowledge bases.
Its primary user-agent pattern is aws-quick-on-behalf-of-; related patterns include aws-quick-on-behalf-of-<UUID>; Amazon Quick Web Crawler; a representative HTTP user-agent is aws-quick-on-behalf-of-<UUID>.
Amazon Quick Web Crawler is Verified from current authoritative identity documentation reviewed on 2026-08-07. The identity type is Official Documented.
Amazon Quick Web Crawler is documented as honoring robots.txt directives.
Treat the user-agent or identity as a claim and corroborate it with published network data, reverse DNS, signed-request evidence, or current operator documentation when available.
Identity
- User-Agent Pattern
-
aws-quick-on-behalf-of- - Aliases
- aws-quick-on-behalf-of-; Amazon Quick Web Crawler
- HTTP Agent Examples
-
aws-quick-on-behalf-of- - Robots Token
- aws-quick-on-behalf-of-
- Identity Type
- Officially documented
- Evidence Method
- Match `aws-quick-on-behalf-of-` to the current operator documentation and corroborate the request with operator-controlled verification signals where available; User-Agent strings alone can be spoofed.
Classification
- Type
- AI
- Kind
- Crawler
- Family
- Amazon Quick
- Purpose
- Knowledge base ingestion
Behavior and handling
- Common Use
- crawling and indexing website content for Amazon Quick knowledge bases
- Detection Notes
- Amazon Quick Web Crawler traffic is primarily detected by `aws-quick-on-behalf-of-`; related patterns include `aws-quick-on-behalf-of-; Amazon Quick Web Crawler`; a representative HTTP user-agent is `aws-quick-on-behalf-of-`. Treat these values as identification claims and corroborate them with source-network ownership, reverse DNS, signed request data, or current operator documentation.
- Respects robots.txt
- Yes
- Spoofing Risk
- Amazon Quick Web Crawler can be spoofed if identification relies only on a user-agent string; corroborate the request with stronger operator-controlled evidence when available.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: aws-quick-on-behalf-of- Disallow: /
Relationships
- Operator
- Amazon Web Services Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.