About this bot
Amazon Quick Web Crawler is a crawler associated with Amazon Web Services and used for knowledge-base-ingestion.
The primary identifying User-Agent token is aws-quick-on-behalf-of-.
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
This identity is recorded as honoring robots.txt under aws-quick-on-behalf-of-. Site-specific access policy should still be evaluated before enforcement.
Risk classification: Neutral. Recommended handling is to evaluate the request context before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
aws-quick-on-behalf-of- - Also known as
- aws-quick-on-behalf-of-; Amazon Quick Web Crawler Amazon Quick Web Crawler
Details
- Kind
- Crawler
- Family
- Amazon Quick
- Purpose
- Knowledge base ingestion
- Common Use
- crawling and indexing website content for Amazon Quick knowledge experiences and connected knowledge bases
- Respects robots.txt
- Yes
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match the documented `aws-quick-on-behalf-of-` User-Agent pattern. Treat the dynamic UUID-bearing User-Agent as a claimed identity unless stronger request context corroborates it.
- Detection Notes
- Match the stable prefix `aws-quick-on-behalf-of-` and expect a per-crawler UUID suffix.
Website controls
- Robots.txt Snippet
User-agent: aws-quick-on-behalf-of- Disallow: /