About this bot
CragCrawler is associated with Unknown and used for unknown.
The primary identifying User-Agent token is CragCrawler.
Directory status: Active. Identity classification: Unverified with Low confidence.
robots.txt behavior is currently unconfirmed.
Risk classification: Neutral. Recommended handling: depends.
How to identify this bot
- User-agent and crawler identifiers
-
CragCrawler
Details
- Kind
- Crawler
- Family
- CragCrawler
- Purpose
- Unknown
- Common Use
- CragCrawler is used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
- Respects robots.txt
- Unknown
Verification
- Identity Type
- Observed
- Evidence Method
- Treat `CragCrawler` as an observed identity until operator documentation is available.
- Detection Notes
- Detect `CragCrawler` in the User-Agent. Treat the header as a claim unless corroborated by stronger operator-controlled signals.
Website controls
- Robots.txt Snippet
# robots.txt behavior is unconfirmed. Use server-side controls if restriction is required.