About this bot
ScrunchAI-testbot is a crawler associated with Scrunch AI and used for ai-visibility-validation.
The primary identifying User-Agent token is ScrunchAI-testbot. Representative HTTP request identity: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ScrunchAI-testbot/1.0; +https://scrunchai.com/bots).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
This identity is recorded as honoring robots.txt under ScrunchAI-testbot. Site-specific access policy should still be evaluated before enforcement.
Risk classification: Neutral. Recommended handling is to evaluate the request context before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
ScrunchAI-testbotMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ScrunchAI-testbot/1.0; +https://scrunchai.com/bots)
Details
- Kind
- Crawler
- Family
- Scrunch AI
- Purpose
- AI visibility validation
- Common Use
- validation checks for Scrunch AI website analysis
- Respects robots.txt
- Yes
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match `ScrunchAI-testbot` as the claimed identity signal and corroborate it with independent network, DNS, cryptographic, or request-context signals when stronger authentication is required.
- Detection Notes
- Match the `ScrunchAI-testbot` User-Agent token. A User-Agent match identifies a claim, not authenticated origin.
Website controls
- Robots.txt Snippet
User-agent: ScrunchAI-testbot Disallow: /- Apache Rule
SetEnvIfNoCase User-Agent "ScrunchAI\-testbot" bot_match- Nginx Rule
if ($http_user_agent ~* "ScrunchAI\-testbot") { set $bot_match 1; }