Overview
UmaiBot collects publicly accessible AI infrastructure and website metadata for the UMAI Public AI Index.
UMAI documents its UmaiBot/1.0 user agent and robots.txt handling for web ingestion requests, while distinguishing other network-measurement components.
Identification: UmaiBot. Robots.txt token: UmaiBot.
Operator documentation: https://umai.entelijan.com/methodology.
Identity
- User-Agent Pattern
-
UmaiBot - HTTP Agent Examples
-
UmaiBot/1.0 (+https://umai.entelijan.com/methodology) - Robots Token
- UmaiBot
- Identity Type
- Officially documented
- Evidence Method
- Verify the documented request signature or provider IP/network where available; a matching User-Agent string alone is not proof of origin.
Classification
- Type
- Security
- Kind
- Internet measurement crawler
- Family
- ENTELIJAN / UMAI
- Purpose
- AI infrastructure measurement
Behavior and handling
- Common Use
- retrieving public website and AI-service metadata
- Detection Notes
- Match HTTP User-Agent token UmaiBot; Robots compliance applies to ingestion requests; operator says network sweeps and fixed API probes may be treated separately. Umai-Scanner is a distinct user-agent and operation.
- Respects robots.txt
- Yes
- Spoofing Risk
- The UmaiBot token can be spoofed in an HTTP User-Agent. Do not trust the token without independent corroboration.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: UmaiBot Disallow: /
Relationships
- Operator
- ENTELIJAN / UMAI Checked 2026-10-22
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.