About this bot
AIWebIndex-Agent is a user triggered fetcher associated with Lyrenth and used for on demand ai readable index fetching.
The primary identifying User-Agent token is AIWebIndex-Agent. Representative HTTP request identity: AIWebIndex-Agent/2.0 (+https://lyrenth.com/bot; on-demand index fetch).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: http message signature.
This identity is recorded as honoring robots.txt under AIWebIndex.
Risk classification: Neutral. Evaluate request context and site policy before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
AIWebIndex-AgentAIWebIndex-Agent/2.0 (+https://lyrenth.com/bot; on-demand index fetch)AIWebIndex - Also known as
- AIWebIndex-Agent/2.0
Details
- Kind
- User-triggered fetcher
- Family
- Lyrenth
- Purpose
- On demand AI readable index fetching
- Common Use
- on-demand retrieval and refresh of AI-readable indexed content requested by agents
- Respects robots.txt
- Yes
Verification
- Identity Type
- HTTP message signature
- Evidence Method
- Use `AIWebIndex-Agent` to identify candidate traffic and validate the cryptographic request identity when a signed request is available.
- Detection Notes
- Match `AIWebIndex-Agent` for discovery; prefer the signed request identity when present.
Website controls
- Robots.txt Snippet
User-agent: AIWebIndex Disallow: /- Apache Rule
RewriteCond %{HTTP_USER_AGENT} "AIWebIndex\-Agent" [NC] RewriteRule ^ - [F,L]- Nginx Rule
if ($http_user_agent ~* "AIWebIndex\-Agent") { return 403; }