About this bot
KagiBot is a crawler associated with Kagi Inc. and used for search-indexing.
The primary identifying token is Kagibot. Representative HTTP request identity: Mozilla/5.0 (compatible; KagiBot/1.0; +https://kagi.com/bot).
Directory status: Active. Identity classification: Verified with High confidence.
This identity is recorded as honoring robots.txt under Kagibot.
KagiBot crawls public pages for Kagi search indexing and follows robots.txt controls.
How to identify this bot
- User-agent and crawler identifiers
-
KagibotMozilla/5.0 (compatible; KagiBot/1.0; +https://kagi.com/bot) - Also known as
- KagiBot
Details
- Kind
- Crawler
- Family
- Kagi
- Purpose
- Search indexing
- Common Use
- KagiBot crawls public pages for Kagi search indexing and follows robots.txt controls.
- Respects robots.txt
- Yes
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match `Kagibot` as the documented identity signal and corroborate it with request-context, network, DNS, or cryptographic signals where available.
- Detection Notes
- Match the `Kagibot` identity token in the HTTP User-Agent or documented request identity. User-Agent text alone remains spoofable.
Website controls
- Robots.txt Snippet
User-agent: Kagibot Disallow: /- Apache Rule
RewriteCond %{HTTP_USER_AGENT} Kagibot [NC] RewriteRule .* - [F,L]- Nginx Rule
if ($http_user_agent ~* "Kagibot") { return 403; }