Overview
KagiBot is operated by Kagi and is used for Crawling web pages for the Kagi search index.
Its documented identity is Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot). The robots.txt token is Kagibot.
It follows robots.txt rules addressed to Kagibot.
Match the Kagibot token and verify that the source IP or hostname appears in Kagi's current first-party bot documentation. Refresh any copied address list before using it.
Identity
- User-Agent
Kagibot- Aliases
- Kagibot/; Kagi search crawler
- HTTP Agent Examples
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot)- Robots.txt Token
Kagibot- Identity Type
- Official Documented
- Evidence Method
- Match the Kagibot token and verify that the source IP or hostname appears in Kagi's current first-party bot documentation. Refresh any copied address list before using it.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- Kagi
- Purpose
- search-indexing
Behavior and handling
- Common Use
- Crawling web pages for the Kagi search index.
- Detection Notes
- Use the Kagibot token and Kagi's current documented source hosts or addresses. Kagi states that standard robots.txt directives targeting Kagibot are respected.
- Respects robots.txt
- Yes
- Spoofing Risk
- A copied Kagibot user agent is not proof of origin; verify the published source infrastructure.
- Risk
- Safe
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
User-agent: Kagibot Disallow: /- Apache Rule
RewriteCond %{HTTP_USER_AGENT} Kagibot [NC] RewriteRule .* - [F,L]- Nginx Rule
if ($http_user_agent ~* "Kagibot") { return 403; }