Overview
kagi-fetcher is an AI search crawler from Kagi used for AI search indexing, answer retrieval, citation discovery, and page freshness checks.
Its primary user-agent pattern is kagi-fetcher.
kagi-fetcher is not independently verified with Medium confidence. The identity type is Observed, and the evidence basis is observed traffic patterns and user-agent evidence.
Robots.txt behavior is not currently confirmed.
kagi-fetcher should be handled according to the site owner’s AI crawler policy, with allow, block, or rate-limit rules applied deliberately.
Identity
- User-Agent
kagi-fetcher- Robots.txt Token
kagi-fetcher- Identity Type
- Observed
- Evidence Method
- Verify kagi-fetcher by matching `kagi-fetcher` to Kagi evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- AI
- Kind
- Fetcher
- Family
- Kagi
- Purpose
- ai-search
Behavior and handling
- Common Use
- kagi-fetcher is used for AI search indexing, answer retrieval, citation discovery, and page freshness checks.
- Detection Notes
- kagi-fetcher traffic is primarily detected by the `kagi-fetcher` user-agent pattern. Compare source IPs, reverse DNS, request paths, and crawl cadence with Kagi infrastructure before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- kagi-fetcher has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.