Quick answer
What is xAI-Grok?
xAI-Grok is an AI crawler from xAI used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
Its primary user-agent pattern is xAI-Grok; related patterns include xAI-Grok/1.0; GrokBot/1.0; Grok-DeepSearch/1.0; a representative HTTP user-agent is xAI-Grok/1.0.
xAI-Grok is not independently verified with Low confidence. The identity type is Observed, and the evidence basis is observed traffic evidence with a supporting public reference.
xAI-Grok does not have confirmed robots.txt behavior in the available public evidence.
xAI-Grok should be handled according to the site owner’s AI crawler policy, with allow, block, or rate-limit rules applied deliberately.
xAI-Grok belongs to the xAI Grok bot family.
Identity
How to identify this Bot
- User-Agent
xAI-Grok- robots.txt token
xAI-Grok- HTTP agent
xAI-Grok/1.0- Aliases
xAI-Grok/1.0GrokBot/1.0Grok-DeepSearch/1.0- Operator
- xAI
- Family
- xAI Grok
- Technical kind
- agent
- Identity method
- observed
Behavior
Purpose, behavior, and practical context
- Purpose
- AI search or agentic browsing
- Common use
- xAI-Grok is used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
- Respects robots.txt
- unknown
- Spoofing risk
- xAI-Grok has high spoofing risk because the pattern is low-confidence or observation-based; do not trust the user-agent by itself.
- Detection notes
- xAI-Grok traffic is primarily detected by the `xAI-Grok` user-agent pattern; related patterns include `xAI-Grok/1.0; GrokBot/1.0; Grok-DeepSearch/1.0`; a representative HTTP user-agent is `xAI-Grok/1.0`. Compare source IPs, reverse DNS, request paths, and crawl cadence with xAI infrastructure before trusting the traffic.
Verification and controls
Verification and blocking guidance
- Verification method
- Verify xAI-Grok by matching `xAI-Grok` to xAI evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
- General blocking snippet
User-agent: xAI-GrokDisallow: /
Related records