Bot intelligence record

Grok-DeepSearch

Review first

Grok-DeepSearch is an AI crawler from xAI used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access; it appears in server logs as `Grok-DeepSearch`.

Ai AI Search Or Deep Research Observed Confidence: Low Verified: No robots.txt: Unknown
Operator
xAI
Family
xAI Grok
Type
Ai
Source type
Observed
Last checked
2026-06-02

User-Agent Pattern

xAI
Grok-DeepSearch
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy
User-agent: Grok-DeepSearch
Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

Depends

Use this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.

Grok-DeepSearch is used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Record Details

Structured data
Operator
xAI
Family
xAI Grok
Type
Ai
Purpose
AI Search Or Deep Research
Identity type
Observed
Confidence
Low
Last verified
2026-06-02
Last checked
2026-06-02
Source type
Observed
Verification
Verify Grok-DeepSearch by matching `Grok-DeepSearch` to xAI evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Spoofing risk
Grok-DeepSearch has high spoofing risk because the pattern is low-confidence or observation-based; do not trust the user-agent by itself.

Notes

  • Grok-DeepSearch is an AI crawler from xAI used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
  • Its primary user-agent pattern is Grok-DeepSearch; related patterns include Grok-DeepSearch/1.0; GrokBot/1.0; xAI-Grok/1.0; a representative HTTP user-agent is Grok-DeepSearch/1.0.
  • Grok-DeepSearch is not independently verified with Low confidence. The identity type is Observed, and the evidence basis is observed traffic evidence with a supporting public reference.
  • Grok-DeepSearch does not have confirmed robots.txt behavior in the available public evidence.
  • Grok-DeepSearch should be handled according to the site owner’s AI crawler policy, with allow, block, or rate-limit rules applied deliberately.
  • Grok-DeepSearch belongs to the xAI Grok bot family.

Evidence and Source

  • Verify Grok-DeepSearch by matching `Grok-DeepSearch` to xAI evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
  • Grok-DeepSearch traffic is primarily detected by the `Grok-DeepSearch` user-agent pattern; related patterns include `Grok-DeepSearch/1.0; GrokBot/1.0; xAI-Grok/1.0`; a representative HTTP user-agent is `Grok-DeepSearch/1.0`. Compare source IPs, reverse DNS, request paths, and crawl cadence with xAI infrastructure before trusting the traffic.
  • Grok-DeepSearch is used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
  • Grok-DeepSearch has high spoofing risk because the pattern is low-confidence or observation-based; do not trust the user-agent by itself.

Monitor This Bot In Edge

Botcrawl Edge

Use Botcrawl Edge to see matching traffic, identify related datacenter activity, and create allow, block, rate-limit, or log rules across connected sites.