Bot Intelligence Record

SemrushBot-OCOB

SemrushBot-OCOB is an AI crawler from Semrush used for AI-related crawling, retrieval, search, or assistant activity.

SemrushBot-OCOB
OperatorSemrush
FamilySemrush
Typeai
Riskneutral
Blockdepends
Verified1
Verification Guidance

User-agent strings can be copied. Use this record for identification, logging, filtering, and review. For allow lists or low-friction rules, pair the identifier with operator documentation, reverse DNS, IP ranges, request signatures, or another verification method when available.

Identification

User-Agent: SemrushBot-OCOB

HTTP Agent: Mozilla/5.0 (compatible; SemrushBot-OCOB/1; +https://www.semrush.com/bot/)

Robots Token: SemrushBot-OCOB

Purpose: ai-training

Identity: verified-bot

Handling

Common Use: AI crawling, assistant retrieval, AI search, or model-supporting discovery depending on the user-agent.

Detection Notes: Match `SemrushBot-OCOB` as a case-insensitive substring in HTTP user-agent logs. Use bot_http_agent for full user-agent examples when the client sends a longer browser-like string. Do not treat a user-agent match alone as proof of identity for allow-listing.

Risk: neutral

Should Block: depends

Respects Robots: no

Rules

Block Snippet

User-agent: SemrushBot-OCOB Disallow: /

Sources

Source

Operator

Related Bots

WordPress neutral

WordPress Namecheap

This is the major egress IP for our containerised WordPress platform so it is likely to be many flavours of WordPress and the potential to be any domain.

Operator: namecheap Family: namecheap Type: ai Purpose: ai-training
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot
vercel-build-container neutral

Vercel build container

Vercel build container is an AI crawler from Vercel used for AI-related crawling, retrieval, search, or assistant activity.

Operator: Vercel Family: Vercel Type: ai Purpose: ai-training
Verified: 1 Robots: unknown Block: depends Confidence: medium Identity: verified-bot
TwinAgent neutral

TwinAgent

TwinAgent is an AI fetcher from Twin used for AI-related crawling, retrieval, search, or assistant activity.

Operator: Twin Family: Twin Type: ai Purpose: ai-assistant
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot
SpyglassesBot neutral

Spyglasses Bot

Spyglasses Bot evaluates website content to identify issues that would affect visibility by AI assistants.

Operator: Spyglasses Family: Spyglasses Type: ai Purpose: ai-assistant
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot
SplitSignalBot safe

SplitSignalBot

SplitSignalBot is a search crawler from Semrush used for search indexing, page discovery, or content rendering.

Operator: Semrush Family: Semrush Type: search Purpose: indexing
Verified: 1 Robots: yes Block: depends Confidence: high Identity: official-documented
SiteAuditBot neutral

SiteAuditBot

Check for over 130 common website issues and get special reports about your site’s crawlability, use of markups, internal linking, speed/performance, HTTPS, and international SEO.

Operator: Semrush Family: Semrush Type: search Purpose: indexing
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot