Official Confidence: High Official Documented
SplitSignalBot
Crawler for SplitSignal SEO testing workflows.
Verified robots.txt: Yes Safe Block: Depends
Semrush Content Marketing bot that crawls websites for content analysis.
User-agent: SemrushBot-CT
Disallow: /(http.user_agent contains "SemrushBot-CT")RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} SemrushBot\-CT [NC]
RewriteRule ^ - [F,L]if ($http_user_agent ~* "SemrushBot-CT") { return 403; }Semrush Content Marketing bot that crawls websites for content analysis.
SemrushBot-CT is operated by Semrush. Botcrawl classifies it as a search bot with a primary purpose of site owner fetch.
Key profile signals: risk level: neutral; robots.txt: yes; verified: yes.
Verify the exact user-agent and confirm Semrush ownership using Semrush’s published bot documentation.
Source documentation: https://www.semrush.com/bot.html
Crawler for SplitSignal SEO testing workflows.
Check for over 130 common website issues and get special reports about your site’s crawlability, use of markups, internal linking, speed/performance, HTTPS, and…
Data collected by SEMrushBot is used for the On Page SEO Checker and SEO Content template tools reports Data collected by SEMrushBot is used for the Topic Research tool…
Data collected by SEMrushBot is used for the SEO Writing Assistant tool to check if URL is accessible
SemrushBot crawls websites for Semrush backlink analytics and link building tools.
Semrush is an all-in-one tool suite for improving online visibility and discovering marketing insights.
Semrushbot crawls your website to analyze it for different SEO and technical issues.
Data collected by SEMrushBot is used for the Backlink Audit tool to check website backlinks
WordPress automated testing platform
Web classifier: fetches a site’s homepage to assign a category and rechecks periodically.
Robin automatically scans school websites in the UK, providing compliance checks against statutory requirements.
OKX Dolphin Crawler simulates visits to target web pages as part of malicious dApp scanning