SemrushBot Core

Neutral Block: Depends Verified robots.txt: No

SemrushBot is used by Semrush to gather website data for backlink analytics and link building features.

Key facts

Operator: Semrush
Family: Semrush
Purpose: Site Owner Fetch
User-Agent: SemrushBot
Should you block it?: Depends
Verified: Yes
Respects robots.txt: No
Identity type: Unknown
Confidence: Medium
Last verified: 2026-04-01
Last checked: 2026-04-01

Bot details

Identity

User-Agent: SemrushBot
robots.txt token: SemrushBot
HTTP user-agent: Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) Mozilla/5.0 (compatible; SemrushBot; +http://www.semrush.com/bot.html)
Aliases: SemrushBot/; SemrushBotBacklinks; SemrushBotLinkBuilding; SemrushBot

Ownership

Operator: Semrush
Family: Semrush
Type: Scraper
Purpose: Site Owner Fetch

Verification and trust

Source type: Unknown
Confidence: Medium
Last verified: 2026-04-01
Last checked: 2026-04-01
Verification: Validate the identifying user-agent or signature against the operator documentation before creating hard allow rules.
IP ranges: https://www.semrush.com/bot/
Operator URL: https://www.semrush.com/bot/
Source URL: https://www.semrush.com/bot/
Spoofing risk: User-agent strings can be spoofed. For allow-listing or low-friction rules, pair the published identifier with operator documentation or cryptographic verification when available.

Blocking and detection

Robots

User-agent: SemrushBot
Disallow: /

Cloudflare

(http.user_agent contains "SemrushBot")

Advanced server rules

Apache

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} SemrushBot [NC]
RewriteRule ^ - [F,L]

Nginx

if ($http_user_agent ~* "SemrushBot") { return 403; }

Notes

SemrushBotBacklinks is the Semrush bot collects data for Semrush’s Backlink Analytics tool.

Known user-agent patterns: SemrushBot/ Known user-agent strings: Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) Robots.txt handling in the directory: no.

Operator documentation: https://www.semrush.com/bot/

Evidence and source

Validate the identifying user-agent or signature against the operator documentation before creating hard allow rules.
SemrushBot is used by Semrush to gather website data for backlink analytics and link building features.
User-agent strings can be spoofed. For allow-listing or low-friction rules, pair the published identifier with operator documentation or cryptographic verification when available.

https://www.semrush.com/bot/