Overview
SmarshBot is a web-archiving crawler operated by Smarsh.
It captures website content for customer-configured compliance, supervision, records-management, and e-discovery workflows.
Its documented HTTP user agent is SmarshBot/1.0. Smarsh also publishes source information that customers can use when allowlisting web-archiving traffic.
The user-agent string can be copied, so confirm the source against current Smarsh documentation or expected customer activity before granting trust.
SmarshBot is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Allow it when the website is enrolled in Smarsh web archiving; otherwise review the source and request pattern before deciding whether to restrict it.
Identity
- User-Agent Pattern
-
SmarshBot - HTTP Agent Examples
-
SmarshBot/1.0 - Robots Token
- SmarshBot
- Identity Type
- Observed
- Evidence Method
- Treat `SmarshBot` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- Archive
- Kind
- Crawler
- Family
- Smarsh
- Purpose
- Web archiving
Behavior and handling
- Common Use
- SmarshBot captures website content for compliance archiving, supervision, records management, and e-discovery.
- Detection Notes
- Detect the exact `SmarshBot/1.0` user agent. Confirm the source against current Smarsh documentation or expected web-archiving activity before granting trust.
- Respects robots.txt
- Unknown
- Spoofing Risk
- Medium because the documented user-agent string can be copied; corroborate it with source information or expected Smarsh archiving activity.
- Risk
- Safe
- Recommended Handling
- Do not block
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.
Relationships
- Operator
- Smarsh Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.