Overview
Netcraft is a monitoring bot used for security scanning, malware checks, vulnerability assessment, certificate review, and site-safety analysis.
Its primary user-agent pattern is Netcraft; a representative HTTP user-agent is Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) Mozilla/4.0 (compatible; Netcraft Web Server Survey).
Netcraft is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Robots.txt behavior is not currently confirmed.
Netcraft can usually be allowed after confirming the source and monitoring request volume.
Identity
- User-Agent Pattern
-
Netcraft - HTTP Agent Examples
-
Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) Mozilla/4.0 (compatible; Netcraft Web Server Survey) - Robots Token
- Netcraft
- Identity Type
- Observed
- Evidence Method
- Treat `Netcraft` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- Security
- Kind
- Monitor
- Family
- Netcraft
- Purpose
- Security
Behavior and handling
- Common Use
- Netcraft is used for security scanning, malware checks, vulnerability assessment, certificate review, and site-safety analysis.
- Detection Notes
- Netcraft traffic is primarily detected by the `Netcraft` user-agent pattern; a representative HTTP user-agent is `Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) Mozilla/4.0 (compatible; Netcraft Web Server Survey)`. Compare source IPs, reverse DNS, request paths, and crawl cadence before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- Netcraft has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Safe
- Recommended Handling
- Do not block
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.
Relationships
- Operator
- Netcraft Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.