Confidence: Medium
CheckView
WordPress automated testing platform
Verified robots.txt: No Neutral Block: Depends
Web classifier: fetches a site’s homepage to assign a category and rechecks periodically.
User-agent: RedactusWebClassifier
Disallow: /
(http.user_agent contains "RedactusWebClassifier")
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} RedactusWebClassifier [NC]
RewriteRule ^ - [F,L]
if ($http_user_agent ~* "RedactusWebClassifier") { return 403; }
WordPress automated testing platform
OKX Dolphin Crawler simulates visits to target web pages as part of malicious dApp scanning
Robin automatically scans school websites in the UK, providing compliance checks against statutory requirements.
zvelo fetches content for web categorization.
