Confidence: Medium
CheckView
WordPress automated testing platform
Verified robots.txt: No Neutral Block: Depends
OKX Dolphin Crawler simulates visits to target web pages as part of malicious dApp scanning
User-agent: OKX-dolphin-crawler
Disallow: /
(http.user_agent contains "OKX-dolphin-crawler")
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} OKX\-dolphin\-crawler [NC]
RewriteRule ^ - [F,L]
if ($http_user_agent ~* "OKX-dolphin-crawler") { return 403; }
WordPress automated testing platform
Web classifier: fetches a site’s homepage to assign a category and rechecks periodically.
Robin automatically scans school websites in the UK, providing compliance checks against statutory requirements.
zvelo fetches content for web categorization.
