webzio-extended

Risky Block: Depends robots.txt: Unknown

Webz.io extended web crawler that maintains a repository of web crawl data.

Key facts

Operator
Webz.io
Family
Webz.io
Purpose
Control Token
User-Agent
webzio-extended
Should you block it?
Depends
Respects robots.txt
Unknown
Identity type
Unknown
Confidence
Unknown

Bot details

Identity

User-Agent
webzio-extended
robots.txt token
webzio-extended
HTTP user-agent
Mozilla/5.0 (compatible; webzio-extended/1.0; +https://webz.io/bot.html)
Aliases
Webz.io Extended

Ownership

Operator
Webz.io
Family
Webz.io
Type
Ai
Purpose
Control Token

Verification and trust

Source type
Unknown
Confidence
Unknown
Verification
Verify the exact user-agent against Webz.io's published crawler documentation.

Blocking and detection

Robots

User-agent: webzio-extended
Disallow: /

Cloudflare

(http.user_agent contains "webzio-extended")
Advanced server rules

Apache

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} webzio\-extended [NC]
RewriteRule ^ - [F,L]

Nginx

if ($http_user_agent ~* "webzio-extended") { return 403; }

Notes

Webz.io extended web crawler that maintains a repository of web crawl data.

webzio-extended is operated by Webz.io. Botcrawl classifies it as a ai bot with a primary purpose of control token.

Key profile signals: risk level: risky; verified: no.

Verify the exact user-agent against Webz.io’s published crawler documentation.

Source documentation: https://webz.io/bot.html

Evidence and source

  • Verify the exact user-agent against Webz.io's published crawler documentation.