Bot Directory

W3C-checklink Neutral

W3 Validator Services

W3 Validator Services is a web scraper from World Wide Web Consortium (W3C) used for public web data collection, page extraction, content monitoring.

Operator and family: World Wide Web Consortium (W3C) Type: Scraper Purpose: Scraping

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

W3C_CSS_Validator Neutral

W3C CSS Validator

W3C CSS Validator is a validator bot from W3C used for markup validation, accessibility testing, structured-data review.

Operator and family: W3C Type: Validator Purpose: Css Validation

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

FeedValidator Neutral

W3C Feed Validator

W3C Feed Validator is a validator bot from W3C used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: W3C Type: Validator Purpose: Feed Validation

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

W3C_I18n-Checker Neutral

W3C Internationalization Checker

W3C Internationalization Checker is a validator bot from W3C used for markup validation, accessibility testing, structured-data review.

Operator and family: W3C Type: Validator Purpose: Internationalization Validation

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

W3C_Validator Neutral

W3C Markup Validator

W3C Markup Validator is a validator bot from W3C used for markup validation, accessibility testing, structured-data review.

Operator and family: W3C Type: Validator Purpose: Markup Validation

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

W3C-mobileOK Neutral

W3C mobileOK Checker

W3C mobileOK Checker is a validator bot from W3C used for markup validation, accessibility testing, structured-data review.

Operator and family: W3C Type: Validator Purpose: Mobile Validation

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

W3C_Unicorn Neutral

W3C Unicorn Validator

W3C Unicorn Validator is a validator bot from W3C used for markup validation, accessibility testing, structured-data review.

Operator and family: W3C Type: Validator Purpose: Multi Validator

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

Wappalyzer Caution

Wappalyzer

Wappalyzer is a technology Profiler used for Wappalyzer is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator and family: Wappalyzer Type: Technology Profiler Purpose: General Bot Traffic

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

WARDBot Neutral

WARDBot

WARDBot is a monitoring bot from WEBSPARK used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: WEBSPARK Type: Monitoring

Verified robots.txt: No Block: Depends Verified Bot

View Record Open in Edge BotDB

Watchbot Safe

Watchbot

Watchbot is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: WatchBot Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

View Record Open in Edge BotDB

WebsiteOps Safe

Watchful

Watchful is a monitoring bot from Watchful LLC used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Watchful LLC Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

wave-streaming-platform-2 Neutral

WAVE Streaming Platform

WAVE Streaming Platform is an AI crawler used for assistant-driven browsing, page retrieval.

Operator and family: WAVE Streaming Platform Type: Ai Purpose: AI Browser

Verified robots.txt: Unknown Block: Depends Signed Agent

View Record Open in Edge BotDB

WebDataStats Neutral

WebDataStats

WebDataStats is an analytics Crawler used for WebDataStats is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator and family: WebDataStats Type: Analytics Crawler Purpose: Web Statistics Crawling

Verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

monitor/webpagetest Safe

webpagetest

webpagetest is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: WebPageTest Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

websitepulse checker Safe

WebsitePulseBot

WebsitePulseBot is a monitoring bot from WebsitePulse used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: WebsitePulse Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

webspidermount Neutral

WebSpiderMount

WebSpiderMount is a search crawler from AspenTechLabs Inc used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: AspenTechLabs Inc Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

View Record Open in Edge BotDB

Webstatus247 Safe

Webstatus247

Webstatus247 is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Webstatus247 Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

WebTotemBot Safe

WebTotemBot

WebTotemBot is a monitoring bot from WebTotem used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: WebTotem Type: Monitoring

Verified robots.txt: Yes Block: Depends Verified Bot

View Record Open in Edge BotDB

Webzio-Extended Neutral

Webzio Extended

Webzio Extended is an AI crawler from Webz.io used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator and family: Webz.io Type: Ai Purpose: Data Collection

Not verified robots.txt: Unknown Block: Depends Observed

View Record Open in Edge BotDB

WhatCMS Caution

WhatCMS

WhatCMS is a technology Profiler used for WhatCMS is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator and family: WhatCMS Type: Technology Profiler Purpose: General Bot Traffic

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

WhatsApp Safe

WhatsApp

WhatsApp is a link preview bot used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: WhatsApp Type: Preview

Verified robots.txt: Yes Block: Depends Official Documented

View Record Open in Edge BotDB

WhatWeb Caution

WhatWeb

WhatWeb is a technology Profiler used for WhatWeb is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator and family: WhatWeb Type: Technology Profiler Purpose: General Bot Traffic

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

wknd-bot Safe

WkndHealthCheckBot

WkndHealthCheckBot is a monitoring bot from Wunderkind used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Wunderkind Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

Citoid/WMF Neutral

WMF Citoid

WMF Citoid is a feed fetcher from Wikimedia Foundation used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Wikimedia Foundation Type: Feed Purpose: Feed Fetch

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB