Skip to content
Public bot and datacenter intelligence since 2011. Public intelligence since 2011 Browse databases

Bot Directory

Search public bot records by name, operator, user-agent, family, type, purpose, and verification data.

1,006 public records
Validator Verified: Yes

Xenu Link Sleuth

Xenu Link Sleuth is a validator bot from Xenu used for markup validation, accessibility testing, structured-data review.

Operator
Xenu
Kind
Validator
Purpose
Validation And Testing
Confidence
Low
Xenu Link Sleuth
Security Verified: Yes

XY Archive Compliance Bot

XY Archive Compliance Bot is a security scanner from XY Archive Compliance used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator
XY Archive Compliance
Kind
Scanner
Purpose
Security
Confidence
Medium
XY-Archive-Compliance
Search Verified: Yes

yacybot

yacybot is a search crawler from YaCy used for search indexing, URL discovery, page rendering, result freshness.

Operator
YaCy
Kind
Crawler
Purpose
Indexing
Confidence
High
yacybot
Monitoring Verified: Yes

YaDirectFetcher

YaDirectFetcher is a monitoring bot from Yandex used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator
Yandex
Kind
Monitor
Purpose
Monitoring
Confidence
High
YaDirectFetcher
Monitoring Verified: Yes

Yahoo Ad Monitoring

Yahoo Ad Monitoring is a monitoring bot from Yahoo used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator
Yahoo
Kind
Monitor
Purpose
Monitoring
Confidence
Medium
Yahoo Ad monitoring
Feed Fetcher Verified: No

Yahoo Blogs

Yahoo Blogs is a feed fetcher from Yahoo used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator
Yahoo
Kind
Feed Fetcher
Purpose
Blog Feed Fetching
Confidence
Medium
Yahoo-Blogs
Feed Fetcher Verified: No

Yahoo FeedSeeker

Yahoo FeedSeeker is a feed fetcher from Yahoo used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator
Yahoo
Kind
Feed Fetcher
Purpose
Feed Fetching
Confidence
Medium
YahooFeedSeeker
Search Verified: Yes

Yahoo Japan SEO Crawler

Yahoo Japan SEO Crawler is a search crawler from Yahoo used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo
Kind
Crawler
Purpose
Indexing
Confidence
Medium
J-BRW
Search Verified: Yes

Yahoo Japan Y!J-ASR

Yahoo Japan Y!J-ASR is a search crawler from Yahoo Japan Corporation used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo Japan Corporation
Kind
Crawler
Purpose
Indexing
Confidence
Medium
Y!J-ASR
Preview Verified: Yes

Yahoo Link Preview

Yahoo Link Preview is a link preview bot from Yahoo used for link unfurling, rich-card generation, social previews, messaging previews.

Operator
Yahoo
Kind
Preview
Purpose
Preview
Confidence
Medium
Yahoo Link Preview
Search Engine Crawler Verified: No

Yahoo MMCrawler

Yahoo MMCrawler is a search crawler from Yahoo used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo
Kind
Search Engine Crawler
Purpose
Media Indexing
Confidence
Medium
Yahoo-MMCrawler
Search Verified: Yes

Yahoo Slurp

Yahoo Slurp is a search crawler from Yahoo used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo
Kind
Crawler
Purpose
Indexing
Confidence
Medium
Yahoo! Slurp
Search Verified: Yes

Yahoo! JAPAN J-DLC

Yahoo! JAPAN J-DLC is a search crawler from Yahoo! JAPAN used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo! JAPAN
Kind
Crawler
Purpose
Indexing
Confidence
Medium
J-DLC
Search Verified: Yes

YahooCacheSystem

YahooCacheSystem is a search crawler from Yahoo used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo
Kind
Crawler
Purpose
Indexing
Confidence
Medium
YahooCacheSystem
Security Verified: Yes

YahooMailProxy

YahooMailProxy is a security scanner from Yahoo used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator
Yahoo
Kind
Scanner
Purpose
Security
Confidence
Medium
YahooMailProxy
Search Engine Crawler Verified: No

YahooSeeker

YahooSeeker is a search crawler from Yahoo used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yahoo
Kind
Search Engine Crawler
Purpose
Search Indexing
Confidence
Medium
YahooSeeker
Ai Verified: No

YaK

YaK is an AI crawler used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator
YaK
Kind
Crawler
Purpose
Ai Crawl
Confidence
Low
YaK
Search Verified: Yes

YandexAccessibilityBot

YandexAccessibilityBot is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Crawler
Purpose
Indexing
Confidence
High
YandexAccessibilityBot
Search Verified: Yes

YandexAdditional

YandexAdditional is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Crawler
Purpose
Indexing
Confidence
High
YandexAdditional
Search Verified: Yes

YandexAdditionalBot

YandexAdditionalBot is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Crawler
Purpose
Indexing
Confidence
High
YandexAdditionalBot
Search Verified: Yes

YandexAdNet

YandexAdNet is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Crawler
Purpose
Indexing
Confidence
High
YandexAdNet
Search Verified: Yes

YandexBlogs

YandexBlogs is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Crawler
Purpose
Indexing
Confidence
High
YandexBlogs
Search Verified: Yes

YandexBot

YandexBot is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Crawler
Purpose
Indexing
Confidence
High
YandexBot
Search Verified: Yes

YandexCalendar

YandexCalendar is a search crawler from Yandex used for search indexing, URL discovery, page rendering, result freshness.

Operator
Yandex
Kind
Fetcher
Purpose
Search
Confidence
High
YandexCalendar