Terracotta
Terracotta is retained Unverified as a Ceramic-associated search/index crawler; current public evidence is inconsistent on request identity and robots behavior.
Timpibot
Timpibot is retained Unverified as a Timpi crawler identity; current third-party observations show active variants, but authoritative operator documentation is insufficient for promotion.
TinEye-bot
TinEye-bot is a crawler associated with TinEye, used for discovering and indexing images for reverse-image search.
Trendiction Bot
trendictionbot crawls public sites for Trendiction search and data services and documents robots.txt exclusion controls.
upday
upday is a search crawler from upday GmbH & Co. KG used for search indexing, URL discovery, page rendering, result freshness.
WindowsForum-AI
WindowsForum-AI is an automated identity associated with WindowsForum.com and used for technology news crawling and aggregation for WindowsForum.com.
yacybot
yacybot is the default crawler identity family for YaCy peer-to-peer search software. YaCy deployments can select or customize crawler agents, so `yacybot` is…
Yahoo Japan SEO Crawler
Yahoo Japan SEO Crawler is the Yahoo! JAPAN Y!J-BRW crawler family used for search-service, research, and development page collection; the User-Agent may evolve…
Yahoo Japan Y!J-ASR
Y!J-ASR is a current Yahoo! JAPAN crawler identity used in search-service, research, and development page collection; Yahoo! JAPAN notes that crawler identifiers may…
Yahoo Slurp
Yahoo Slurp is Yahoo Search’s crawler for web indexing and selected Yahoo content services. Yahoo documents the current Slurp HTTP identity and states…
YandexBot
YandexBot is Yandex’s main web indexing robot; a MirrorDetector variant identifies alternate site addresses.
YandexComBot
YandexComBot indexes content for Yandex search in languages other than Russian and supports robot-specific restrictions.
YandexFavicons
YandexFavicons downloads site favicon files for display in Yandex search results.
YandexMobileBot
YandexMobileBot evaluates whether pages provide layouts suitable for mobile devices.
YandexVerticals
YandexVerticals crawls Yandex classifieds verticals including Auto.ru, Realty, Jobs, and Reviews.