AI
QuillBot
QuillBot is an operator-attributed AI web-retrieval identity associated with QuillBot/Learneo.
AI
Qwen-User
Qwen-User is a fetcher associated with Alibaba Cloud, used for fetching pages in response to Qwen user requests.
AI
QwenBot
QwenBot is an Alibaba/Qwen crawler used for automated public-web collection supporting Qwen AI workflows.
AI
Rapidflare Ingestion Crawler
Rapidflare Ingestion Crawler is a signed customer-directed knowledge-source fetcher with no single fixed User-Agent.
AI
Reflectionbot
Reflectionbot is a Reflection AI training crawler used for visiting publicly available pages to help build and improve Reflection AI models.
AI
SBIntuitions-SearchBot
SBIntuitions-SearchBot retrieves relevant webpages in response to Sarashina user questions.
AI
SBIntuitionsBot
SBIntuitionsBot is an AI-development crawler operated by SB Intuitions for AI development and information analysis.
AI
ScrunchAI-testbot
ScrunchAI-testbot performs validation checks separately from Scrunch AI's primary crawler.
AI
Sidetrade indexer bot
Sidetrade indexer bot is an AI crawler from Sidetrade used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.
AI
SWM-ARGOS-Research-Bot
SWM-ARGOS-Research-Bot is a Sell With Marketing research crawler used for bounded web research and website measurement.
AI
TavilyBot
TavilyBot remains a useful observed Tavily crawler identity, but Tavily’s current product documentation does not establish a stable public request identity strongly enough…
AI
Thinkbot
Thinkbot remains an observed low-confidence bot token; no current authoritative operator identity or request model was found for promotion.
AI
Trae
Trae remains an observed low-confidence AI-agent token; no current authoritative public request identity was found for promotion.
AI
v0bot
v0bot is Vercel’s documented AI crawler for v0 services; it should not be mislabeled specifically as an AI-training crawler.
AI
Ventus Agent
Ventus Agent is a signed AI automation/browser agent that should be authenticated with HTTP Message Signatures rather than a fixed User-Agent.
AI
Vercatus
Vercatus is a Vercatus audit crawler used for owner-requested analysis of how automated search and AI systems can access and interpret a website.
AI
Visually.io Shopify Editor
Visually.io Shopify Editor is a signed automated agent associated with Visually.io; no fixed HTTP User-Agent is published.
AI
WAVE Streaming Platform
WAVE Streaming Platform is a signed automated agent associated with WAVE Streaming Platform; no fixed HTTP User-Agent is published.
AI
xAI-Grok
xAI-Grok is an observed/tentative token associated by name with xAI/Grok activity, but a current canonical operator-published HTTP identity could not be established.
AI
YandexAdditional
YandexAdditional helps process robots controls that exclude already-indexed page content from Search with Yandex AI responses; it does not make indexing requests.