AI

AI

Amazonbot

Amazon

Amazon web crawler used for product improvement and possible AI-model training.

AI

Amzn-User

Amazon

Amazon user-triggered live web fetcher, including Alexa-related requests.

AI

Anchor Browser

Anchor Browser

Cryptographically signed Anchor Browser agent traffic.

AI

Andibot

Andi

Observed Andi-associated crawler token; exact identity remains unverified.

AI

anthropic-ai

Anthropic

Legacy historical Anthropic crawler token retained for log matching.

AI

Big Sur AI

Big Sur AI

Big Sur AI is a verified AI/commerce crawler identity used to retrieve web data for AI-assisted commerce experiences.

AI

BuddyBot

BuddyBotLearning (attributed)

BuddyBot is an observed crawler token attributed to BuddyBotLearning, but the exact crawler identity remains unauthenticated.

AI

ChatGLM Spider

Zhipu AI

ChatGLM Spider is a crawler associated with Zhipu AI and used for ai crawl unconfirmed; candidate traffic can include `ChatGLM-Spider`

AI

ChatGPT Work Cloud Browser

OpenAI

ChatGPT Work Cloud Browser is a agent associated with OpenAI and used for authenticated user triggered browser

AI

ChatGPT-Operator

OpenAI

ChatGPT-Operator is a historical agent associated with OpenAI and used for historical agent detection

AI

ChatGPT-User

OpenAI

ChatGPT-User is a user triggered fetcher associated with OpenAI and used for user requested fetching; candidate traffic can include `ChatGPT-User`

AI

ChatGPT-User 2.0

OpenAI

ChatGPT-User 2.0 is a historical fetcher associated with OpenAI and used for historical user triggered fetching; candidate traffic can include `ChatGPT-User/2.0`

AI

Chathive Crawler

Chathive

Chathive Crawler is a knowledge base crawler associated with Chathive and used for knowledge base ingestion; candidate traffic can include `ChathiveCrawler`

AI

CitibotSiteCrawler

Citibot

CitibotSiteCrawler is a crawler associated with Citibot and used for civic content ingestion; candidate traffic can include `CitibotSiteCrawler`

AI

Claude-Code

Anthropic

Claude-Code is a developer client associated with Anthropic and used for developer agent api and mcp client; candidate traffic can include `claude-cli/`

AI

Claude-SearchBot

Anthropic

Claude-SearchBot is a search crawler associated with Anthropic and used for ai search; candidate traffic can include `Claude-SearchBot`

AI

Claude-User

Anthropic

Claude-User is a user triggered fetcher associated with Anthropic and used for ai assistant user fetch; candidate traffic can include `Claude-User`

AI

Claude-Web

Anthropic

Claude-Web is a historical fetcher associated with Anthropic and used for historical ai web fetch; candidate traffic can include `Claude-Web`

AI

ClaudeBot

Anthropic

ClaudeBot is a crawler associated with Anthropic and used for model development crawling; candidate traffic can include `ClaudeBot`

AI

Cledara SaaS Management Agent

Cledara

Cledara SaaS Management Agent is an automated identity from Cledara used for customer authorized saas administration; it appears in server logs as `CledaraBot`.

AI

Cloudflare AI Search

Cloudflare

Cloudflare AI Search is a crawler associated with Cloudflare and used for ai search indexing; candidate traffic can include `Cloudflare-AI-Search`

AI

cohere-training-data-crawler

Cohere

cohere-training-data-crawler is an automated identity from Cohere used for historical attributed ai training; it appears in server logs as `cohere-training-data-crawler`.

AI

Composer

Composer

Composer is an automated agent from Composer used for ai browser.

AI

Context7-Crawler

Upstash

Context7-Crawler indexes software documentation so developers and AI tools can retrieve current, source-linked references.