cohere-training-data-crawler
AI

cohere-training-data-crawler

cohere-training-data-crawler is an automated identity from Cohere used for historical attributed ai training; it appears in server logs as `cohere-training-data-crawler`.

Operator Cohere

About this bot

cohere-training-data-crawler is associated with Cohere and used for historical attributed ai training.

The primary identifying User-Agent token is cohere-training-data-crawler.

Directory status: Legacy. Identity classification: Unverified with Medium confidence. Identity type: historical-observed.

robots.txt behavior is currently unconfirmed.

Verification: Treat `cohere-training-data-crawler` as a historical/observed token. Current Cohere policy states that no Cohere bot or User-Agent is being used to crawl or scrape web content for generative-AI training at this time.

Details

Kind
Historical training crawler
Family
Cohere
Purpose
Historical attributed AI training
Common Use
Historical or community-attributed Cohere training-data crawling; not a currently documented active training crawler.
Respects robots.txt
Unknown

Verification

Identity Type
historical-observed
Evidence Method
Treat `cohere-training-data-crawler` as a historical/observed token. Current Cohere policy states that no Cohere bot or User-Agent is being used to crawl or scrape web content for generative-AI training at this time.
Detection Notes
Do not classify this token as a currently documented Cohere training crawler without new operator documentation establishing renewed use.
Website controls
Robots.txt Snippet
# robots.txt behavior is unconfirmed. Use server-side controls if restriction is required.

Similar Bots

AI

Keenable-User

Keenable.ai, Inc.

Keenable-User fetches specific web pages at the request of users or AI agents.

AI

KeenableBot

Keenable.ai, Inc.

KeenableBot indexes public web pages for search used by AI agents and applications.

AI

AgentReadyWebsiteBot

Omnirithm Inc.

AgentReadyWebsiteBot tests whether requested websites expose information needed by AI agents.

AI

AgenstryBot

Agenstry

AgenstryBot checks public AI agent cards, discovery documents, and MCP endpoints.

AI

A1-User

A1

A1-User retrieves public pages when an A1 assistant user requests a web page.

AI

Gist Crawler

ProRata / Gist

The Gist Crawler retrieves licensed and public web content for Gist.ai search and retrieval.