Overview
MistralAI-Training is a crawler associated with Mistral AI, used for crawling web content to build datasets for training Mistral generative AI models.
Its primary user-agent pattern is MistralAI-Training; related patterns include Mistral training crawler; a representative HTTP user-agent is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots).
MistralAI-Training is verified with High confidence. The identity type is Official Documented.
MistralAI-Training is documented as honoring robots.txt directives.
Treat the user-agent or identity as a claim and corroborate it with published network data, reverse DNS, signed-request evidence, or current operator documentation when available.
Identity
- User-Agent
MistralAI-Training- Aliases
- Mistral training crawler
- HTTP Agent Examples
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)- Robots.txt Token
MistralAI-Training- Identity Type
- Official Documented
- Evidence Method
- Verify MistralAI-Training by matching `MistralAI-Training` to Mistral AI evidence, then corroborating the request with source-network ownership, reverse DNS, signed request data, or current operator documentation.
Classification
- Type
- AI
- Kind
- Crawler
- Family
- Mistral AI
- Purpose
- model-training
Behavior and handling
- Common Use
- crawling web content to build datasets for training Mistral generative AI models
- Detection Notes
- MistralAI-Training traffic is primarily detected by `MistralAI-Training`; related patterns include `Mistral training crawler`; a representative HTTP user-agent is `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)`. Treat these values as identification claims and corroborate them with source-network ownership, reverse DNS, signed request data, or current operator documentation.
- Respects robots.txt
- Yes
- Spoofing Risk
- MistralAI-Training can be spoofed if identification relies only on a user-agent string; corroborate the request with stronger operator-controlled evidence when available.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
User-agent: MistralAI-Training Disallow: /