Overview
Cotoyogi is an AI training crawler from Research Organization of Information and Systems used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
Its primary user-agent pattern is Cotoyogi; related patterns include Cotoyogi/; a representative HTTP user-agent is Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/).
Cotoyogi is Verified from current authoritative identity documentation reviewed on 2026-08-07. The identity type is Official Documented.
Cotoyogi is marked as respecting robots.txt directives for crawler access control.
Cotoyogi should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent
Cotoyogi- Aliases
- Cotoyogi/
- HTTP Agent Examples
Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/)- Robots.txt Token
Cotoyogi- Identity Type
- Official Documented
- Evidence Method
- Match `Cotoyogi` to the current operator documentation and corroborate the request with operator-controlled verification signals where available; User-Agent strings alone can be spoofed.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- Research Organization of Information and Systems
- Purpose
- ai-training
Behavior and handling
- Common Use
- Cotoyogi is used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
- Detection Notes
- Cotoyogi traffic is primarily detected by the `Cotoyogi` user-agent pattern; related patterns include `Cotoyogi/`; a representative HTTP user-agent is `Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/)`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Research Organization of Information and Systems infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Cotoyogi has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
User-agent: Cotoyogi Disallow: /