About this bot
ICC Crawler is a crawler associated with NICT and used for indexing.
The primary identifying User-Agent token is ICC-Crawler. Representative HTTP request identity: ICC-Crawler/3.0 (Mozilla-compatible;; https://ucri.nict.go.jp/en/icccrawler.html).
Directory status: Active. Identity classification: Verified with Medium confidence. Identity type: verified bot.
This identity is recorded as honoring robots.txt under ICC-Crawler. Site-specific access policy should still be evaluated before enforcement.
Risk classification: Neutral. Recommended handling is to evaluate the request context before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
ICC-CrawlerICC-Crawler/3.0 (Mozilla-compatible;; https://ucri.nict.go.jp/en/icccrawler.html) - Also known as
- ICC-Crawler/
Details
- Kind
- Crawler
- Family
- NICT
- Purpose
- Indexing
- Common Use
- ICC Crawler is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Respects robots.txt
- Yes
Verification
- Identity Type
- Verified bot
- Evidence Method
- Match `ICC-Crawler` as the claimed identity signal and corroborate it with independent network, DNS, cryptographic, or request-context signals when stronger authentication is required.
- Detection Notes
- Match the `ICC-Crawler` User-Agent token and consider recorded aliases where applicable. A User-Agent match identifies a claim, not authenticated origin.
Website controls
- Robots.txt Snippet
User-agent: ICC-Crawler Disallow: /