Overview
ITProfilesBot collects public information about IT service providers and their services.
The crawler retrieves company information, public case studies and related profile details. Its operator documents robots.txt and Crawl-delay support.
Identification: ITProfilesBot.
Operator documentation: https://itprofiles.com/cms/bot.
Identity
- User-Agent Pattern
-
ITProfilesBot - HTTP Agent Examples
-
ITProfilesBot/1.0 (+https://itprofiles.com/cms/bot) - Robots Token
- ITProfilesBot
- Identity Type
- Officially documented
- Evidence Method
- operator documentation; user-agent alone is untrusted
Classification
- Type
- Crawler
- Kind
- Business information crawler
- Family
- ITProfiles
- Purpose
- Public it provider profile indexing
Behavior and handling
- Common Use
- public it provider profile indexing
- Detection Notes
- Match the distinctive ITProfilesBot token. Operator docs mention version 1.1 while the example user agent remains 1.0; keep the published example and do not infer header version.
- Respects robots.txt
- Yes
- Spoofing Risk
- The ITProfilesBot User-Agent token can be impersonated; confirm provenance before trusting it.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: ITProfilesBot Disallow: /
Relationships
- Operator
- ITProfiles Checked 2026-10-22
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.