Overview
Haiku-SearchBot is a search crawler from CLERK SAS used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is Haiku-SearchBot; related patterns include Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Haiku-SearchBot/1.0; +https://haiku.fr/robots-doc; a representative HTTP user-agent is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Haiku-SearchBot/1.0; +https://haiku.fr/robots-doc.
Haiku-SearchBot is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Haiku-SearchBot is marked as not reliably governed by robots.txt directives; use server-side rules if the traffic should be restricted.
Haiku-SearchBot should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Haiku-SearchBot belongs to the CLERK bot family.
Identity
- User-Agent Pattern
-
Haiku-SearchBot - Aliases
- Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Haiku-SearchBot/1.0; +https://haiku.fr/robots-doc
- HTTP Agent Examples
-
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Haiku-SearchBot/1.0; +https://haiku.fr/robots-doc - Robots Token
- Haiku-SearchBot
- Identity Type
- Observed
- Evidence Method
- Treat `Haiku-SearchBot` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- CLERK
- Purpose
- Indexing
Behavior and handling
- Common Use
- Haiku-SearchBot is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- Haiku-SearchBot traffic is primarily detected by the `Haiku-SearchBot` user-agent pattern; related patterns include `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Haiku-SearchBot/1.0; +https://haiku.fr/robots-doc a representative HTTP user-agent is `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Haiku-SearchBot/1.0; +https://haiku.fr/robots-doc Compare source IPs, reverse DNS, request paths, and crawl cadence with CLERK SAS infrastructure before trusting the traffic.
- Respects robots.txt
- No
- Spoofing Risk
- Haiku-SearchBot has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
# This agent may ignore robots.txt. Use authenticated access controls or network policy when blocking is required.
Relationships
- Operator
- CLERK SAS Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.