Overview
AspiegelBot is a search crawler from Huawei / Petal Search used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is AspiegelBot; related patterns include aspiegelbot; Aspiegel Bot; Petal Search crawler.
AspiegelBot is not independently verified with Medium confidence. The identity type is Documented, and the evidence basis is observed traffic patterns and user-agent evidence.
Robots.txt behavior is not currently confirmed.
AspiegelBot should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
AspiegelBot belongs to the Huawei bot family.
Identity
- User-Agent Pattern
-
AspiegelBot - Aliases
- aspiegelbot; Aspiegel Bot; Petal Search crawler
- HTTP Agent Examples
-
AspiegelBot - Robots Token
- AspiegelBot
- Identity Type
- Documented
- Evidence Method
- Verify AspiegelBot by matching `AspiegelBot` to Huawei / Petal Search evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- Search engine crawler
- Kind
- Search engine crawler
- Family
- Huawei
- Purpose
- Search indexing
Behavior and handling
- Common Use
- AspiegelBot is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- AspiegelBot traffic is primarily detected by the `AspiegelBot` user-agent pattern; related patterns include `aspiegelbot; Aspiegel Bot; Petal Search crawler`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Huawei / Petal Search infrastructure before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- AspiegelBot has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.
Relationships
- Operator
- Huawei / Petal Search Checked 2026-06-22
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.