Overview
ERNIEBot is a crawler associated with Baidu, used for automated web access associated with Baidu ERNIE services.
Its primary user-agent pattern ERNIEBot; related patterns Baidu ERNIE crawler; representative HTTP user-agent ERNIEBot.
ERNIEBot is unverified with Medium confidence. The identity type is Observed.
Robots.txt behavior for ERNIEBot is not confirmed. Do not treat a user-agent-only rule as guaranteed enforcement.
The token is independently reported by current crawler-intelligence sources, but no current first-party verification policy was located.
Treat the user-agent as an identity claim. Corroborate it with operator-controlled IP ranges, reverse DNS, signed-request evidence, or current documentation when available.
Identity
- User-Agent Pattern
-
ERNIEBot - Aliases
- Baidu ERNIE crawler
- HTTP Agent Examples
-
ERNIEBot - Robots Token
- ERNIEBot
- Identity Type
- observed
- Evidence Method
- Match `ERNIEBot` and corroborate the request with current Baidu documentation, operator-controlled network data, reverse DNS, or signed-request evidence when available.
Classification
- Type
- ai
- Kind
- crawler
- Family
- Baidu ERNIE
- Operator
- Baidu
- Company
- Baidu
- Purpose
- ai-indexing-or-training
Behavior and handling
- Common Use
- automated web access associated with Baidu ERNIE services
- Detection Notes
- Detect primarily by `ERNIEBot`; related patterns include `Baidu ERNIE crawler`; representative HTTP user-agent: `ERNIEBot`. User-agent strings can be copied, so corroborate with stronger evidence before granting trust.
- Respects robots.txt
- unknown
- Spoofing Risk
- ERNIEBot has high spoofing risk because its user-agent can be copied and the current evidence is observation-based; do not trust it by name alone.
- Risk
- neutral
- Recommended Handling
- monitor
Rules and controls
- Robots.txt Snippet
-
# Robots.txt behavior is unconfirmed. Monitor first and use stronger controls when enforcement is required. - Apache Rule
-
RewriteCond %{HTTP_USER_AGENT} "ERNIEBot" [NC] RewriteRule ^ - [F,L] - Nginx Rule
-
if ($http_user_agent ~* "ERNIEBot") { return 403; }