About this bot
YandexBot is associated with Yandex and is used for web indexing.
The primary identity signal is YandexBot. Representative HTTP identity: Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented plus fcrdns.
robots.txt behavior: respected under the `YandexBot` token.
Verification: Match the documented Yandex identity, then authenticate origin with forward-confirmed reverse DNS: the PTR hostname must end in yandex.ru, yandex.net, or yandex.com and forward-resolve to the source IP.
How to identify this bot
- User-agent and crawler identifiers
-
YandexBotMozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) - Also known as
- Yandex main crawler; YandexBot/3.0; Yandex MirrorDetector
Details
- Kind
- Crawler
- Family
- Yandex
- Purpose
- Web indexing
- Common Use
- YandexBot is Yandex’s main web indexing robot; a MirrorDetector variant identifies alternate site addresses.
- Respects robots.txt
- Yes
Verification
- Identity Type
- official-documented-plus-fcrdns
- Evidence Method
- Match the documented Yandex identity, then authenticate origin with forward-confirmed reverse DNS: the PTR hostname must end in yandex.ru, yandex.net, or yandex.com and forward-resolve to the source IP.
- Detection Notes
- YandexBot is Yandex’s main web indexing robot; a MirrorDetector variant identifies alternate site addresses. Yandex documents that many non-indexing robots may ignore general User-agent:* rules; use the exact agent group where applicable. Browser version components may change.
Website controls
- Robots.txt Snippet
User-agent: YandexBot Disallow: /