About this bot
YandexSitelinks is associated with Yandex and is used for sitelink availability checking.
The primary identity signal is YandexSitelinks. Representative HTTP identity: Mozilla/5.0 (compatible; YandexSitelinks; Dyatel; +http://yandex.com/bots).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented plus fcrdns.
robots.txt behavior: respected under the `YandexSitelinks` token.
Verification: Match the documented Yandex identity, then authenticate origin with forward-confirmed reverse DNS: the PTR hostname must end in yandex.ru, yandex.net, or yandex.com and forward-resolve to the source IP.
How to identify this bot
- User-agent and crawler identifiers
-
YandexSitelinksMozilla/5.0 (compatible; YandexSitelinks; Dyatel; +http://yandex.com/bots) - Also known as
- YandexSitelinks Yandex robot
Details
- Kind
- Link checker
- Family
- Yandex
- Purpose
- Sitelink availability checking
- Common Use
- YandexSitelinks checks the availability of pages used as sitelinks.
- Respects robots.txt
- Yes
Verification
- Identity Type
- official-documented-plus-fcrdns
- Evidence Method
- Match the documented Yandex identity, then authenticate origin with forward-confirmed reverse DNS: the PTR hostname must end in yandex.ru, yandex.net, or yandex.com and forward-resolve to the source IP.
- Detection Notes
- YandexSitelinks checks the availability of pages used as sitelinks. Yandex documents that many non-indexing robots may ignore general User-agent:* rules; use the exact agent group where applicable. Browser version components may change.
Website controls
- Robots.txt Snippet
User-agent: YandexSitelinks Disallow: /