Bot intelligence record

YandexWebmaster

Usually allow

Use the YandexWebmaster identifier to separate Yandex search indexing or content discovery traffic from normal visitor requests in server logs.

Search Indexing Official Documented Confidence: High Verified: Yes robots.txt: Yes

User-Agent Pattern

Yandex
YandexWebmaster

Robots.txt Snippet

Copy-ready
User-agent: YandexWebmaster Disallow: /

Handling Guidance

Depends

This bot is usually safe to allow when the request source is verified and the traffic matches your site policy.

Search indexing, content discovery, rendering, or search-result freshness checks.

Record Details

Structured data
Operator
Yandex
Family
Yandex
Type
Search
Purpose
Indexing
Identity type
Official Documented
Confidence
High
Last verified
2026-04-29
Last checked
2026-04-30
Source type
Official
Spoofing risk
Yandex user-agent strings are often spoofed. Verify the source host with reverse DNS and forward DNS before allow-listing.

Notes

YandexWebmaster is listed in the Botcrawl directory as a search crawler from Yandex. The primary identifier for log review is YandexWebmaster.

Identification

  • User-agent pattern: YandexWebmaster
  • Family: Yandex
  • Type: Search
  • Kind: Fetcher

Common use

Search indexing, content discovery, rendering, or search-result freshness checks.

Verification and handling

Verify with reverse DNS and forward DNS checks; valid Yandex hosts end in yandex.ru, yandex.net, or yandex.com.

Directory guidance marks the risk level as Safe and the blocking decision as Depends. Do not rely on the user-agent string alone because user-agent strings can be copied or spoofed.

Robots.txt handling: Yes.

Evidence and Source

  • Verify with reverse DNS and forward DNS checks; valid Yandex hosts end in yandex.ru, yandex.net, or yandex.com.
  • Search indexing, content discovery, rendering, or search-result freshness checks.
  • Yandex user-agent strings are often spoofed. Verify the source host with reverse DNS and forward DNS before allow-listing.

WordPress Bot Protection

Bot Blocker for WordPress

Monitor bot traffic, review live activity, and control AI crawlers, scrapers, scanners, spam bots, and fake trusted bots from one clean WordPress dashboard.