Yeti
Yeti is the web crawler for Naver, a South Korean search engine.
Collects on-page content from registered ad landing pages for ad matching and ranking.
User-agent: adsnaver
Disallow: /
(http.user_agent contains "adsnaver")
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} adsnaver [NC]
RewriteRule ^ - [F,L]
if ($http_user_agent ~* "adsnaver") { return 403; }
Known user-agent patterns: adsnaver Known user-agent strings: adsnaver Robots.txt handling in the directory: no.
Operator documentation: https://ads.naver.com/
Yeti is the web crawler for Naver, a South Korean search engine.
Naver's web crawler, also known as Yeti, used to crawl and index web content.
Naver's preview-snippet crawler that fetches titles, descriptions, and images when users insert links in Naver services.
NAVER specialist robot that collects additional information for advertiser pages.
NAVER preview robot that collects link summary information in editors and similar workflows.
Zoominfobot is an indexing robot for a web search engine, similar to Google.
ZumBot is a web crawler that indexes webpages for Zum Open Internet Search.
You.com Search Engine Crawler
Yandex crawler for video indexing.
