Bot Intelligence Record

Yahoo Slurp

Yahoo! Slurp was the search engine crawler for Yahoo's search engine.

Yahoo! Slurp
OperatorYahoo
FamilyYahoo
Typesearch
Risksafe
Blockdepends
Verified1
Verification Guidance

User-agent strings can be copied. Use this record for identification, logging, filtering, and review. For allow lists or low-friction rules, pair the identifier with operator documentation, reverse DNS, IP ranges, request signatures, or another verification method when available.

Identification

User-Agent: Yahoo! Slurp

HTTP Agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) sieve-gq1/1560642271-0

Robots Token: Yahoo! Slurp

Purpose: indexing

Identity: verified-bot

Handling

Common Use: Search indexing, content discovery, rendering, or search-result freshness checks.

Detection Notes: Match `Yahoo! Slurp` as a case-insensitive substring in HTTP user-agent logs. Use bot_http_agent for full user-agent examples when the client sends a longer browser-like string. Do not treat a user-agent match alone as proof of identity for allow-listing.

Risk: safe

Should Block: depends

Respects Robots: yes

Rules

Block Snippet

User-agent: Yahoo! Slurp Disallow: /

Sources

Source

Operator

Related Bots

ZoominfoBot safe

ZoomInfo

Zoominfobot is an indexing robot for a web search engine, similar to Google. Created by Zoom Information Inc.(www.zoominfo.com), Zoominfobot’s patented technology continually scans millions.

Operator: ZoomInfo Family: ZoomInfo Type: search Purpose: indexing
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot
YouBot safe

YouBot

YouBot is a search crawler associated with You.com, used for search indexing and content discovery.

Operator: You.com Family: YouBot Type: search Purpose: indexing
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot
YextBot neutral

Yext Inc

The Yext Crawler provides Yext customers with a tool to retrieve data from their own websites.

Operator: Yext Family: Yext Type: search Purpose: indexing
Verified: 1 Robots: no Block: depends Confidence: medium Identity: verified-bot
YandexVideoParser safe

YandexVideoParser

YandexVideoParser is a search crawler from Yandex used for search indexing, page discovery, or content rendering.

Operator: Yandex Family: Yandex Type: search Purpose: indexing
Verified: 1 Robots: no Block: depends Confidence: high Identity: official-documented
YandexWebmaster safe

YandexWebmaster

YandexWebmaster is a search crawler from Yandex used for search indexing, page discovery, or content rendering.

Operator: Yandex Family: Yandex Type: search Purpose: indexing
Verified: 1 Robots: yes Block: depends Confidence: high Identity: official-documented