Slurp

Neutral Block: No Verified robots.txt: Yes

Yahoo Search web crawler (powered by Bing) for indexing web content.

Key facts

Operator
Yahoo
Family
Yahoo
Purpose
Indexing
User-Agent
Slurp
Should you block it?
No
Verified
Yes
Respects robots.txt
Yes
Identity type
Unknown
Confidence
Unknown

Bot details

Identity

User-Agent
Slurp
robots.txt token
Slurp
HTTP user-agent
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
Aliases
Yahoo Slurp, Yahoo Bot

Ownership

Operator
Yahoo
Family
Yahoo
Type
Search
Purpose
Indexing

Verification and trust

Source type
Unknown
Confidence
Unknown
Verification
Treat this entry as verified only when the exact user-agent matches the operator documentation at https://help.yahoo.com/help/us/ysearch/slurp.

Blocking and detection

Robots

User-agent: Slurp
Disallow: /

Cloudflare

(http.user_agent contains "Slurp")
Advanced server rules

Apache

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Slurp [NC]
RewriteRule ^ - [F,L]

Nginx

if ($http_user_agent ~* "Slurp") { return 403; }

Notes

Yahoo Search web crawler (powered by Bing) for indexing web content.

Slurp is operated by Yahoo. Botcrawl classifies it as a search bot with a primary purpose of indexing.

Key profile signals: risk level: neutral; robots.txt: yes; verified: yes.

Treat this entry as verified only when the exact user-agent matches the operator documentation at https://help.yahoo.com/help/us/ysearch/slurp.

Source documentation: https://help.yahoo.com/help/us/ysearch/slurp

Evidence and source

  • Treat this entry as verified only when the exact user-agent matches the operator documentation at https://help.yahoo.com/help/us/ysearch/slurp.