About this bot
yisouspider is associated with UCWeb / Alibaba Group and is used for mobile search indexing.
The primary identity signal is yisouspider. Representative HTTP identity: yisouspider.
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
robots.txt behavior: respected under the `yisouspider` token.
Verification: Match the documented yisouspider identity; corroborate origin through Shenma-controlled request/network context before applying trust-based exceptions.
How to identify this bot
- User-agent and crawler identifiers
-
yisouspider - Also known as
- YisouSpider; Shenma spider; Shenma Search crawler YisouSpider
Details
- Kind
- Crawler
- Family
- Shenma Search
- Purpose
- Mobile search indexing
- Common Use
- Mobile-web discovery and indexing for Shenma Search.
- Respects robots.txt
- Yes
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match the documented yisouspider identity; corroborate origin through Shenma-controlled request/network context before applying trust-based exceptions.
- Detection Notes
- Shenma’s webmaster guidance explicitly identifies yisouspider as its crawler and tells publishers to allow normal pages in robots.txt for crawling.
Website controls
- Robots.txt Snippet
User-agent: yisouspider Disallow: /- Apache Rule
RewriteCond %{HTTP_USER_AGENT} yisouspider [NC] RewriteRule .* - [F,L]- Nginx Rule
if ($http_user_agent ~* "yisouspider") { return 403; }