Overview
Sogou inst spider is operated by Sogou and is used for Rapid or specialized crawling for Sogou Search.
Its documented identity is Sogou inst spider/4.0. The robots.txt token is Sogou inst spider.
It follows robots.txt rules addressed to Sogou inst spider.
Match the case-sensitive Sogou inst spider token and corroborate it with current Sogou documentation, source-network ownership, and crawl behavior.
Identity
- User-Agent Pattern
-
Sogou inst spider - Aliases
- Sogou inst spider/4.0
- HTTP Agent Examples
-
Sogou inst spider/4.0 - Robots Token
- Sogou inst spider
- Identity Type
- Officially documented
- Evidence Method
- Match the case-sensitive Sogou inst spider token and corroborate it with current Sogou documentation, source-network ownership, and crawl behavior.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- Sogou
- Operator
- Sogou
- Company
- Sogou Inc.
- Purpose
- Search indexing
Behavior and handling
- Common Use
- Rapid or specialized crawling for Sogou Search.
- Detection Notes
- Sogou lists Sogou inst spider alongside Sogou web spider and states that its spiders support robots.txt.
- Respects robots.txt
- Yes
- Spoofing Risk
- The plain-text user-agent is spoofable; network and behavioral checks are required.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: Sogou inst spider Disallow: / - Apache Rule
-
RewriteCond %{HTTP_USER_AGENT} Sogou\ inst\ spider [NC] RewriteRule .* - [F,L] - Nginx Rule
-
if ($http_user_agent ~* "Sogou\ inst\ spider") { return 403; }