Overview
SiteGuru is an automated web identity associated with SiteGuru.
It is used for SEO analysis and website crawling.
The documented User-Agent pattern is SiteGuruCrawler. User-Agent strings can be copied, so corroborate requests with operator documentation, network ownership, reverse DNS, or other request evidence.
Identity
- User-Agent
SiteGuruCrawler- HTTP Agent Examples
SiteGuruCrawler- Identity Type
- User Agent
- Evidence Method
- Match the documented User-Agent pattern SiteGuruCrawler, then corroborate it with operator documentation, network ownership, reverse DNS, or other request evidence. User-Agent strings alone do not prove identity.
Classification
- Type
- Seo
- Kind
- Crawler
- Family
- SiteGuru
- Purpose
- seo-crawling
Behavior and handling
- Common Use
- SEO analysis and website crawling
- Detection Notes
- Detect candidate SiteGuru traffic using the documented User-Agent pattern SiteGuruCrawler. Confirm the identity with supporting evidence before enforcement.
- Respects robots.txt
- Yes
- Spoofing Risk
- SiteGuru can be impersonated because its User-Agent pattern can be copied. Treat the identity as confirmed only when supporting evidence matches.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
User-agent: SiteGuruCrawler Disallow: /