Overview
Sitebulb is a search crawler used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is Sitebulb; related patterns include Sitebulb/1.1; Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36 (compatible; Sitebulb/1.1; +https://sitebulb.com); a representative HTTP user-agent is Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36 (compatible; Sitebulb/1.1; +https://sitebulb.com).
Sitebulb is verified with High confidence. The identity type is Official Documented, and the evidence basis is official operator documentation.
Sitebulb is marked as respecting robots.txt directives for crawler access control.
Sitebulb can usually be allowed after confirming the source and monitoring request volume.
Identity
- User-Agent Pattern
-
Sitebulb - Aliases
- Sitebulb/1.1; Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36 (compatible; Sitebulb/1.1; +https://sitebulb.com)
- HTTP Agent Examples
-
Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36 (compatible; Sitebulb/1.1; +https://sitebulb.com) - Robots Token
- Sitebulb
- Identity Type
- Officially documented
- Evidence Method
- Verify Sitebulb by matching `Sitebulb` to official operator documentation, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- Sitebulb
- Purpose
- Technical SEO analysis
Behavior and handling
- Common Use
- Sitebulb is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- Sitebulb traffic is primarily detected by the `Sitebulb` user-agent pattern; related patterns include `Sitebulb/1.1; Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36 (compatible; Sitebulb/1.1; +https://sitebulb.com)`; a representative HTTP user-agent is `Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36 (compatible; Sitebulb/1.1; +https://sitebulb.com)`. Compare source IPs, reverse DNS, request paths, and crawl cadence before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Sitebulb has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Safe
- Recommended Handling
- Do not block
Rules and controls
- Robots.txt Snippet
-
User-agent: Sitebulb Disallow: /
Relationships
- Operator
- Sitebulb Checked 2026-06-02
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.