Bot intelligence record

Siteliner

Usually allow

Siteliner is a search crawler used for search indexing, URL discovery, page rendering, result freshness; it appears in server logs as `Siteliner`.

Search Site Quality Audit Official Documented Confidence: High Verified: Yes robots.txt: Yes
Operator
Siteliner
Family
Siteliner
Type
Search
Source type
Official
Last checked
2026-06-02

User-Agent Pattern

Siteliner
Siteliner
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy 
User-agent: Siteliner
Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

No

This bot is usually safe to allow when the request source is verified and the traffic matches your site policy.

Siteliner is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.

Record Details

Verified fields
Operator
Siteliner
Family
Siteliner
Type
Search
Purpose
Site Quality Audit
Identity type
Official Documented
Confidence
High
Last verified
2026-06-02
Last checked
2026-06-02
Source type
Official
Verification
Verify Siteliner by matching `Siteliner` to official operator documentation, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
Spoofing risk
Siteliner has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.

Notes

  • Siteliner is a search crawler used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
  • Its primary user-agent pattern is Siteliner; related patterns include Mozilla/5.0 (compatible; Siteliner/1.0; +http://www.siteliner.com/bot); a representative HTTP user-agent is Mozilla/5.0 (compatible; Siteliner/1.0; +http://www.siteliner.com/bot).
  • Siteliner is verified with High confidence. The identity type is Official Documented, and the evidence basis is official operator documentation.
  • Siteliner is marked as respecting robots.txt directives for crawler access control.
  • Siteliner can usually be allowed after confirming the source and monitoring request volume.

Evidence and Source

  • Verify Siteliner by matching `Siteliner` to official operator documentation, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
  • Siteliner traffic is primarily detected by the `Siteliner` user-agent pattern; related patterns include `Mozilla/5.0 (compatible; Siteliner/1.0; +http://www.siteliner.com/bot)`; a representative HTTP user-agent is `Mozilla/5.0 (compatible; Siteliner/1.0; +http://www.siteliner.com/bot)`. Compare source IPs, reverse DNS, request paths, and crawl cadence before trusting the traffic.
  • Siteliner is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
  • Siteliner has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.

https://www.siteliner.com/bot

Use This Signal In Edge

Botcrawl Edge

Use Edge to match live requests, detect related datacenter traffic, and apply allow, block, rate-limit, or log rules.

Open Edge Open in Edge BotDB