Overview
LINER Bot is an AI training crawler used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
Its primary user-agent pattern is LinerBot; a representative HTTP user-agent is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; LinerBot/1.0; +https://docs.getliner.com/docs/linerbot).
LINER Bot is verified with Medium confidence. The identity type is Verified Bot, and the evidence basis is a public crawler reference or source-linked documentation.
LINER Bot is marked as not reliably governed by robots.txt directives; use server-side rules if the traffic should be restricted.
LINER Bot should be handled according to the site owner’s AI crawler policy, with allow, block, or rate-limit rules applied deliberately.
Identity
- User-Agent
LinerBot- HTTP Agent Examples
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; LinerBot/1.0; +https://docs.getliner.com/docs/linerbot)- Robots.txt Token
LinerBot- Identity Type
- Verified Bot
- Evidence Method
- Verify LINER Bot by matching `LinerBot` to a public crawler reference or source-linked documentation, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
Classification
- Type
- AI
- Kind
- Crawler
- Family
- Liner Bot
- Purpose
- ai-training
Behavior and handling
- Common Use
- LINER Bot is used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
- Detection Notes
- LINER Bot traffic is primarily detected by the `LinerBot` user-agent pattern; a representative HTTP user-agent is `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; LinerBot/1.0; +https://docs.getliner.com/docs/linerbot)`. Compare source IPs, reverse DNS, request paths, and crawl cadence before trusting the traffic.
- Respects robots.txt
- No
- Spoofing Risk
- LINER Bot has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
# This agent may ignore robots.txt. Use authenticated access controls or network policy when blocking is required.