Overview
TwinAgent is an AI crawler from Twin used for assistant-driven browsing, page retrieval, and automated web access on behalf of an AI product.
Its primary user-agent pattern is TwinAgent; a representative HTTP user-agent is TwinAgent/1.0.
TwinAgent is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Robots.txt behavior is not currently confirmed.
TwinAgent should be handled according to the site owner’s AI crawler policy, with allow, block, or rate-limit rules applied deliberately.
Identity
- User-Agent Pattern
-
TwinAgent - HTTP Agent Examples
-
TwinAgent/1.0 - Robots Token
- TwinAgent
- Identity Type
- Observed
- Evidence Method
- Treat `TwinAgent` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- AI
- Kind
- Fetcher
- Family
- Twin
- Operator
- Twin
- Company
- Twin
- Purpose
- AI assistant
Behavior and handling
- Common Use
- TwinAgent is used for assistant-driven browsing, page retrieval, and automated web access on behalf of an AI product.
- Detection Notes
- TwinAgent traffic is primarily detected by the `TwinAgent` user-agent pattern; a representative HTTP user-agent is `TwinAgent/1.0`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Twin infrastructure before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- TwinAgent has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.