About this bot
RetilyCrawler is a crawler associated with Retily and used for support knowledge ingestion.
The primary identifying User-Agent token is RetilyCrawler. Representative HTTP request identity: RetilyCrawler/1.0 (+https://retily.com/bot).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
This identity is recorded as honoring robots.txt under RetilyCrawler.
Risk classification: Neutral. Evaluate request context and site policy before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
RetilyCrawlerRetilyCrawler/1.0 (+https://retily.com/bot)
Details
- Kind
- Crawler
- Family
- Retily
- Purpose
- Support knowledge ingestion
- Common Use
- on-demand ingestion of customer website content
- Respects robots.txt
- Yes
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match `RetilyCrawler` as the claimed identity signal and corroborate it with independent network, DNS, cryptographic, or request-context signals when stronger authentication is required.
- Detection Notes
- Match the `RetilyCrawler` User-Agent token. A User-Agent match identifies a claim, not authenticated origin.
Website controls
- Robots.txt Snippet
User-agent: RetilyCrawler Disallow: /