About this bot
Context7-Crawler indexes software documentation so developers and AI tools can retrieve current, source-linked references.
Context7 publishes the Context7-Crawler/1.0 user agent, robots.txt controls, and cryptographic HTTP Message Signature verification.
Identification: Context7-Crawler. Robots.txt token: Context7-Crawler.
Operator documentation: https://context7.com/crawler.
How to identify this bot
- User-agent and crawler identifiers
-
Context7-CrawlerContext7-Crawler/1.0 (+https://context7.com/crawler)
Details
- Kind
- Documentation crawler
- Family
- Upstash
- Purpose
- Technical documentation indexing
- Common Use
- crawling and indexing public technical documentation
- Respects robots.txt
- Yes
Verification
- Identity Type
- Officially documented
- Evidence Method
- Verify the documented request signature or provider IP/network where available; a matching User-Agent string alone is not proof of origin.
- Detection Notes
- Match HTTP User-Agent token Context7-Crawler; Uses Web Bot Auth signatures. This is documentation retrieval, not a general AI model-training crawler.
Website controls
- Robots.txt Snippet
User-agent: Context7-Crawler Disallow: /