About this bot
YepBot is associated with Ahrefs and is used for indexnow validation and search index support.
The primary identity signal is YepBot. Representative HTTP identity: Mozilla/5.0 (compatible; YepBot/1.0; +http://yep.com/yepbot/).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented plus rdns.
robots.txt behavior: respected under the `YepBot` token.
Verification: Match YepBot/1.0, then corroborate origin by reverse DNS ending in ahrefs.com and forward resolution to the source address.
How to identify this bot
- User-agent and crawler identifiers
-
YepBotMozilla/5.0 (compatible; YepBot/1.0; +http://yep.com/yepbot/) - Also known as
- YepBot/1.0
Details
- Kind
- Crawler
- Family
- Yep
- Purpose
- Indexnow validation and search index support
- Common Use
- IndexNow validation and notification requests for the Yep/Ahrefs search-index ecosystem.
- Respects robots.txt
- Yes
Verification
- Identity Type
- official-documented-plus-rdns
- Evidence Method
- Match YepBot/1.0, then corroborate origin by reverse DNS ending in ahrefs.com and forward resolution to the source address.
- Detection Notes
- Yep documents YepBot as robots.txt- and Crawl-delay-compliant. Current use is primarily IndexNow key-validation and ping requests, although the identity supports the Yep/Ahrefs search-index ecosystem.
Website controls
- Robots.txt Snippet
User-agent: YepBot Disallow: /