About this bot
AdsTxtCrawler is a ads txt crawler associated with OneTag Limited and used for ads txt verification.
The primary identifying User-Agent token is AdsTxtCrawler. Representative HTTP request identity: AdsTxtCrawler/1.0; +https://github.com/InteractiveAdvertisingBureau/adstxtcrawler.
Directory status: Active. Identity classification: Verified with High confidence. Identity type: verified bot.
This identity is recorded as honoring robots.txt under InteractiveAdvertisingBureau.
Risk classification: Neutral. Evaluate request context and site policy before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
AdsTxtCrawlerAdsTxtCrawler/1.0; +https://github.com/InteractiveAdvertisingBureau/adstxtcrawlerInteractiveAdvertisingBureau - Also known as
- InteractiveAdvertisingBureau
Details
- Kind
- Ads.txt crawler
- Family
- AdsTxtCrawler
- Purpose
- Ads.txt verification
- Common Use
- fetching publisher ads.txt files to verify OneTag authorization and advertising supply-chain declarations
- Respects robots.txt
- Yes
Verification
- Identity Type
- Verified bot
- Evidence Method
- Match `AdsTxtCrawler` as the claimed identity signal and corroborate it with stronger request or network signals when authentication matters.
- Detection Notes
- Match the `AdsTxtCrawler` User-Agent identity and consider the recorded alternate tokens.
Website controls
- Robots.txt Snippet
User-agent: InteractiveAdvertisingBureau Disallow: /