Overview
AudigentBot is Audigent’s broader advertising crawler.
It can collect content from both the HTML header and page body for advertising-related analysis. It is a distinct operator-documented identity from `AudigentAdBot`, which is limited to header metadata. A wildcard robots.txt disallow can block AudigentBot.
Directory status: Active. Identity classification: Verified with High confidence.
This identity is documented as honoring robots.txt controls.
Risk classification: Neutral.
Identity
- User-Agent Pattern
-
AudigentBot - Aliases
- audigentbot
- HTTP Agent Examples
-
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; AudigentBot; +https://audigent.com/bot.html) Chrome/W.X.Y.Z Safari/537.36 - Robots Token
- AudigentBot
- Identity Type
- Officially documented
- Evidence Method
- Match the documented `AudigentBot` token and browser-like User-Agent. Corroborate source and advertising context when authenticity matters because the User-Agent is copyable.
Classification
- Type
- Advertising
- Kind
- Advertising crawler
- Family
- Audigent
- Purpose
- Advertising content analysis
Behavior and handling
- Common Use
- Collecting webpage header and body content to support advertising relevance, metadata analysis, and ad-inventory bidding on sites where Audigent or its partners may serve ads.
- Detection Notes
- AudigentBot is distinct from `AudigentAdBot`: this crawler can access both header and body content, while AudigentAdBot is limited to header metadata.
- Respects robots.txt
- Yes
- Spoofing Risk
- The browser-like User-Agent can be copied; corroborate source and behavior before making trust-based decisions.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: AudigentBot Disallow: /