Overview
Ahrefs Site Audit is a search crawler from Ahrefs used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is AhrefsSiteAudit; related patterns include Ahrefs audit crawler; a representative HTTP user-agent is Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/).
Ahrefs Site Audit is verified with High confidence. The identity type is Verified Bot, and the evidence basis is official operator documentation.
Ahrefs Site Audit is marked as respecting robots.txt directives for crawler access control.
Ahrefs Site Audit should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent Pattern
-
AhrefsSiteAudit - Aliases
- Ahrefs audit crawler
- HTTP Agent Examples
-
Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/) - Robots Token
- AhrefsSiteAudit
- Identity Type
- Verified bot
- Evidence Method
- Verify Ahrefs Site Audit by matching `AhrefsSiteAudit` to Ahrefs evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- Ahrefs
- Purpose
- Indexing
Behavior and handling
- Common Use
- Ahrefs Site Audit is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- Ahrefs Site Audit traffic is primarily detected by the `AhrefsSiteAudit` user-agent pattern; related patterns include `Ahrefs audit crawler`; a representative HTTP user-agent is `Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/)`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Ahrefs infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Ahrefs Site Audit has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: AhrefsSiteAudit Disallow: /
Relationships
- Operator
- Ahrefs Checked 2026-06-23
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.