About this bot
Botify is associated with Botify and used for technical seo site auditing.
The primary identifying User-Agent token is botify. Representative HTTP request identity: Mozilla/5.0 (compatible; botify;http://botify.com).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
robots.txt handling depends on the deployment, configuration, or request mode.
Verification: Match the `botify` token and corroborate crawl configuration or verified-site context. Botify customers can configure User-Agent behavior.
How to identify this bot
- User-agent and crawler identifiers
-
botifyMozilla/5.0 (compatible; botify;http://botify.com) - Also known as
- SiteCrawler Botify crawler Botify
Details
- Kind
- Technical SEO crawler
- Family
- Botify
- Purpose
- Technical SEO site auditing
- Common Use
- technical SEO crawling, site auditing, content analysis, and search-performance diagnostics
- Respects robots.txt
- Depends
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match the `botify` token and corroborate crawl configuration or verified-site context. Botify customers can configure User-Agent behavior.
- Detection Notes
- Botify crawls sites for technical SEO analysis, ContentIQ/Site Audit, and search-performance recommendations; robots behavior can be overridden by project configuration.
Website controls
- Robots.txt Snippet
# robots.txt handling depends on the deployment or configuration. Confirm behavior before relying on robots.txt alone.