Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
User-Agent Lookup API
ai neutral 1

ClaudeBot

ClaudeBot
Operator and family: Anthropic Kind: crawler Block: depends Status: active

ClaudeBot is Anthropic’s crawler used to discover and retrieve public web content for Claude-related systems.

View Record
ai neutral 1

Claude-User

Claude-User
Operator and family: Anthropic Kind: agent Block: depends Status: active

Claude-User represents user-initiated Claude retrieval activity rather than broad background crawling.

View Record
ai safe 1

Claude-SearchBot

Claude-SearchBot
Operator and family: Anthropic Kind: crawler Block: depends Status: active

Claude-SearchBot is Anthropic’s search-focused crawler for retrieving web content.

View Record
search neutral 1

CitibotSiteCrawler

CitibotSiteCrawler
Operator: Citibot · Family: CitibotSiteCrawler Kind: crawler Block: depends Status: active

CitibotSiteCrawler collects public data from government websites to power Citibot’s AI civic engagement tools.

View Record
search neutral 1

Chrome-Lighthouse

Chrome-Lighthouse
Operator and family: Google Kind: crawler Block: depends Status: active

Chrome-Lighthouse is an automated, open-source tool for auditing web page quality and does not operate as a traditional web crawler. It runs a series of audits…

View Record
preview safe 1

Chrome Privacy Preserving Prefetch Proxy

chrome-privacy-preserving-prefetch-proxy
Operator and family: Google Kind: preview Block: depends Status: active

Chrome Privacy Preserving Prefetch Proxy is a preview or prefetch bot from Google used to fetch pages for previews, unfurls, or user-triggered rendering.

View Record
monitoring neutral 1

CheckView

CheckView
Operator and family: CheckView.io Kind: monitor Block: depends Status: active

CheckView is a monitoring bot from CheckView.io used to check website availability, performance, or page health.

View Record
monitoring safe 1

Checkly Bot

Checkly
Operator and family: Checkly Kind: monitor Block: no Status: active

Checkly is a high-programmability active monitoring solution. We support users in monitoring their websites and APIs. Puppeteer and Playwright (both supported) are browser automation tools.

View Record
ai neutral 1

ChatGPT-User

ChatGPT-User
Operator and family: OpenAI Kind: agent Block: depends Status: active

ChatGPT-User represents user-initiated browsing or retrieval activity from ChatGPT.

View Record
ai safe 1

ChatGPT-Operator

chatgpt-operator
Operator and family: OpenAI Kind: agent Block: depends Status: active

ChatGPT-Operator is an AI agent from OpenAI used for AI-related crawling, retrieval, search, or assistant activity.

View Record
webhook safe 1

ChargeBee

ChargeBee
Operator and family: ChargeBee Kind: webhook Block: no Status: active

Chargebee provides a webhooks integration to notify web servers of payment events.

View Record
search neutral 1

Channel3Bot

channel3bot
Operator and family: Channel3 Kind: crawler Block: depends Status: active

Channel3Bot visits public product pages to index their content, with the aim of driving traffic back to those websites.

View Record