Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
User-Agent Lookup API
scraper neutral 1

Channable

channable/importer
Operator and family: Channable Kind: crawler Block: depends Status: active

Channable is a crawler used for scraping, SEO analysis, or data collection from Channable.

View Record
monitoring safe 1

Cert Chief

CertChief
Operator and family: Chief Tools Kind: monitor Block: no Status: active

Cert Chief is a certificate monitoring tool that periodically crawl web properties to check their configuration and reports problems and changes when they are detected.

View Record
security neutral 1

CCBot

CCBot
Operator and family: Common Crawl Kind: scanner Block: depends Status: active

CCBot is a security scanner from Common Crawl used for security checks, malware review, or abuse prevention.

View Record
monitoring safe 1

catchpoint

Catchpoint
Operator and family: Catchpoint Kind: monitor Block: no Status: active

Our mission has remained the same from day one: to prioritize monitoring and observability from the end-user perspective.

View Record
search neutral 1

Capital One Bot

CapitalOneBot
Operator and family: Capital One Kind: crawler Block: depends Status: active

Capital One Bot crawls dealer websites for getting the usage information for Capital One lead navigator button.

View Record
search neutral 1

CaliberBot

Caliperbot/1.0
Operator and family: Conductor Kind: crawler Block: depends Status: active

Caliperbot crawls Conductor clients' and prospects' websites for HTML feature extraction to power Content Analytics features within our Searchlight web application.

View Record
feed safe 1

Buttondown RSS-Feed-Parser

Buttondown
Operator and family: Buttondown Kind: fetcher Block: depends Status: active

The bot fetches RSS feeds to import into Buttondown newsletters.

View Record
monitoring safe 1

BugsNag

BugsNag
Operator and family: Bugs Nag Kind: monitor Block: no Status: active

BugsNag integration service, now Insight Hub, is used for error and performance monitoring of web applications.

View Record
preview neutral 1

Buffer Link Preview Bot

BufferLinkPreviewBot
Operator and family: buffer.com Kind: preview Block: depends Status: active

When Buffer users share links in their social media posts, their scraper helps create engaging previews.

View Record
ai neutral 1

Browserbase

browserbase
Operator and family: Browserbase Kind: agent Block: depends Status: active

Browserbase is an AI agent from Browserbase used for AI-related crawling, retrieval, search, or assistant activity.

View Record
search neutral 1

BrightEdge Bot

BrightEdge Crawler
Operator and family: BrightEdge Kind: crawler Block: depends Status: active

Autopilot is an SEO marketing automation tool that includes features for internal linking and image optimization. We crawl customer sites so that we can determine the…

View Record
monitoring safe 1

Brightbot

brightbot
Operator and family: Bright Data Kind: monitor Block: depends Status: active

Brightbot is a monitoring bot from Bright Data used to check website availability, performance, or page health.

View Record