Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
User-Agent Lookup API
search safe 1

BingBot

bingbot
Operator and family: Microsoft Kind: crawler Block: depends Status: active

Bingbot is Microsoft Bing's crawler and handles most of Bing's routine web crawling for search discovery and indexing.

View Record
scraper neutral 1

Bing Preview

BingPreview
Operator and family: Microsoft Kind: preview Block: depends Status: active

BingPreview generates page snapshots for Bing. Note that BingPreview has desktop and mobile variants.

View Record
search neutral 1

Bing Ads

adidxbot
Operator and family: Microsoft Kind: crawler Block: depends Status: active

AdIdxBot is the crawler used by Bing Ads. AdIdxBot crawls ads and follows the websites from those ads for quality control. Just like Bingbot, AdIdxBot has…

View Record
monitoring safe 1

BinaryCanary

http://www.binarycanary.com
Operator and family: Binary Canary Kind: monitor Block: no Status: active

BinaryCanary monitors websites for availability and performance issues.

View Record
scraper neutral 1

BigUpData Bot

BigUpDataBot
Operator and family: BigUpData Kind: crawler Block: depends Status: active

BigUpData Bot is a crawler used for scraping, SEO analysis, or data collection from BigUpData.

View Record
monitoring safe 1

BigScootsMonitor

BigScootsMonitor
Operator: BigScoots · Family: BigScootsMonitor Kind: monitor Block: no Status: active

BigScootsMonitor is a monitoring bot from BigScoots used to check website availability, performance, or page health.

View Record
search neutral 1

Big Sur AI

bigsur.ai
Operator and family: Big Sur AI Kind: crawler Block: depends Status: active

Big Sur AI Crawler, crawlers users websites to enable AI-infused experiences.

View Record
search neutral 1

Bibliotheque Nacional de France Crawler

bnf.fr_bot
Operator and family: Bibliothèque nationale de France Kind: crawler Block: depends Status: active

Bibliothèque nationale de France's mission is to collect, catalog, preserve, enrich and communicate the national documentary heritage.

View Record
monitoring safe 1

Better Uptime

Better Uptime Bot
Operator and family: Better Stack Kind: monitor Block: no Status: active

The bot is used for monitoring infrastructure platforms.

View Record
search neutral 1

BestChange Bot

BestChange
Operator and family: BestChange Kind: crawler Block: depends Status: active

The BestChange bot downloads exchange rate information from 600 websites every 5 seconds.

View Record
feed safe 1

Bazqux

BazQux
Operator and family: Bazqux Kind: fetcher Block: depends Status: active

The Bazqux Fetcher is how BazQux Reader grabs RSS/Atom feeds and com­ments when users choose to sub­scribe to your blog in BazQux Reader. Fetcher col­lects and…

View Record
search neutral 1

Barkrowler

Barkrowler
Operator and family: Babbar Kind: crawler Block: depends Status: active

SEO web crawler to identify web page popularity and thematic.

View Record