Bot Directory

Search public Botcrawl bot records to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.

AI Crawlers Search Bots Scrapers Scanners Monitoring Preview Bots
See these bots hitting your site in real time

The public directory explains known bots and user-agents. Botcrawl Edge uses BotDB plus datacenter intelligence for live classification, rules, and enforcement.

Try Edge Free Open Edge BotDB
998 bots
2checkout Safe

2checkout

2checkout is a webhook callback used for webhook delivery, payment notifications, service callbacks.

Operator and family: 2checkout Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
monitoring360 Safe

360Monitoring

360Monitoring is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: 360Monitoring Type: Monitoring
Not verified robots.txt: Unknown Block: No Observed
View Record Open in Edge BotDB
AccessibleWebBot Safe

Accessible Web Bot

Accessible Web Bot is a monitoring bot from Accessible Web used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Accessible Web Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
AccessStatus Safe

AccessStatus

AccessStatus is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: AccessStatus Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Accoona-AI-Agent Neutral

Accoona-AI-Agent

Accoona-AI-Agent is a search crawler from Accoona used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Accoona Type: Search Engine Crawler Purpose: Search Indexing
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
ActiveComply Safe

ActiveComply Bot

ActiveComply Bot is a security scanner from ActiveComply used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: ActiveComply Type: Security
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
Acunetix Caution

Acunetix

Acunetix is a security scanner used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Acunetix Type: Vulnerability Scanner Purpose: Vulnerability Scanning
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
Adagiobot Safe

Adagio Bot

Adagio Bot is a monitoring bot from Adagio used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Adagio Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
AddSearchBot Neutral

AddSearchBot

AddSearchBot is a search crawler from Addsearch used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Addsearch Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
AddThis Neutral

AddThis

AddThis is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: AddThis Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
ADmantX Caution

ADmantX

ADmantX is a marketing crawler used for advertising quality review, contextual classification, brand-safety checks.

Operator and family: ADmantX Type: Marketing Crawler Purpose: Marketing Intelligence
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
AdsBot-Google-Mobile Safe

AdsBot-Google-Mobile

AdsBot-Google-Mobile is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: Depends Block: Depends Official Documented
View Record Open in Edge BotDB
AdSensorBot Neutral

AdSensor

AdSensor is a marketing crawler from LLC EDKONTROL used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator: LLC EDKONTROL Family: AdSensor Type: Advertising Purpose: Ad Monitoring
Verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
adsnaver Safe

adsnaver

adsnaver is a search crawler from Naver used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Naver Type: Search Purpose: Indexing
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
InteractiveAdvertisingBureau Neutral

AdsTxtCrawler

AdsTxtCrawler is a search crawler from OneTag Limited used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: OneTag Limited Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
Advailo Kuma Neutral

Advailo Kuma

Advailo Kuma is a monitoring bot from Advailo used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Advailo Type: Monitoring
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
AdvallyBot Neutral

AdvallyBot

AdvallyBot is a marketing crawler from Advally used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Advally Type: Advertising Purpose: Ads Txt Monitoring
Verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
Adyen Safe

Adyen

Adyen is a webhook callback used for webhook delivery, payment notifications, service callbacks.

Operator and family: Adyen Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Aether Neutral

Aether

Aether is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Aether Type: Search Engine Crawler Purpose: Search Indexing
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
AfterShip Magento-2 Connector Safe

AfterShip Magento 2 Connector

AfterShip Magento 2 Connector is an ecommerce crawler from AfterShip used for product discovery, catalog checks, marketplace crawling, price monitoring.

Operator and family: AfterShip Type: Ecommerce
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
aa/1.0 Neutral

Agency Analytics Crawler

Agency Analytics Crawler is a search crawler from Agency Analytics used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Agency Analytics Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
AgencyToolsPro Neutral

AgencyToolsPro Uptime Monitoring Bot

AgencyToolsPro Uptime Monitoring Bot is a monitoring bot from AgencyToolsPro used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: AgencyToolsPro Type: Monitoring
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
AgentTimes Neutral

AgentTimes

AgentTimes is an AI crawler from Unknown used for assistant-driven browsing, page retrieval.

Family: AgentTimes Type: Ai Purpose: Ai Assistant
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
agi-agent-2 Neutral

AGI Agent

AGI Agent is an AI crawler from AGI, Inc used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: AGI, Inc Family: AGI Agent Type: Ai Purpose: AI Agent
Verified robots.txt: Unknown Block: Depends Signed Agent
View Record Open in Edge BotDB