Public Bot and Datacenter Directory
See what is crawling the web.
Identify web crawlers, AI agents, hosting networks, and the infrastructure behind automated traffic.
Search the public index
Identify a Bot or network.
1,048Bot records
80Network records
766Operators indexed
8,110Published guides
Explore the directory
Two databases. One clear view of automated traffic.
Bot Directory
Crawlers, agents, monitors, and automated clients
Understand identity, purpose, operator, verification, robots behavior, spoofing risk, and recommended handling.
Browse all BotsDatacenter Directory
Clouds, hosting networks, ASNs, and infrastructure
Review providers, organizations, CIDR ranges, infrastructure classes, traffic context, and operational cautions.
Browse all networks