Skip to content
Public bot and datacenter intelligence since 2011. Public intelligence since 2011 Browse databases

Open web intelligence

Public bot and datacenter intelligence.

Search documented bot identities, user-agent strings, operators, ASNs, network providers, and independent web-security research.

Public databases

Research bots and network infrastructure.

Each record is organized for fast research, source review, identity checks, and practical website policy decisions.

1,006 published records

Bot Directory

Identify crawlers, AI agents, search bots, monitoring services, automation tools, and potentially unwanted traffic by name, operator, purpose, and user-agent.

  • User-agent and robots.txt data
  • Operator, family, type, and purpose
  • Verification notes and source links
Open Bot Directory
44 published records

Datacenter Directory

Research hosting providers, cloud networks, ASNs, CIDR ranges, locations, traffic classifications, and infrastructure commonly associated with automated requests.

  • Providers, organizations, and ASNs
  • IP ranges, countries, and network types
  • Confidence, risk, and evidence fields
Open Datacenter Directory

Built for research

A practical public reference for the automated web.

01

Identity

Understand what a bot claims to be, who operates it, why it exists, and how its identifiers are documented.

02

Infrastructure

Connect providers, networks, ASNs, countries, IP ranges, and hosting classifications to public records.

03

Evidence

Review source links, verification methods, confidence notes, risks, and handling guidance before making decisions.

Latest research

Analysis from the Botcrawl blog.

View all articles

Open access

Start with the public directories.

Search records directly, follow the evidence, and use the blog for deeper bot, cybersecurity, malware, scam, and infrastructure research.