Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
User-Agent Lookup API
search safe 1

DuckAssistBot

DuckAssistBot
Operator and family: DuckDuckGo Kind: crawler Block: depends Status: active

DuckAssistBot is a web crawler for DuckDuckGo.

View Record
security safe 1

Drata Autopilot

Dratabot
Operator and family: Drata Kind: scanner Block: no Status: active

The Drata Autopilot bot continuously monitors the security posture of customer domains.

View Record
search safe 1

Dr. Link Check

Dlc
Operator and family: Dr. Link Check Kind: crawler Block: no Status: active

Dr. Link Check crawls websites to help their owners identify and fix broken links.

View Record
monitoring safe 1

Doctom Monitor

DMBrowser
Operator and family: Dotcom-Monitor Kind: monitor Block: no Status: active

The Doctom Monitor checks websites for uptime and performance issues.

View Record
scraper neutral 1

discordBot

Discordbot
Operator and family: Discord, Inc. Kind: crawler Block: depends Status: active

The discordBot scrapes URLs that are shared within the Discord chat platform. This is done to generate contextual previews of the content, including titles, descriptions, and…

View Record
search neutral 1

Direqt Anomura

Anomura
Operator: Direqt · Family: Direqt Anomura Kind: crawler Block: depends Status: active

Anomura is Direqt’s search crawler, it discovers and indexes pages their customers websites.

View Record
scraper neutral 1

DigiCert DCV

DigiCert DCV Bot
Operator and family: DigiCert Kind: crawler Block: depends Status: active

DigiCert DCV is a crawler used for scraping, SEO analysis, or data collection from DigiCert.

View Record
scraper neutral 1

Diffbot-User

Diffbot-User
Operator and family: Diffbot Kind: fetcher Block: depends Status: active

Diffbot-User is a crawler used for scraping, SEO analysis, or data collection from Diffbot.

View Record
search neutral 1

Diffbot

Diffbot
Operator and family: Diffbot Kind: crawler Block: depends Status: active

Diffbot is a search crawler from Diffbot used for search indexing, page discovery, or content rendering.

View Record
ai neutral 1

Devin

Devin
Operator and family: Devin AI Kind: fetcher Block: depends Status: active

Devin is a collaborative AI teammate built to help ambitious engineering teams achieve more.

View Record
security safe 1

Detectify

Detectify
Operator and family: Detectify Kind: scanner Block: depends Status: active

Detectify is a security scanner from Detectify used for security checks, malware review, or abuse prevention.

View Record
search safe 1

Deepcrawl

lumar
Operator and family: Lumar Kind: crawler Block: no Status: active

The DeepCrawl bot crawls the websites of its customers to collect performance analytics and suggest SEO optimizations.

View Record