Bot Directory

Diffbot-User Neutral

Diffbot-User

Diffbot-User is a crawler used for scraping, SEO analysis, or data collection from Diffbot.

Operator and family: Diffbot Type: Scraper Purpose: Scraping

Verified robots.txt: Yes Block: Depends Official Documented

DigiCert DCV Bot Neutral

DigiCert DCV

DigiCert DCV is a crawler used for scraping, SEO analysis, or data collection from DigiCert.

Operator and family: DigiCert Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

Anomura Neutral

Direqt Anomura

Anomura is Direqt’s search crawler, it discovers and indexes pages their customers websites.

Operator: Direqt Family: Direqt Anomura Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

Discordbot Neutral

discordBot

The discordBot scrapes URLs that are shared within the Discord chat platform. This is done to generate contextual previews of the content, including titles, descriptions, and images.

Operator: Discord, Inc. Family: Discord Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

DMBrowser Safe

Doctom Monitor

The Doctom Monitor checks websites for uptime and performance issues.

Operator and family: Dotcom-Monitor Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

Dlc Safe

Dr. Link Check

Dr. Link Check crawls websites to help their owners identify and fix broken links.

Operator and family: Dr. Link Check Type: Search Purpose: Indexing

Verified robots.txt: No Block: No Verified Bot

Dratabot Safe

Drata Autopilot

The Drata Autopilot bot continuously monitors the security posture of customer domains.

Operator and family: Drata Type: Security

Verified robots.txt: No Block: No Verified Bot

DuckAssistBot Safe

DuckAssistBot

DuckAssistBot is a web crawler for DuckDuckGo.

Operator and family: DuckDuckGo Type: Search Purpose: Indexing

Verified robots.txt: Yes Block: Depends Official Documented

DuckDuckBot Safe

DuckDuckBot

DuckDuckBot is the search engine crawler for the DuckDuckGo search engine.

Operator and family: DuckDuckGo Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

easybill-ImportManager Neutral

EasyBill Import Manager

EasyBill Import Manager is a tool that synchronizes order data from external systems to EasyBill.

Operator and family: easybill.de Type: Ecommerce

Verified robots.txt: No Block: Depends Verified Bot

EasyCron Safe

EasyCron

EasyCron is an online cron job service. Users can schedule an HTTP request to be made at a specific date and time.

Operator and family: EasyCron Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

http://easyurl.net/monitoring Safe

Easydns

Easydns is a monitoring bot from EasyDNS used to check website availability, performance, or page health.

Operator and family: EasyDNS Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

EasyScan Neutral

EasyScan

EasyScan is an AI agent from codire GmbH used for AI-related crawling, retrieval, search, or assistant activity.

Operator: codire GmbH Family: codire Type: Ai Purpose: Ai Assistant

Verified robots.txt: No Block: Depends Verified Bot

w4mwnpbXf3MFAbxOkJRw Neutral

Echobot Bot

We scrape full article/page content to ensure we can optimally automate the content distribution for the digital publishers we work with. Every single article a publisher releases will get.

Operator and family: Echobox Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

elmahio-uptimebot Safe

elmah.io Uptime Monitoring

Elmah.io Uptime Monitoring bot is a heartbeats tool monitors the availability of their users' websites.

Operator and family: elmah.io Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

eMoneyBot Neutral

eMoney Advisor

eMoney Advisor is a search crawler from eMoney Advisor used for search indexing, page discovery, or content rendering.

Operator and family: eMoney Advisor Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

EpivozCrawler Neutral

Epivoz Crawler

News aggregator needs to crawl news/blog articles to generate short summaries for page preview of attributed links.

Operator and family: Techmeme Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

eRepublik.tools Safe

eRepublik.tools

Search engine providing gaming statistics and tools for the browser game "eRepublik".

Operator and family: Sebastian Foth - Software Solutions Type: Search Purpose: Indexing

Verified robots.txt: No Block: No Verified Bot

EvoUptimeBot Safe

EvoUptimeBot

Built-in uptime monitoring for the EvoCommerce platform.

Operator and family: Evo Agency Ltd. Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

ExaBot Neutral

ExaBot

Claimed Exa crawler identifier for AI search and web data retrieval.

Operator and family: Exa Type: Ai Purpose: AI Search Data Retrieval

Not verified robots.txt: Unknown Block: Depends Observed

ExodusMovement Safe

Exodus

Exodus is an automated bot from Exodus.

Operator and family: Exodus Purpose: Site Owner Fetch

Verified robots.txt: No Block: No Verified Bot

http://www.ezoic.com/bot.html Neutral

EzoicBot

Ezoic is a technology platform for digital publishers. You can learn more about what Ezoic does here.EzoicBot is our web crawler designed to extract valuable information about how the.

Operator and family: Ezoic Inc Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

facebook-webhooks Safe

Facebook Webhooks

Facebook Webhooks is a webhook callback service from Meta used for service notifications, callbacks, or integration events.

Operator and family: Meta Type: Webhook

Verified robots.txt: Unknown Block: Depends Verified Bot

FacebookBot Neutral

FacebookBot

FacebookBot is a search crawler from Meta used for search indexing, page discovery, or content rendering.

Operator and family: Meta Type: Search Purpose: Indexing

Verified robots.txt: Yes Block: Depends Verified Bot