Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
search safe 1

deadlinkchecker

deadlinkchecker
Operator and family: DLC Websites Kind: crawler Block: no Status: active

Dead Link Checker is a service which crawls a customer's website reporting on any broken links (404, 500 etc) it finds.

search safe 1

Daum

Daum/4.1
Operator and family: Daum Kind: crawler Block: depends Status: active

Daum is a search crawler associated with Daum, used for search indexing and content discovery.

search safe 1

Dataprovider.com

Dataprovider
Operator and family: Dataprovider.com Kind: crawler Block: depends Status: active

Dataprovider.com indexes the web and structures the data.

scraper neutral 1

DataForSEO Bot

DataForSeoBot
Operator and family: DataForSEO Kind: crawler Block: depends Status: active

DataForSEO Bot is a driving force of our leading product - Backlinks API, which has been developed with a single purpose: providing website owners, webmasters, and…

scraper neutral 1

DataForSEO

RSiteAuditor
Operator and family: DataForSEO Kind: crawler Block: depends Status: active

DataForSEO is using RSiteAuditor to scan websites for critical on-site SEO errors and provides aggregated data in a structured form to its customer through a RESTful…

monitoring safe 1

Dash0 Synthetic Monitoring

dash0-synthetic
Operator and family: Dash0 Kind: monitor Block: depends Status: active

Dash0 Synthetic Monitoring is a monitoring bot from Dash0 used to check website availability, performance, or page health.

scraper safe 1

Cốc Cốc

coccocbot
Operator and family: Coccoc Kind: crawler Block: depends Status: active

Coccocbot scrapes websites that are request from the Vietnamese search engine Coc Coc.

security safe 1

Cybaa Bot

CybaaBot
Operator: Cybaa · Family: Cybaa Bot Kind: scanner Block: no Status: active

Performs broad security research by crawling the most popular domains obtained from Crawler.Ninja.

security safe 1

Cybaa Agent

cybaa-agent
Operator and family: Cybaa Kind: scanner Block: depends Status: active

Cybaa Agent is a security scanner from Cybaa used for security checks, malware review, or abuse prevention.

monitoring neutral 1

Cxense

cXensebot
Operator and family: Cxense Kind: monitor Block: depends Status: active

The Cxensebot performs SEO monitoring and analysis of customer webpages.

webhook safe 1

Customer.io Webhooks

customerio-webhooks
Operator and family: Customer.io Kind: webhook Block: depends Status: active

Customer.io Webhooks is a webhook callback service from Customer.io used for service notifications, callbacks, or integration events.

unknown safe 1

cron-job.org

cron-job.org
Operator and family: cron-job.org Kind: fetcher Block: no Status: active

cron-job.org is an automated bot from cron-job.org.