Bot Directory

Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.

637 bots
2checkout Safe

2checkout

2Checkout Payment Platform's webhooks integration for notifying websites about payment events. Now operated by Verifone.

2checkout 2checkout Webhook Webhook
Verified robots.txt: No Block: No Verified Bot
monitoring360 Safe

360Monitoring

360Monitoring is a monitoring bot from 360Monitoring used to check website availability, performance, or page health.

360Monitoring 360Monitoring Monitoring Monitoring
robots.txt: No Block: No Observed
AccessibleWebBot Safe

Accessible Web Bot

Accessible Web Bot crawls customer websites to discover pages and monitor for accessibility violations on a regular basis. Crawls are initiated for Accessible Web's "Page Monitoring" SaaS.

Accessible Web Accessible Web Monitoring Monitoring
Verified robots.txt: No Block: No Verified Bot
AccessStatus Safe

AccessStatus

AccessStatus is a bot that checks the HTTP status code of a web page. It is used to determine if a URL is active, redirected, or returning an error.

AccessStatus AccessStatus Monitoring Monitoring
Verified robots.txt: No Block: No Verified Bot
ActiveComply Safe

ActiveComply Bot

ActiveComply Bot is a crawler for a service that monitors social media for regulatory compliance. It scans for specific keywords and content for businesses in regulated industries.

ActiveComply ActiveComply Security Security
Verified robots.txt: No Block: No Verified Bot
Adagiobot Safe

Adagio Bot

Adagio Bot is a monitoring bot from Adagio used to check website availability, performance, or page health.

Adagio Adagio Monitoring Monitoring
Verified robots.txt: No Block: No Verified Bot
AddSearchBot Neutral

AddSearchBot

As AddSearch adds content from your site to the search, the AddSearch bot gets counted as traffic by most analytics software.

Addsearch Addsearch Search Indexing
Verified robots.txt: No Block: Depends Verified Bot
AddThis Neutral

AddThis

The AddThis bot crawls websites to gather and update content for its website marketing tools. These tools include features like social sharing buttons and content recommendation widgets.

AddThis AddThis Search Indexing
Verified robots.txt: No Block: Depends Verified Bot
AdsBot-Google-Mobile Safe

AdsBot-Google-Mobile

AdsBot-Google-Mobile is a search crawler from Google used for search indexing, page discovery, or content rendering.

Google Google Search Indexing
Verified robots.txt: No Block: Depends Official Documented
adsnaver Safe

adsnaver

adsnaver is a search crawler from Naver used for search indexing, page discovery, or content rendering.

Naver Naver Search Indexing
Verified robots.txt: No Block: Depends Verified Bot
InteractiveAdvertisingBureau Neutral

AdsTxtCrawler

OneTag is required to crawl ads.txt files from our publishers to verify the presence of the onetag.com line.

OneTag Limited OneTag Limited Search Indexing
Verified robots.txt: No Block: Depends Verified Bot
Advailo Kuma Neutral

Advailo Kuma

The Advailo Kuma uptime monitor is used to monitor webpage availability and performance.

Advailo Advailo Monitoring Monitoring
Verified robots.txt: No Block: Depends Verified Bot