Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
search neutral 1

Agency Analytics Crawler

aa/1.0
Operator and family: Agency Analytics Kind: crawler Block: depends Status: active

A web crawler by Agency Analytics that allows their clients to check their own sites for SEO.

ecommerce safe 1

AfterShip Magento 2 Connector

AfterShip Magento-2 Connector
Operator and family: AfterShip Kind: fetcher Block: no Status: active

AfterShip Magento 2 Connector is a commerce-related fetcher from AfterShip used for commerce, checkout, advertising, or payment-related checks.

webhook safe 1

Adyen

Adyen
Operator and family: Adyen Kind: webhook Block: no Status: active

The Adyen webhooks integration sends HTTP requests to inform web servers about payment-related events.

monitoring neutral 1

Advailo Kuma

Advailo Kuma
Operator and family: Advailo Kind: monitor Block: depends Status: active

The Advailo Kuma uptime monitor is used to monitor webpage availability and performance.

search neutral 1

AdsTxtCrawler

InteractiveAdvertisingBureau
Operator and family: OneTag Limited Kind: crawler Block: depends Status: active

OneTag is required to crawl ads.txt files from our publishers to verify the presence of the onetag.com line.

search safe 1

adsnaver

adsnaver
Operator and family: Naver Kind: crawler Block: depends Status: active

adsnaver is a search crawler from Naver used for search indexing, page discovery, or content rendering.

search safe 1

AdsBot-Google-Mobile

AdsBot-Google-Mobile
Operator and family: Google Kind: crawler Block: depends Status: active

AdsBot-Google-Mobile is a search crawler from Google used for search indexing, page discovery, or content rendering.

search neutral 1

AddThis

AddThis
Operator and family: AddThis Kind: crawler Block: depends Status: active

The AddThis bot crawls websites to gather and update content for its website marketing tools. These tools include features like social sharing buttons and content recommendation…

search neutral 1

AddSearchBot

AddSearchBot
Operator and family: Addsearch Kind: crawler Block: depends Status: active

As AddSearch adds content from your site to the search, the AddSearch bot gets counted as traffic by most analytics software.

monitoring safe 1

Adagio Bot

Adagiobot
Operator and family: Adagio Kind: monitor Block: no Status: active

Adagio Bot is a monitoring bot from Adagio used to check website availability, performance, or page health.

security safe 1

ActiveComply Bot

ActiveComply
Operator and family: ActiveComply Kind: scanner Block: no Status: active

ActiveComply Bot is a crawler for a service that monitors social media for regulatory compliance. It scans for specific keywords and content for businesses in regulated…