Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
User-Agent Lookup API
search neutral 1

Agency Analytics Crawler

aa/1.0
Operator and family: Agency Analytics Kind: crawler Block: depends Status: active

A web crawler by Agency Analytics that allows their clients to check their own sites for SEO.

View Record
ecommerce safe 1

AfterShip Magento 2 Connector

AfterShip Magento-2 Connector
Operator and family: AfterShip Kind: fetcher Block: no Status: active

AfterShip Magento 2 Connector is a commerce-related fetcher from AfterShip used for commerce, checkout, advertising, or payment-related checks.

View Record
webhook safe 1

Adyen

Adyen
Operator and family: Adyen Kind: webhook Block: no Status: active

The Adyen webhooks integration sends HTTP requests to inform web servers about payment-related events.

View Record
monitoring neutral 1

Advailo Kuma

Advailo Kuma
Operator and family: Advailo Kind: monitor Block: depends Status: active

The Advailo Kuma uptime monitor is used to monitor webpage availability and performance.

View Record
search neutral 1

AdsTxtCrawler

InteractiveAdvertisingBureau
Operator and family: OneTag Limited Kind: crawler Block: depends Status: active

OneTag is required to crawl ads.txt files from our publishers to verify the presence of the onetag.com line.

View Record
search safe 1

adsnaver

adsnaver
Operator and family: Naver Kind: crawler Block: depends Status: active

adsnaver is a search crawler from Naver used for search indexing, page discovery, or content rendering.

View Record
search safe 1

AdsBot-Google-Mobile

AdsBot-Google-Mobile
Operator and family: Google Kind: crawler Block: depends Status: active

AdsBot-Google-Mobile is a search crawler from Google used for search indexing, page discovery, or content rendering.

View Record
search neutral 1

AddThis

AddThis
Operator and family: AddThis Kind: crawler Block: depends Status: active

The AddThis bot crawls websites to gather and update content for its website marketing tools. These tools include features like social sharing buttons and content recommendation…

View Record
search neutral 1

AddSearchBot

AddSearchBot
Operator and family: Addsearch Kind: crawler Block: depends Status: active

As AddSearch adds content from your site to the search, the AddSearch bot gets counted as traffic by most analytics software.

View Record
monitoring safe 1

Adagio Bot

Adagiobot
Operator and family: Adagio Kind: monitor Block: no Status: active

Adagio Bot is a monitoring bot from Adagio used to check website availability, performance, or page health.

View Record
security safe 1

ActiveComply Bot

ActiveComply
Operator and family: ActiveComply Kind: scanner Block: no Status: active

ActiveComply Bot is a crawler for a service that monitors social media for regulatory compliance. It scans for specific keywords and content for businesses in regulated…

View Record