Bot Intelligence

Bot Directory

Search bots, crawlers, AI agents, scrapers, scanners, preview bots, search bots, and user-agent patterns.

AI Crawlers Scrapers Search Bots Security Scanners
640 bot records Directory records are structured for lookup, filtering, logs, and API use.
User-Agent Lookup API
search safe 1

Baiduspider

Baiduspider
Operator and family: Baidu Kind: crawler Block: depends Status: active

Baiduspider is the search engine crawler for the search engine Baidu.

View Record
search safe

Baidu ADS Server Proxy

Baidu-ADS
Operator and family: Baidu Kind: crawler Block: depends Status: active

Baidu ADS Server Proxy is a search crawler from Baidu used for search indexing, page discovery, or content rendering.

View Record
feed neutral 1

AwarioSmartBot

Awario
Operator and family: Awario Kind: fetcher Block: depends Status: active

AwarioSmartBot is a web crawlers sent by Awario to discover and collect new and updated web data (that is further used by Internet marketers from all…

View Record
monitoring safe 1

Automaton

AutomatonHeadlessChrome
Operator and family: Automaton Kind: monitor Block: no Status: active

Automaton is a monitoring bot from Automaton used to check website availability, performance, or page health.

View Record
feed neutral 1

Authory

Authory
Operator and family: Authory Kind: fetcher Block: depends Status: active

The Authory bot visits websites to back up articles on behalf of journalists and other writers who use the service.

View Record
monitoring safe 1

Audisto Crawler

Audisto Crawler
Operator and family: Audisto Kind: monitor Block: no Status: active

Audisto Crawler fetches all accessible URLs of a website. Audisto provides a service to audit and monitor websites for its customers. More information about the crawler…

View Record
scraper neutral 1

Attracta

Attracta
Operator and family: Attracta Kind: crawler Block: depends Status: active

The Attracta bot is analyzes user website content as part of Attracta's SEO services.

View Record
search neutral 1

atlassian-bot

atlassian-bot
Operator: Atlassian · Family: atlassian-bot Kind: crawler Block: depends Status: active

Atlassian-bot is a crawler for custom 3P websites that indexes data for rovo search.

View Record
search safe 1

Atlassian Rovo

rovo
Operator and family: Atlassian Kind: crawler Block: depends Status: active

Atlassian Rovo is a search crawler from Atlassian used for search indexing, page discovery, or content rendering.

View Record
webhook safe 1

Atlassian Jira Webhooks

atlassian-jira-webhooks
Operator and family: Atlassian Kind: webhook Block: depends Status: active

Atlassian Jira Webhooks is a webhook callback service from Atlassian used for service notifications, callbacks, or integration events.

View Record
search safe 1

Artemis Web Reader

artemis web reader/
Operator and family: capjamesg Kind: crawler Block: depends Status: active

Artemis Web Reader is a search crawler from capjamesg used for search indexing, page discovery, or content rendering.

View Record
feed safe 1

Artemis Web Crawler

artemis-web-crawler
Operator and family: Artemis Kind: fetcher Block: depends Status: active

Artemis Web Crawler is a feed retrieval bot from Artemis used to retrieve feeds, subscriptions, podcasts, or syndicated content.

View Record