Bot Directory

Search the public Botcrawl bot directory by name, operator, type, or user-agent.

AI Crawlers Search Bots Scrapers Scanners
Need live enforcement?

Classify traffic and apply rules before content is served.

Try Edge Free Open Edge BotDB
998 bots
QualifiedBot Neutral

QualifiedBot

QualifiedBot is a search crawler from Qualified.com, Inc. used for search indexing, URL discovery, page rendering, result freshness.

Operator: Qualified.com, Inc. Family: Inc. Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
cf-qualys-scanner Safe

Qualys

Qualys is a monitoring bot used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Qualys Type: Security
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
SSL Labs Safe

Qualys SSL Scanner

Qualys SSL Scanner is a monitoring bot from Qualys used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Qualys Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Quantcastbot Neutral

Quantcastbot

Quantcastbot is a search crawler from Quantcast used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Quantcast Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
Quartr Crawler Neutral

Quartr Crawler

Quartr Crawler is a search crawler from Quartr used for search indexing, URL discovery, page rendering, result freshness.

Operator: Quartr Family: Quartr Crawler Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
QueritBot Neutral

QueritBot

QueritBot is an AI search crawler from Querit used for AI search indexing, answer retrieval, citation discovery.

Operator and family: Querit Type: Ai Purpose: Ai Search
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
QuillBot Neutral

QuillBot

QuillBot is an AI crawler used for assistant-driven browsing, page retrieval.

Operator and family: QuillBot Type: Ai Purpose: Ai Assistant
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
Quora-Bot Neutral

Quora Bot

Quora Bot is a link preview bot from Quora used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: Quora Type: Page Preview Purpose: Link Preview Fetching
Not verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
Qwantbot Safe

Qwantbot

Qwantbot is a search crawler from Qwant used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Qwant Type: Search Purpose: Indexing
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
Qwantbot-news Safe

Qwantbot-news

Qwantbot-news is a search crawler from Qwant used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Qwant Type: Search
Verified robots.txt: Yes Block: Depends Official Documented
View Record Open in Edge BotDB
Qwantify Caution

Qwantify

Qwantify is a marketing crawler used for advertising quality review, contextual classification, brand-safety checks.

Operator and family: Qwantify Type: Marketing Crawler Purpose: Marketing Site Analysis
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
Rackspace Monitoring Safe

Rackspace

Rackspace is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Rackspace Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
Radian6 Caution

Radian6

Radian6 is a marketing crawler from Salesforce / Radian6 used for advertising quality review, contextual classification, brand-safety checks.

Operator and family: Salesforce / Radian6 Type: Marketing Crawler Purpose: Marketing Intelligence
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
rakutenusabot-image Neutral

Rakuten Image extraction bot

Rakuten Image extraction bot is a web scraper from Rakuten used for public web data collection, page extraction, content monitoring.

Operator and family: Rakuten Type: Scraper Purpose: Scraping
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
Razorpay Safe

Razorpay Webhook

Razorpay Webhook is a webhook callback from Razorpay used for webhook delivery, payment notifications, service callbacks.

Operator and family: Razorpay Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Readability Caution

Readability

Readability is a web scraper used for public web data collection, page extraction, content monitoring.

Operator and family: Readability Type: Content Crawler Purpose: Content Discovery
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
Readable Safe

Readable

Readable is a monitoring bot from Added Bytes Ltd used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Added Bytes Ltd Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Recurly Webhook Safe

Recurly Webhooks

Recurly Webhooks is a webhook callback from Recurly used for webhook delivery, payment notifications, service callbacks.

Operator and family: Recurly Type: Webhook
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
RedactusWebClassifier Neutral

Redactus Web Classifier

Redactus Web Classifier is a security scanner from Redactus used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Redactus Type: Security
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
redditbot Neutral

redditbot

redditbot is a link preview bot from Reddit used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: Reddit Type: Preview
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
redirect-pizza Safe

Redirect Pizza Destination Monitor

Redirect Pizza Destination Monitor is a monitoring bot from redirect.pizza used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: redirect.pizza Type: Monitoring
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
Reelevant Neutral

Reelevant

Reelevant is a web scraper used for public web data collection, page extraction, content monitoring.

Operator and family: Reelevant Type: Scraper Purpose: Scraping
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
Retool Neutral

Retool

Retool is an ecommerce crawler used for product discovery, catalog checks, marketplace crawling, price monitoring.

Operator and family: Retool Type: Ecommerce
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
RetroListeCOM Safe

RetroListeCOM

RetroListeCOM is a monitoring bot from Niclas Papst used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Niclas Papst Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB