Bot Directory

Public records for crawlers, AI agents, scrapers, scanners, and user-agent patterns.

AI Crawlers Search Bots Scrapers Scanners
Need live control?

Classify traffic and enforce rules before content is served.

OAI-AdsBot Neutral

OAI-AdsBot

OAI-AdsBot is a security scanner from OpenAI used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: OpenAI Type: Security
Verified robots.txt: Depends Block: Depends Official Documented
OAI-SearchBot Safe

OAI-SearchBot

OAI-SearchBot is an AI search crawler from OpenAI used for AI search indexing, answer retrieval, citation discovery.

Operator and family: OpenAI Type: Ai Purpose: Ai Search
Verified robots.txt: Yes Block: Depends Official Documented
ohdear.app Safe

Oh Dear

Oh Dear is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Oh Dear Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
OKX-dolphin-crawler Neutral

OKX-dolphin-crawler

OKX-dolphin-crawler is a search crawler from OKX used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: OKX Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
omgili Neutral

Omgili Bot

Omgili Bot is a web scraper from Webz.io / Omgili used for search indexing, URL discovery, page rendering, result freshness.

Operator: Webz.io / Omgili Family: Omgili Type: Scraper Purpose: Web Data Indexing
Verified robots.txt: Yes Block: Depends Verified Bot
Omnisend Safe

Omnisend

Omnisend is an ecommerce crawler used for product discovery, catalog checks, marketplace crawling, price monitoring.

Operator and family: Omnisend Type: Ecommerce
Verified robots.txt: Unknown Block: No Verified Bot
OnCrawl Mobile/1.0 Safe

OnCrawl

OnCrawl is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Oncrawl Type: Search Purpose: Indexing
Verified robots.txt: Yes Block: Depends Verified Bot
OneTrust Safe

Onetrust CMP Scanner

Onetrust CMP Scanner is a monitoring bot from OneTrust, LLC. used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator: OneTrust, LLC. Family: LLC. Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
online-webceo-bot Neutral

Online Webceo Bot

Online Webceo Bot is a web scraper from Online Webceo used for public web data collection, page extraction, content monitoring.

Operator and family: Online Webceo Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
OnlineOrNot Safe

OnlineOrNot Monitor

OnlineOrNot Monitor is a monitoring bot from OnlineOrNot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: OnlineOrNot Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
opencode Neutral

opencode

opencode is an AI crawler used for assistant-driven browsing, page retrieval.

Operator and family: opencode Type: Ai Purpose: Ai Assistant
Not verified robots.txt: Unknown Block: Depends Observed
OpenGraph.io/ Neutral

Opengraph Bot

Opengraph Bot is a web scraper from Opengraph used for public web data collection, page extraction, content monitoring.

Operator and family: Opengraph Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
OpenLinkProfiler Caution

OpenLinkProfiler

OpenLinkProfiler is an SEO crawler used for SEO analysis, crawl diagnostics, backlink discovery, technical audit work.

Operator and family: OpenLinkProfiler Type: Seo Crawler Purpose: Backlink Analysis
Verified robots.txt: Unknown Block: Monitor Documented
OpenRSS Safe

OpenRSS

OpenRSS is a feed fetcher used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: OpenRSS Type: Feed Purpose: Feed Fetch
Verified robots.txt: Unknown Block: Depends Verified Bot
OpenVAS Caution

OpenVAS

OpenVAS is a security scanner from Greenbone / OpenVAS used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Greenbone / OpenVAS Type: Vulnerability Scanner Purpose: Vulnerability Scanning
Verified robots.txt: Unknown Block: Monitor Documented
Orlo-LinkPreview Neutral

Orlo Link Preview

Orlo Link Preview is a link preview bot from Orlo used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: Orlo Type: Preview
Verified robots.txt: Unknown Block: Depends Verified Bot
Oseox Neutral

Oseox

Oseox is an SEO crawler used for SEO analysis, crawl diagnostics, backlink discovery, technical audit work.

Operator and family: Oseox Type: Seo Purpose: Seo Crawling
Not verified robots.txt: Yes Block: Depends Documented
Cozi-iCalendar-FeedReader Safe

OurFamilyWizard

OurFamilyWizard is a feed fetcher used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: OurFamilyWizard Type: Feed Purpose: Feed Fetch
Verified robots.txt: Unknown Block: Depends Verified Bot
outbrain Neutral

Outbrain

Outbrain is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Outbrain Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
OutsellURLValidator Safe

OutsellURLValidator

OutsellURLValidator is a monitoring bot from Outsell Corporation used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Outsell Corporation Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
Overcast/1.0 Podcast Sync Safe

Overcast

Overcast is a feed fetcher from Overcast Radio used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Overcast Radio Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
OdklBot Neutral

Ozon Web Grabber

Ozon Web Grabber is a web scraper from Ozon used for public web data collection, page extraction, content monitoring.

Operator and family: Ozon Type: Scraper Purpose: Scraping
Verified robots.txt: Unknown Block: Depends Verified Bot
Paddle Safe

Paddle Webhooks

Paddle Webhooks is a webhook callback from Paddle used for webhook delivery, payment notifications, service callbacks.

Operator: Paddle Family: Paddle Webhooks Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
PRTGCloudBot Safe

PaesslerCloudBot

PaesslerCloudBot is a monitoring bot from Paessler used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Paessler Type: Monitoring
Verified robots.txt: No Block: No Verified Bot