Bot Directory

Nostra Neutral

Nostra

Nostra accelerates site speed for managed web platforms.

Operator and family: Nostra Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

Notabot Safe

Notabot

Crawler to integrate Helpfeel external search engine.

Operator and family: Helpfeel Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

NotionAutomation Safe

Notion Automation

Notion Automation webhook delivery bot.

Operator and family: Notion Type: Webhook

Not verified robots.txt: No Block: No Observed

Novellum Neutral

Novellum AI Crawl

Novellum.ai is building out tools for building agents. This MCP tool will be used by agents to crawl sites.

Operator and family: Novellum Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

Nutch Neutral

Nutch

Nutch is a search crawler from Apache Nutch used for search indexing, page discovery, or content rendering.

Operator and family: Apache Nutch Type: Search Purpose: Indexing

Verified robots.txt: Yes Block: Depends Official Documented

OAI-AdsBot Neutral

OAI-AdsBot

OpenAI bot for validating submitted ChatGPT ad landing pages.

Operator and family: OpenAI Type: Security

Verified robots.txt: No Block: Depends Official Documented

OAI-SearchBot Safe

OAI-SearchBot

OAI-SearchBot is OpenAI’s search crawler used to surface and retrieve web content for search-related experiences.

Operator and family: OpenAI Type: Ai Purpose: Ai Search

Verified robots.txt: Yes Block: Depends Official Documented

ohdear.app Safe

Oh Dear

The Oh Dear application availability and performance monitoring checker.

Operator and family: Oh Dear Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

OKX-dolphin-crawler Neutral

OKX-dolphin-crawler

OKX Dolphin Crawler simulates visits to target web pages as part of malicious dApp scanning.

Operator and family: OKX Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

omgili Neutral

Omgili Bot

Omgili/Webz.io crawler used to index forums, comments, discussion boards, and other public web data.

Operator: Webz.io / Omgili Family: Omgili Type: Scraper Purpose: Web Data Indexing

Verified robots.txt: Yes Block: Depends Verified Bot

Omnisend Safe

Omnisend

Bot for checking omnisend integration in woocommerce shops and shopify.

Operator and family: Omnisend Type: Ecommerce

Verified robots.txt: No Block: No Verified Bot

OnCrawl Mobile/1.0 Safe

OnCrawl

OnCrawl is a search crawler from Oncrawl used for search indexing, page discovery, or content rendering.

Operator and family: Oncrawl Type: Search Purpose: Indexing

Verified robots.txt: Yes Block: Depends Verified Bot

OneTrust Safe

Onetrust CMP Scanner

Onetrust CMP Scanner is a monitoring bot from OneTrust, LLC. used to check website availability, performance, or page health.

Operator: OneTrust, LLC. Family: LLC. Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

online-webceo-bot Neutral

Online Webceo Bot

A bot associated with WebCEO, a company that provides SEO tools and services.

Operator and family: Online Webceo Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

OnlineOrNot Safe

OnlineOrNot Monitor

OnlineOrNot provides website monitoring in the form of uptime checks and page speed tests.

Operator and family: OnlineOrNot Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

OpenGraph.io/ Neutral

Opengraph Bot

Our API is used by mostly consumer facing products to preview links when sharing them on their platforms. For example, how when a link is shared on Facebook or Slack, those platforms.

Operator and family: Opengraph Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

OpenRSS Safe

OpenRSS

OpenRSS is a feed retrieval bot from OpenRSS used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: OpenRSS Type: Feed Purpose: Feed Fetch

Verified robots.txt: No Block: Depends Verified Bot

Orlo-LinkPreview Neutral

Orlo Link Preview

The Orlo Link Preview bot is used by the Orlo social media management platform. It fetches previews of links that are scheduled to be published in social media posts.

Operator and family: Orlo Type: Preview

Verified robots.txt: No Block: Depends Verified Bot

Cozi-iCalendar-FeedReader Safe

OurFamilyWizard

Users subscribe to external iCalendars and sync them into their Cozi calendars. We periodically fetch these iCals to keep them up to date.

Operator and family: OurFamilyWizard Type: Feed Purpose: Feed Fetch

Verified robots.txt: No Block: Depends Verified Bot

outbrain Neutral

Outbrain

The Outbrain crawler analyzes content on publisher websites for the purpose of serving ads.

Operator and family: Outbrain Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

OutsellURLValidator Safe

OutsellURLValidator

Validating client website URLS to monitor for hosting/provider changes.

Operator and family: Outsell Corporation Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

Overcast/1.0 Podcast Sync Safe

Overcast

Overcast is a podcast player application, and its bot fetches RSS feeds and audio files from podcast hosting servers. This keeps the podcast directory and episodes updated for its users.

Operator and family: Overcast Radio Type: Feed Purpose: Feed Fetch

Verified robots.txt: No Block: Depends Verified Bot

OdklBot Neutral

Ozon Web Grabber

A component that serves to load previews for external and internal links. For external links, whenever possible, information from the open graph tags specified on the page (title, descr.

Operator and family: Ozon Type: Scraper Purpose: Scraping

Verified robots.txt: No Block: Depends Verified Bot

Paddle Safe

Paddle Webhooks

Webhooks let you get notified when events happen in Paddle.

Operator: Paddle Family: Paddle Webhooks Type: Webhook

Verified robots.txt: No Block: No Verified Bot