Bot Directory

scraping@nytimes.com Neutral

New York Times Newsgathering

New York Times Newsgathering is a web scraper from The New York Times used for public web data collection, page extraction, content monitoring.

Operator and family: The New York Times Type: Scraper Purpose: Scraping

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

NewRelicPinger Neutral

NewRelicPinger

NewRelicPinger is a monitoring bot from New Relic used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: New Relic Type: Monitoring Bot Purpose: Uptime And Performance Monitoring

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

news-please Neutral

news-please

news-please is a crawler framework used for news-please is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator and family: news-please Type: Crawler Framework Purpose: News Extraction

Not verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

newsai Neutral

newsai

newsai is an AI search crawler used for AI search indexing, answer retrieval, citation discovery.

Operator and family: newsai Type: Ai Purpose: Ai Search

Not verified robots.txt: Unknown Block: Depends Observed

View Record Open in Edge BotDB

NewsBank Neutral

NewsBank

NewsBank is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: NewsBank Type: Search Purpose: Indexing

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

NewsBlur Safe

NewsBlur

NewsBlur is a feed fetcher used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: NewsBlur Type: Feed Purpose: Feed Fetch

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

NewsNow Safe

NewsNow

NewsNow is a search crawler from NewsNowUK used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: NewsNowUK Type: Search Purpose: Indexing

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

Nitro- Neutral

NitroBot

NitroBot is a webhook callback from NitroPack Ltd used for webhook delivery, payment notifications, service callbacks.

Operator and family: NitroPack Ltd Type: Webhook

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

NIXStatsbot/1.1 Safe

NixStatsMonitoringBot

NixStatsMonitoringBot is a monitoring bot from NixStats used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: NixStats Type: Monitoring

Verified robots.txt: No Block: No Verified Bot

View Record Open in Edge BotDB

Nmap Scripting Engine High

Nmap Scripting Engine

Nmap Scripting Engine is a security scanner from Nmap Project used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Nmap Project Type: Security Scanner Purpose: Security Scanning

Verified robots.txt: Unknown Block: Block Documented

View Record Open in Edge BotDB

NodePing Safe

Nodeping

Nodeping is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Nodeping Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

Noibu Safe

Noibu JS Beautifier

Noibu JS Beautifier is a monitoring bot from Noibu used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Noibu Type: Monitoring

Verified robots.txt: Unknown Block: No Verified Bot

View Record Open in Edge BotDB

noorobot Neutral

Noorobot

Noorobot is a search crawler from Noor Digital Agency AB used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Noor Digital Agency AB Type: Search Purpose: Indexing

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

Nooshub Safe

Nooshub

Nooshub is a feed fetcher used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Nooshub Type: Feed Purpose: Feed Fetch

Verified robots.txt: No Block: Depends Verified Bot

View Record Open in Edge BotDB

Norton-Safeweb Caution

Norton Safe Web

Norton Safe Web is a security scanner from NortonLifeLock / Gen Digital used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: NortonLifeLock / Gen Digital Type: Security Scanner Purpose: Security Scanning

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

NostoCrawlerBot Neutral

NostoCrawlerBot

NostoCrawlerBot is a search crawler from Nosto used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Nosto Type: Search Purpose: Indexing

Verified robots.txt: No Block: Depends Verified Bot

View Record Open in Edge BotDB

Nostra Neutral

Nostra

Nostra is a web scraper used for public web data collection, page extraction, content monitoring.

Operator and family: Nostra Type: Scraper Purpose: Scraping

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

Notabot Safe

Notabot

Notabot is a search crawler from Helpfeel used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Helpfeel Type: Search Purpose: Indexing

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

NotionAutomation Safe

Notion Automation

Notion Automation is a webhook callback from Notion used for webhook delivery, payment notifications, service callbacks.

Operator and family: Notion Type: Webhook

Not verified robots.txt: Unknown Block: No Observed

View Record Open in Edge BotDB

NotionEmbedder Neutral

NotionEmbedder

NotionEmbedder is a link preview bot from Notion used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: Notion Type: Link Preview Bot Purpose: Link Preview Fetching

Verified robots.txt: Unknown Block: Allow Documented

View Record Open in Edge BotDB

NovaAct Neutral

NovaAct

NovaAct is an AI crawler from Amazon used for assistant-driven browsing, page retrieval.

Operator and family: Amazon Type: Ai Purpose: Ai Assistant

Verified robots.txt: Yes Block: Depends Observed

View Record Open in Edge BotDB

Novellum Neutral

Novellum AI Crawl

Novellum AI Crawl is a search crawler from Novellum used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Novellum Type: Search Purpose: Indexing

Verified robots.txt: Unknown Block: Depends Verified Bot

View Record Open in Edge BotDB

Nuclei Caution

Nuclei

Nuclei is a security scanner from ProjectDiscovery used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: ProjectDiscovery Type: Vulnerability Scanner Purpose: Vulnerability Scanning

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

Nutch Neutral

Nutch

Nutch is a search crawler from Apache Nutch used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Apache Nutch Type: Search Purpose: Indexing

Verified robots.txt: Yes Block: Depends Official Documented

View Record Open in Edge BotDB