ai-crawler

amazon-kendra-web-crawler Neutral

Amazon Kendra Web Crawler

Amazon Kendra Web Crawler is an AI crawler from Amazon used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Amazon Family: Amazon Kendra Type: Ai Crawler Purpose: Enterprise Search Indexing

Verified robots.txt: Yes Block: Depends Documented

View Record Open in Edge BotDB

BorderxBot Neutral

BorderxBot

BorderxBot is an AI crawler from Borderxlab / Nubestore AI used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Borderxlab / Nubestore AI Family: BorderxBot Type: Ai Crawler Purpose: Ecommerce Product Crawling

Verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

DigitalOceanGenAI-Crawler Neutral

DigitalOcean GenAI Crawler

DigitalOcean GenAI Crawler is an AI search crawler from DigitalOcean used for AI search indexing, answer retrieval, citation discovery.

Operator and family: DigitalOcean Type: Ai Crawler Purpose: Ai Search Indexing

Not verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

EchoboxBot Neutral

EchoboxBot

EchoboxBot is an AI crawler from Echobox used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator and family: Echobox Type: Ai Crawler Purpose: Publisher Content Automation

Not verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

NavuBot Neutral

NavuBot

NavuBot is an AI training crawler from HivePoint, Inc. used for AI model training, dataset discovery.

Operator: HivePoint, Inc. Family: Navu Type: Ai Crawler Purpose: Ai Training Crawling

Not verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

SelectikaScraper Neutral

SelectikaScraper

SelectikaScraper is an AI crawler from Selectika used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator and family: Selectika Type: Ai Crawler Purpose: Ai Enrichment

Not verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB

sovereign.ai Caution

Sovereign AI

Sovereign AI is an AI crawler used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator and family: Sovereign AI Type: Ai Crawler Purpose: Ai Content Discovery

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

Spawning-AI Caution

Spawning AI

Spawning AI is an AI crawler used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator and family: Spawning AI Type: Ai Crawler Purpose: Ai Content Discovery

Verified robots.txt: Unknown Block: Monitor Documented

View Record Open in Edge BotDB

TARAGroup-Intelligent-Bot Neutral

TARAGroup Intelligent Bot

TARAGroup Intelligent Bot is an AI crawler from TARAGroup used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator and family: TARAGroup Type: Ai Crawler Purpose: Intelligent Crawling

Not verified robots.txt: Unknown Block: Depends Documented

View Record Open in Edge BotDB