Botcrawl Edge

Control AI Bots, Scrapers, and Crawlers

Botcrawl Edge shows crawler, AI bot, scraper, and scanner traffic in real time with BotDB intelligence, then lets you allow, block, rate-limit, or log traffic from one dashboard.

Real-Time Monitoring

Watch crawler, scraper, scanner, and AI bot traffic as it hits your connected sites.

BotDB Intelligence

Classify traffic with BotDB intelligence built for crawlers, AI agents, SEO tools, scanners, and spam bots.

Rules & Enforcement

Allow trusted bots and block, rate-limit, or log unwanted automation by user-agent, IP, country, or type.

Bot Directory

Browse all bots →
wave-streaming-platform-2 Neutral

WAVE Streaming Platform

WAVE Streaming Platform is an AI crawler used for assistant-driven browsing, page retrieval.

Operator and family: WAVE Streaming Platform Type: Ai Purpose: AI Browser
Verified robots.txt: Unknown Block: Depends Signed Agent
visually-io-shopify-editor Neutral

Visually.io Shopify Editor

Visually.io Shopify Editor is an AI crawler from Visually.io used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Visually.io Family: Visually.io Shopify Editor Type: Ai Purpose: Shopify Editor
Verified robots.txt: Unknown Block: Depends Signed Agent
ventus-agent Neutral

Ventus Agent

Ventus Agent is an AI crawler used for assistant-driven browsing, page retrieval.

Operator and family: Ventus Agent Type: Ai Purpose: AI Browser
Verified robots.txt: Unknown Block: Depends Signed Agent
payhawk-invoice-fetching-bot Neutral

Payhawk Invoice Fetching Agent

Payhawk Invoice Fetching Agent is an AI crawler from Payhawk used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Payhawk Family: Payhawk Invoice Fetching Agent Type: Ai Purpose: Invoice Fetching
Verified robots.txt: Unknown Block: Depends Signed Agent
link-cli Neutral

Link CLI

Link CLI is an AI crawler from Link used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Link Family: Link CLI Type: Ai Purpose: Payment Agent
Verified robots.txt: Unknown Block: Depends Signed Agent
drift-agent Neutral

Drift Agent

Drift Agent is an AI crawler from Drift Security used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Drift Security Family: Drift Agent Type: Ai Purpose: Security Automation
Verified robots.txt: Unknown Block: Depends Signed Agent

Start Monitoring Bot Traffic

Connect a site, see every classified event, and create rules to allow trusted bots while blocking or limiting unwanted traffic.