Reverse proxy, WordPress plugin, and JavaScript snippet.
Features
Real-time analytics and controls for bots, datacenters, human visitors, IP addresses, requests, geography, rules, reports, APIs, and webhooks.
Botcrawl Edge Platform
Monitor every request. Classify every source. Control what reaches your site.
Botcrawl Edge is traffic intelligence for the modern web: automated traffic analytics, datacenter analytics, human visitor analytics, IP investigation, live monitoring, and rules that can allow, block, rate-limit, or log traffic before it becomes noise.
Known crawlers, scrapers, AI agents, fake bots, and documented user-agents.
Bulk controls for AI training, AI search, and assistant-driven crawlers.
Long-range visibility for bots, datacenters, humans, IPs, geography, and actions.
Analytics
Bots, datacenters, and humans in one dashboard.
Overview
Automated
Humans
Traffic & Geo
Reports
Across all connected sites
Detected and classified
Country and provider context
Stopped by rules
Traffic TimelineBots · Datacenters · Humans
Traffic CompositionAutomated + human
- Bots
- 33.6K
- Datacenters
- 130.0K
- Humans
- 22.0K
- Fake Bots
- 43.6K
Capabilities
Built for traffic intelligence and enforcement.
Every feature connects back to one job: understand who is visiting your site, where they are coming from, what they are requesting, and what action should happen next.
Monitor
Live Traffic Feed
Watch requests across every connected site as they happen. Filter by bot, datacenter, human visitor, country, request path, rule action, or traffic type.
- Real-time request stream
- Allowed, logged, blocked, and rate-limited events
- Bot, datacenter, and human segmentation
Monitor
Interactive Globe Monitor
See bot clusters, datacenter origin regions, and human visitor distribution on a live 3D globe built for security monitoring.
- Live location signals
- Bot/datacenter/human color separation
- Global traffic at a glance
Analyze
Bot Analytics
Measure crawler behavior, AI crawler volume, fake bot activity, verified bot traffic, risk levels, actions, and top user-agent patterns.
- AI crawlers, scrapers, search bots, scanners, monitors
- Verified versus fake bot breakdowns
- Traffic timeline and action charts
Analyze
Datacenter Analytics
Identify cloud, VPS, hosting, proxy, and infrastructure-origin traffic by provider, ASN, country, network, path pattern, and behavior.
- Provider and ASN intelligence
- Country and region summaries
- Cloud traffic classification
Analyze
Human Visitor Analytics
Track confirmed human visits, pageviews, unique visitors, languages, top pages, traffic sources, device data, and visitor paths when the JavaScript snippet is installed.
- Human pageviews and unique IPs
- Top pages and entry paths
- Device/session enrichment with snippet tracking
Investigate
IP Explorer
Open any IP address to inspect its full activity trail: requests, first seen, last seen, action history, paths, method, location, and classification.
- Per-IP page trail
- Request method and path history
- All-time and selected-period activity
Control
Rules Engine
Allow, block, rate-limit, or log traffic by user-agent, IP address, IP range, country, bot type, datacenter provider, or traffic class.
- User-agent, IP, country, and CIDR rules
- Bot type and datacenter provider rules
- Block, allow, rate-limit, or log actions
Control
AI Crawler Control
Set one rule for all tracked AI crawlers or tune individual crawlers by name, operator, user-agent, risk, or category.
- Block all AI crawlers
- Rate-limit, log, or allow all
- Robots.txt directives for crawlers that honor them
Connect
Three Connection Methods
Connect with reverse proxy enforcement, the WordPress plugin, or a JavaScript snippet. Use one method or combine layers for richer traffic data.
- Reverse proxy for pre-origin enforcement
- WordPress plugin for server-side classification
- JavaScript snippet for human analytics enrichment
Report
Exportable Reports
Generate styled reports across sites, time ranges, traffic classes, top countries, IPs, bots, datacenters, rule actions, and visitor activity.
- 1d, 7d, 14d, 30d, 90d, 365d, and custom ranges
- Charts, tables, and composition summaries
- Agency-ready reporting views
Develop
REST API and Webhooks
Classify user-agents, pull event data, list sites, read rules, query BotDB, and receive signed HTTP POST notifications when bot events occur.
- API keys for programmatic access
- Signed webhook payloads
- Developer access to traffic and classification data
Support
Priority Support
Commercial support for high-traffic sites, agencies, and teams that need help with rules, classification, integrations, and incident review.
- Technical tickets
- Integration guidance
- Enterprise and custom plan support
Rules Engine
Control bots, datacenters, and humans with one rule system.
Create precise rules by user-agent, IP address, IP range, country, bot type, datacenter provider, and traffic class. Use allow, block, rate-limit, or log actions to protect content without losing visibility.
allowblockrate-limitlog
User-Agent
IP Address
IP Range
Country
Bot Type
Datacenter Provider
Traffic Type
AI Crawlers