Bot Directory

Public records for crawlers, AI agents, scrapers, scanners, and user-agent patterns.

AI Crawlers Search Bots Scrapers Scanners
Need live control?

Classify traffic and enforce rules before content is served.

Try Edge Free Open Edge BotDB
998 bots
link-cli Neutral

Link CLI

Link CLI is an AI crawler from Link used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Operator: Link Family: Link CLI Type: Ai Purpose: Payment Agent
Verified robots.txt: Unknown Block: Depends Signed Agent
View Record Open in Edge BotDB
LinkTiger Safe

Link Tiger

Link Tiger is a search crawler from LinkTiger, Inc. used for search indexing, URL discovery, page rendering, result freshness.

Operator: LinkTiger, Inc. Family: Inc. Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Link Valet Neutral

Link Valet

Link Valet is a validator bot used for markup validation, accessibility testing, structured-data review.

Operator and family: Link Valet Type: Validator Purpose: Validation And Testing
Verified robots.txt: Unknown Block: Allow Documented
View Record Open in Edge BotDB
LinkCheck by Siteimprove Neutral

LinkCheck

LinkCheck is a monitoring bot from SiteImprove used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: SiteImprove Type: Monitoring
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
linkchecker.pro Neutral

LinkChecker Bot

LinkChecker Bot is a monitoring bot from LinkChecker used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: LinkChecker Type: Monitoring
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
Linkdexbot Caution

LinkdexBot

LinkdexBot is an SEO crawler from Linkdex used for SEO analysis, crawl diagnostics, backlink discovery, technical audit work.

Operator and family: Linkdex Type: Seo Crawler Purpose: Seo Link Analysis
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
LinkedInBot Neutral

LinkedInBot

LinkedInBot is a link preview bot from LinkedIn used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: LinkedIn Type: Preview
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
LinkpadBot Caution

LinkpadBot

LinkpadBot is an SEO crawler from Linkpad used for SEO analysis, crawl diagnostics, backlink discovery, technical audit work.

Operator and family: Linkpad Type: Seo Crawler Purpose: Backlink Analysis
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
LinksIndexerBot Neutral

LinksIndexerBot

LinksIndexerBot is a search crawler from Links Indexer used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Links Indexer Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
LinkupBot Neutral

LinkupBot

LinkupBot is an AI search crawler from Linkup used for AI search indexing, answer retrieval, citation discovery.

Operator and family: Linkup Type: Ai Purpose: Ai Search
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
Lipperhey Caution

Lipperhey

Lipperhey is an SEO crawler used for SEO analysis, crawl diagnostics, backlink discovery, technical audit work.

Operator and family: Lipperhey Type: Seo Crawler Purpose: Seo Analysis
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
LiveLapBot Neutral

LiveLapBot

LiveLapBot is a monitoring bot from LiveLap used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: LiveLap Type: Monitoring Purpose: Site Monitoring
Not verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
LogicMonitor SiteMonitor/ Safe

logicmonitor

logicmonitor is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: LogicMonitor Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
LongURL API Neutral

LongURL API

LongURL API is a link preview bot from LongURL used for link unfurling, rich-card generation, social previews, messaging previews.

Operator and family: LongURL Type: Link Preview Bot Purpose: Link Preview Fetching
Verified robots.txt: Unknown Block: Allow Documented
View Record Open in Edge BotDB
LoomlyBot Neutral

Loomly Bot

Loomly Bot is a web scraper from Loomly used for public web data collection, page extraction, content monitoring.

Operator and family: Loomly Type: Scraper Purpose: Scraping
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
ltx71 Caution

ltx71

ltx71 is a crawler framework used for ltx71 is used for ltx71 is a crawler user-agent token observed in bot detection lists and server logs.

Operator and family: ltx71 Type: Crawler Purpose: General Web Crawling
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
Macrobondbot Safe

Macrobondbot

Macrobondbot is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Macrobondbot Type: Search Purpose: Indexing
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
MagiBot Safe

MagiBot

MagiBot is a search crawler from Peak Labs used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Peak Labs Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
Magnet.me-web/ Neutral

MagnetmeBot

MagnetmeBot is a search crawler from Magnet.me used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Magnet.me Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
MailChimp Caution

MailChimp

MailChimp is a marketing crawler used for advertising quality review, contextual classification, brand-safety checks.

Operator and family: Mailchimp Type: Marketing Crawler Purpose: Marketing Intelligence
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
Mail.RU_Bot Neutral

MailRUBot

MailRUBot is a web scraper from Mail Russia used for public web data collection, page extraction, content monitoring.

Operator and family: Mail Russia Type: Scraper Purpose: Scraping
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
MainWP Safe

MainWP

MainWP is a monitoring bot from Direct Support / Website Managed used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Direct Support / Website Managed Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
Make/production Safe

Make Platform

Make Platform is a webhook callback from Make used for webhook delivery, payment notifications, service callbacks.

Operator and family: Make Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
ManageWP Safe

ManageWP

ManageWP is a webhook callback used for webhook delivery, payment notifications, service callbacks.

Operator and family: ManageWP Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB