Kagibot
Safe
Kagi Bot
Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
Verified robots.txt: No Block: Depends Verified Bot
Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.
Kagibot
Safe
Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
kakaotalk-scrap
Neutral
The KakaoTalk scrap server collects and processes webpage data to create optimized previews for URLs.
KargoBot-Artemis
Safe
KargoBot-Artemis is Kargo's autonomous content verification bot. It's a simulation of a user on an iOS device. The bot is used to scan sites for content that may be unsuitable for customers.
netarkivindsamling
Neutral
kb.dk_bot is a search crawler from Netarkivet used for search indexing, page discovery, or content rendering.
kernel
Neutral
Kernel Browsers is an AI agent from Kernel used for AI-related crawling, retrieval, search, or assistant activity.
kinsta-bot
Safe
Our bot makes requests towards Kinsta-hosted client sites for uptime monitoring purposes as well as to confirm successful domain pointing.
Klaviyo/1.0
Neutral
The integration with Klaviyo will automatically capture information about who visits your site and views your products including details on what they viewed so you can send super personal.
KlaviyoAIBot
Neutral
Klaviyo’s web crawler for its Kai Customer Agent feature.
Known Agent
Neutral
Traffic identification and management for AI agent and bot activity.
LegalMonster
Safe
Monitor customers' sites for compliance with cookie- and other privacy-related legislation.
Leikibot
Neutral
LeikiBot, run by DoubleVerify, crawls webpages content for advertisers.
https://www.letsencrypt.org
Safe
Let's Encrypt is a security scanner from Let's Encrypt used for security checks, malware review, or abuse prevention.
Level9SearchBot
Safe
Level9SearchBot is a search crawler from Level 9 used for search indexing, page discovery, or content rendering.
https://www.loc.gov/programs/web-archiving/for-site-owners/
Neutral
The Library of Congress Web Archive manages, preserves, and provides access to archived web content selected by subject experts from across the Library, so that it will be available for.
LinerBot
Neutral
The web pages crawled by Linerbot are used to find the right sources that can generate answers to your questions.
Linespider
Safe
Linespider is a Web crawler that provides a wide range of search results for LINE services while complying with the Robots Exclusion Protocol.
LinkTiger
Safe
LinkTiger crawls customer sites and reports broken links.
LinkCheck by Siteimprove
Neutral
The Siteimprove LinkCheck crawler analyzes and monitors websites for quality assurance, SEO, and accessibility purposes, and keeps website content in line with brand guidelines and.
linkchecker.pro
Neutral
Web Crawler that monitors the backlinks profile.
LinkedInBot
Neutral
LinkedInBot is used by LinkedIn when rendering link preview information.
LinksIndexerBot
Neutral
LinksIndexerBot is an SEO bot that crawls websites to index backlinks and aggregate website summaries.
LogicMonitor SiteMonitor/
Safe
The logicmonitor bot performs synthetic monitoring checks on websites and online services to test their availability and performance.
LoomlyBot
Neutral
LoomlyBot is used to extract metadata from web pages in order to show a social media post preview within Loomly so that clients can see what their social media posts will look like when.
Macrobondbot
Safe
Macrobond implements custom web crawlers to fetch macroeconomic data published by official data sources.