Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.
contxbot
Neutral
Amazon uses a crawler, also known as a spider or a bot to process and index the content of webpages. The Amazon crawler visits your site to determine its content in order to provide.
amazon-kendra-
Neutral
Amazon Kendra is a highly accurate intelligent search service that enables your users to search unstructured data using natural language. It returns specific answers to questions, giving.
amazon-QBusiness
Safe
Amazon Q Business uses a web crawler to index authorized websites for enterprise search and assistant features.
amazon-route-53-health-check-service
Safe
Amazon Route 53 Health Check Service is a monitoring bot from Amazon used to check website availability, performance, or page health.
Amazonbot
Neutral
Amazonbot is Amazon's web crawler used to improve our services, such as enabling Alexa to answer even more questions for customers. Amazonbot is a polite crawler that respects standard.
Amzn-SearchBot
Safe
Amzn-SearchBot is a search crawler from Amazon used for search indexing, page discovery, or content rendering.
Amzn-User
Neutral
Amzn-User is an AI fetcher from Amazon used for AI-related crawling, retrieval, search, or assistant activity.
Anchor Browser
Neutral
Anchor Browser is an AI agent from Anchor used for AI-related crawling, retrieval, search, or assistant activity.
ApifyWebsiteContentCrawler
Neutral
Website content crawling and extraction for AI applications.
AppcastParsingBot
Neutral
Scrapes client job postings for Appcast services.
AASA-Bot
Neutral
The Apple App Site Association is used to support "Universal Links" that can open in native iOS apps. The bot requests a specific path for a given hostname, which returns metadata that.
iTMS
Neutral
Fetches URLs associated with registered Apple Podcasts content.