AmazonBuyForMe
Neutral
Amazon Buy For Me
Amazon Buy For Me is a commerce-related fetcher from Amazon used for commerce, checkout, advertising, or payment-related checks.
Verified robots.txt: No Block: Depends Verified Bot
Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.
AmazonBuyForMe
Neutral
Amazon Buy For Me is a commerce-related fetcher from Amazon used for commerce, checkout, advertising, or payment-related checks.
contxbot
Neutral
Amazon uses a crawler, also known as a spider or a bot to process and index the content of webpages. The Amazon crawler visits your site to determine its content in order to provide.
amazon-kendra-
Neutral
Amazon Kendra is a highly accurate intelligent search service that enables your users to search unstructured data using natural language. It returns specific answers to questions, giving.
amazon-QBusiness
Safe
Amazon Q Business uses a web crawler to index authorized websites for enterprise search and assistant features.
amazon-route-53-health-check-service
Safe
Amazon Route 53 Health Check Service is a monitoring bot from Amazon used to check website availability, performance, or page health.
Amazonbot
Neutral
Amazonbot is Amazon's web crawler used to improve our services, such as enabling Alexa to answer even more questions for customers. Amazonbot is a polite crawler that respects standard.
Amzn-SearchBot
Safe
Amzn-SearchBot is a search crawler from Amazon used for search indexing, page discovery, or content rendering.
Amzn-User
Neutral
Amzn-User is an AI fetcher from Amazon used for AI-related crawling, retrieval, search, or assistant activity.
Anchor Browser
Neutral
Anchor Browser is an AI agent from Anchor used for AI-related crawling, retrieval, search, or assistant activity.
ApifyWebsiteContentCrawler
Neutral
Website content crawling and extraction for AI applications.
AppcastParsingBot
Neutral
Scrapes client job postings for Appcast services.
AASA-Bot
Neutral
The Apple App Site Association is used to support "Universal Links" that can open in native iOS apps. The bot requests a specific path for a given hostname, which returns metadata that.
iTMS
Neutral
Fetches URLs associated with registered Apple Podcasts content.
Applebot
Safe
Applebot data is used to power various features, such as the search technology that is integrated into many user experiences in Appleʼs ecosystem including Spotlight, Siri, and Safari.
Applebot-Extended
Safe
Applebot-Extended is an AI control token from Apple used for AI-related crawling, retrieval, search, or assistant activity.
A360-Search
Safe
Area 360 is a search crawler from Area360 used for search indexing, page discovery, or content rendering.
Arquivo-web-crawler
Neutral
Arquivo Web Crawler is a feed retrieval bot from Arquivo used to retrieve feeds, subscriptions, podcasts, or syndicated content.
artemis-web-crawler
Safe
Artemis Web Crawler is a feed retrieval bot from Artemis used to retrieve feeds, subscriptions, podcasts, or syndicated content.
artemis web reader/
Safe
Artemis Web Reader is a search crawler from capjamesg used for search indexing, page discovery, or content rendering.
atlassian-jira-webhooks
Safe
Atlassian Jira Webhooks is a webhook callback service from Atlassian used for service notifications, callbacks, or integration events.
rovo
Safe
Atlassian Rovo is a search crawler from Atlassian used for search indexing, page discovery, or content rendering.
atlassian-bot
Neutral
Atlassian-bot is a crawler for custom 3P websites that indexes data for rovo search.
Attracta
Neutral
The Attracta bot is analyzes user website content as part of Attracta's SEO services.
Audisto Crawler
Safe
Audisto Crawler fetches all accessible URLs of a website. Audisto provides a service to audit and monitor websites for its customers. More information about the crawler is available here.