Applebot-Extended
Apple control token for foundation-model training opt-out.
Fetches URLs associated with registered Apple Podcasts content.
User-agent: iTMS
Disallow: /
(http.user_agent contains "iTMS")
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} iTMS [NC]
RewriteRule ^ - [F,L]
if ($http_user_agent ~* "iTMS") { return 403; }
Known user-agent patterns: iTMS Known user-agent strings: iTMS Robots.txt handling in the directory: no.
Operator documentation: https://support.apple.com/en-us/119829
Apple control token for foundation-model training opt-out.
Apple crawler for search and related Apple features.
The Apple App Site Association is used to support "Universal Links" that can open in native iOS apps.
User-authorized website monitoring, uptime checks, diagnostics, and compliance scanning for managed sites.
Research web crawler that indexes publicly available documents. Respects robots.txt and rate limits.
Spyglasses Bot evaluates website content to identify issues that would affect visibility by AI assistants.
AI assistant for e-commerce stores. Only crawls sites upon request from the site owner.
