Applebot is listed in the Botcrawl directory as a search crawler from Apple. The primary identifier for log review is Applebot.
Identification
- User-agent pattern:
Applebot - Family: Apple
- Type: Search
- Kind: Crawler
Common use
Search indexing, content discovery, rendering, or search-result freshness checks.
Verification and handling
Verify reverse DNS in the applebot.apple.com domain or match IPs against Apple's Applebot CIDR JSON.
Directory guidance marks the risk level as Safe and the blocking decision as Depends. Do not rely on the user-agent string alone because user-agent strings can be copied or spoofed.
Robots.txt handling: Yes.
Identification
Verification And Behavior
Common Use
Search indexing, content discovery, rendering, or search-result freshness checks.
Detection Notes
Match `Applebot` as a case-insensitive substring in HTTP user-agent logs. Review bot_aliases for alternate names or product labels. Use bot_http_agent for full user-agent examples when the client sends a longer browser-like string. Do not treat a user-agent match alone as proof of identity for allow-listing.
Rules And Blocking Notes
User-agent: Applebot Disallow: /