ProjectShield Url Check
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digital attackā¦
AI Assistant
User-agent: gemini-deep-research
Disallow: /
(http.user_agent contains "gemini-deep-research")
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} gemini\-deep\-research [NC]
RewriteRule ^ - [F,L]
if ($http_user_agent ~* "gemini-deep-research") { return 403; }
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digital attackā¦
Google Messages link-preview fetcher.
Generic Google crawler for public-content fetches outside core Search.
GoogleOther-Image is GoogleOther optimized for fetching publicly accessible image URLs.
GoogleOther-Video is GoogleOther optimized for fetching publicly accessible video URLs.
Google AdSense uses a crawler called Google-Display-Ads-Bot to verify your site when you add a site to AdSense.
Google-CWS is the Chrome Web Store user-triggered fetcher for URLs developers provide in extension and theme metadata.
Google-hosted browsing agent triggered by user requests.
