ProjectShield Url Check
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digital attackā¦
APIs-Google is the user agent used by Google APIs to deliver push notification messages. Application developers can request these notifications to avoid the need for continually polling Google's servers to find out if the resources they are interested in have changed. To make sure nobody abuses this service, Google requires developers to prove that they own the domain before allowing them to register a URL with a domain as the location where they want to receive messages.
User-agent: APIs-Google
Disallow: /
(http.user_agent contains "APIs-Google")
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} APIs\-Google [NC]
RewriteRule ^ - [F,L]
if ($http_user_agent ~* "APIs-Google") { return 403; }
Application developers can request these notifications to avoid the need for continually polling Google’s servers to find out if the resources they are interested in have changed. To make sure nobody abuses this service, Google requires developers to prove that they own the domain before allowing them to register a URL with a domain as the location where they want to receive messages.
Known user-agent patterns: APIs-Google Known user-agent strings: APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html) Robots.txt handling in the directory: no.
Operator documentation: https://support.google.com/webmasters/answer/1061943?hl=en
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digital attackā¦
Google Messages link-preview fetcher.
Generic Google crawler for public-content fetches outside core Search.
GoogleOther-Image is GoogleOther optimized for fetching publicly accessible image URLs.
GoogleOther-Video is GoogleOther optimized for fetching publicly accessible video URLs.
Google crawler used on owner request for Vertex AI Agents.
Google control token for Gemini training and grounding permissions.
Google AdSense uses a crawler called Google-Display-Ads-Bot to verify your site when you add a site to AdSense.
