Google-CloudVertexBot

Safe Block: Depends Verified robots.txt: Yes

Google crawler used on a site owner's request when building Vertex AI Agents.

Key facts

Operator: Google
Family: Google
Purpose: Site Owner Fetch
User-Agent: Google-CloudVertexBot
Should you block it?: Depends
Verified: Yes
Respects robots.txt: Yes
Identity type: Official Documented
Confidence: High
Last verified: 2026-04-01
Last checked: 2026-04-01

Bot details

Identity

User-Agent: Google-CloudVertexBot
robots.txt token: Google-CloudVertexBot
HTTP user-agent: Google-CloudVertexBot
Aliases: CloudVertexBot; Vertex AI crawler

Ownership

Operator: Google
Family: Google
Type: Ai
Purpose: Site Owner Fetch

Verification and trust

Source type: Official
Confidence: High
Last verified: 2026-04-01
Last checked: 2026-04-01
Verification: Use Google's official crawler verification guidance because user-agent strings can be spoofed.
Operator URL: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
Source URL: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers

Blocking and detection

Robots

User-agent: Google-CloudVertexBot
Disallow: /

Cloudflare

(http.user_agent contains "Google-CloudVertexBot")

Advanced server rules

Apache

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Google\-CloudVertexBot [NC]
RewriteRule ^ - [F,L]

Nginx

if ($http_user_agent ~* "Google-CloudVertexBot") { return 403; }

Notes

Google-CloudVertexBot is used for crawls requested by site owners for building Vertex AI Agents. Google says it has no effect on Google Search or other products.

This is a site-owner initiated crawl class with its own robots token.

Evidence and source

Use Google's official crawler verification guidance because user-agent strings can be spoofed.

https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers