Google-Agent
Google user-triggered agent used by Google-hosted agents to navigate the web on a user’s request.
GoogleOther video fetcher optimized for publicly accessible video URLs.
Fetches publicly accessible video URLs for GoogleOther workflows.
Officially documented in Google’s common crawler list.
User-agent: GoogleOther-Video
Disallow: /
(http.user_agent contains "GoogleOther-Video")
RewriteCond %{HTTP_USER_AGENT} GoogleOther-Video [NC]
RewriteRule .* - [F,L]
if ($http_user_agent ~* "GoogleOther-Video") { return 403; }
GoogleOther-Video is the video-oriented variant of GoogleOther, used for fetching publicly accessible video URLs for internal Google uses that do not affect Google Search or other products.
https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
Google user-triggered agent used by Google-hosted agents to navigate the web on a user’s request.
Google Messages fetcher used to generate link previews for URLs sent in chat messages.
Google Pinpoint fetcher that requests URLs users specify as sources for Pinpoint collections.
GoogleOther image fetcher optimized for publicly accessible image URLs.
Google News robots.txt token used to control crawling preferences for Google News.
Chrome Web Store fetcher that requests URLs developers provide in extension and theme metadata.
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digi...
Google-Adwords-Instant is a bot connected to the Google Ads platform. It visits advertiser landing pages to perform verification and quality checks.
