GoogleOther-Video
GoogleOther video fetcher optimized for publicly accessible video URLs.
Google Messages fetcher used to generate link previews for URLs sent in chat messages.
Generates link previews for URLs sent in Google Messages.
Officially documented in Google’s user-triggered fetchers list.
User-agent: GoogleMessages
Disallow: /
(http.user_agent contains "GoogleMessages")
RewriteCond %{HTTP_USER_AGENT} GoogleMessages [NC]
RewriteRule .* - [F,L]
if ($http_user_agent ~* "GoogleMessages") { return 403; }
Google Messages is a user-triggered Google fetcher that requests URLs in order to generate previews in Google Messages chats.
https://developers.google.com/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers
GoogleOther video fetcher optimized for publicly accessible video URLs.
Chrome Web Store fetcher that requests URLs developers provide in extension and theme metadata.
Google News robots.txt token used to control crawling preferences for Google News.
Google user-triggered agent used by Google-hosted agents to navigate the web on a user’s request.
GoogleOther image fetcher optimized for publicly accessible image URLs.
Google Pinpoint fetcher that requests URLs users specify as sources for Pinpoint collections.
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digi...
Google-Adwords-Instant is a bot connected to the Google Ads platform. It visits advertiser landing pages to perform verification and quality checks.
