GoogleOther-Video
GoogleOther video fetcher optimized for publicly accessible video URLs.
Google Pinpoint fetcher that requests URLs users specify as sources for Pinpoint collections.
Fetches user-supplied source URLs for Google Pinpoint collections.
Officially documented in Google’s user-triggered fetchers list.
User-agent: Google-Pinpoint
Disallow: /
(http.user_agent contains "Google-Pinpoint")
RewriteCond %{HTTP_USER_AGENT} Google-Pinpoint [NC]
RewriteRule .* - [F,L]
if ($http_user_agent ~* "Google-Pinpoint") { return 403; }
Google-Pinpoint is a user-triggered Google fetcher that requests individual URLs users added as sources for Pinpoint research collections.
https://developers.google.com/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers
GoogleOther video fetcher optimized for publicly accessible video URLs.
Google user-triggered agent used by Google-hosted agents to navigate the web on a user’s request.
Google Messages fetcher used to generate link previews for URLs sent in chat messages.
GoogleOther image fetcher optimized for publicly accessible image URLs.
Google News robots.txt token used to control crawling preferences for Google News.
Chrome Web Store fetcher that requests URLs developers provide in extension and theme metadata.
Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digi...
Google-Adwords-Instant is a bot connected to the Google Ads platform. It visits advertiser landing pages to perform verification and quality checks.
Proxies user actions on Yandex services, including online translation and button-click responses.
Yandex Calendar robot that downloads calendar files by user request.
Automate complex operations end-to-end.
Crawler receives individual links at the user's initiative to support certain product features.
