Google

Browse bots in this family.

Confidence: High

GoogleOther-Video

GoogleOther video fetcher optimized for publicly accessible video URLs.

Google Google Scraper Crawler GoogleOther-Video
Verified robots.txt: Yes Neutral Block: Depends
Confidence: High

Google-Agent

Google user-triggered agent used by Google-hosted agents to navigate the web on a user’s request.

Google Google Ai Agent User Triggered Google-Agent
Verified robots.txt: No Neutral Block: Depends
Confidence: High

Google Messages

Google Messages fetcher used to generate link previews for URLs sent in chat messages.

Google Google Unknown Fetcher GoogleMessages
Verified robots.txt: No Safe Block: Depends
Confidence: High

Google Pinpoint

Google Pinpoint fetcher that requests URLs users specify as sources for Pinpoint collections.

Google Google Unknown Fetcher User Triggered Google-Pinpoint
Verified robots.txt: No Safe Block: Depends
Confidence: High

GoogleOther-Image

GoogleOther image fetcher optimized for publicly accessible image URLs.

Google Google Scraper Crawler GoogleOther-Image
Verified robots.txt: Yes Neutral Block: Depends
Confidence: High

Google Chrome Web Store

Chrome Web Store fetcher that requests URLs developers provide in extension and theme metadata.

Google Google Unknown Fetcher Google-CWS
Verified robots.txt: No Safe Block: Depends
Confidence: High

Googlebot-News

Google News robots.txt token used to control crawling preferences for Google News.

Google Google Search Crawler Googlebot-News
Verified robots.txt: Yes Safe Block: Depends
Official Confidence: High Official Documented

ProjectShield Url Check

Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digi...

Google Google Security Monitor Site Owner Fetch ProjectShield-UrlCheck
Verified robots.txt: No Safe Block: Depends
Official Confidence: High Official Documented

Google Image Proxy

The Google Image Proxy bot is used to render link content sent via email in Gmail.

Google Google Scraper Crawler General Crawl GoogleImageProxy
Verified robots.txt: No Safe Block: Depends
Official Confidence: High Official Documented

Google-AdWords-Express

Google-AdWords-Express is a bot for a Google Ads product aimed at small businesses. It crawls advertiser websites to assist with ad creation and to verify si...

Google Google Search Fetcher Site Owner Fetch Google-AdWords-Express
Verified robots.txt: No Safe Block: Depends
Official Confidence: High Official Documented

Google-Adwords-Instant

Google-Adwords-Instant is a bot connected to the Google Ads platform. It visits advertiser landing pages to perform verification and quality checks.

Google Google Search Fetcher Site Owner Fetch Google-Adwords-Instant
Verified robots.txt: No Safe Block: Depends
Official Confidence: High Official Documented

Google Scholar

Google Scholar uses a bot to crawl and index scholarly literature from academic publishers, repositories, and university websites. This populates its academi...

Google Google Search Crawler Search Googlebot-IA/
Verified robots.txt: No Safe Block: Depends