Google

Browse bots in this family.

AdsBot-Google-Mobile Safe

AdsBot-Google-Mobile

AdsBot-Google-Mobile is a search crawler from Google used for search indexing, page discovery, or content rendering.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Official Documented
chrome-privacy-preserving-prefetch-proxy Safe

Chrome Privacy Preserving Prefetch Proxy

Chrome Privacy Preserving Prefetch Proxy is a preview or prefetch bot from Google used to fetch pages for previews, unfurls, or user-triggered rendering.

Operator and family: Google Type: Preview
Verified robots.txt: Unknown Block: Depends Verified Bot
Chrome-Lighthouse Neutral

Chrome-Lighthouse

Chrome-Lighthouse is an automated, open-source tool for auditing web page quality and does not operate as a traditional web crawler. It runs a series of audits against a given page to.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
FeedFetcher-Google Safe

FeedFetcher-Google

FeedFetcher-Google is a feed retrieval bot from Google used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Official Documented
gemini-deep-research Safe

Gemini Deep Research

Gemini Deep Research is a search crawler from Google used for search indexing, page discovery, or content rendering.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
google-admob-reward-verification Safe

Google AdMob Reward Verification

Google AdMob Reward Verification is a webhook callback service from Google used for service notifications, callbacks, or integration events.

Operator and family: Google Type: Webhook
Verified robots.txt: No Block: No Verified Bot
Google-Ads-Creatives-Assistant Neutral

Google Ads Creatives Assistant

User-triggered content retrieval for Google Ads creative generation.

Operator and family: Google Type: Ai Purpose: Ai Assistant
Verified robots.txt: Unknown Block: Depends Verified Bot
AdsBot-Google Neutral

Google AdsBot

Google AdsBot is special-case crawler that monitors websites where Google Ads are served.

Operator and family: Google Type: Monitoring
Verified robots.txt: No Block: Depends Verified Bot
Mediapartners-Google Neutral

Google Adsense: Mediapartners-Google

The Google AdSense bot monitors the content of websites using Google AdSense.

Operator and family: Google Type: Monitoring
Verified robots.txt: Yes Block: Depends Verified Bot
APIs-Google Safe

Google API

APIs-Google is the user agent used by Google APIs to deliver push notification messages. Application developers can request these notifications to avoid the need for continually polling.

Operator and family: Google Type: Ai Purpose: Ai Training
Verified robots.txt: No Block: No Verified Bot
Google-BusinessLinkVerification Neutral

Google Business Link Verification

Verifies that Business Profile links are reachable, relevant, and return valid responses.

Operator and family: Google Type: Security
Verified robots.txt: No Block: Depends Official Documented
Google-Calendar-Importer Safe

Google Calendar Importer

Google Calendar fetcher for syncing URL-based calendar feeds.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: No Official Documented
GoogleAssociationService Neutral

Google Digital Asset Links

The Digital Asset Links bot verifies statements lists made by website operators.

Operator and family: Google Type: Preview
Not verified robots.txt: No Block: Depends Observed
google-docs Safe

Google Docs

Fetches images and page content when users insert links into Google Docs.

Operator and family: Google Type: Preview
Verified robots.txt: Unknown Block: Depends Verified Bot
google.com/feedfetcher Safe

Google Feed Fetcher

Google FeedFetcher is the RSS reader for Google.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Google-Firebase Neutral

Google Firebase

Google Firebase is a crawler used for scraping, SEO analysis, or data collection from Google.

Operator and family: Google Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
GoogleImageProxy Neutral

Google Image Proxy

The Google Image Proxy bot is used to render link content sent via email in Gmail.

Operator and family: Google Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
Googlebot-Image Safe

Google Images

The Google Images bot is the search engine crawler for Google Images Search.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
Google-InspectionTool Safe

Google Inspection Tool

Google-InspectionTool is the crawler used by Search testing tools such as the Rich Result Test and URL inspection in Search Console. Apart from the user agent and user agent token, it.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: No Block: No Verified Bot
Google-PageRenderer Neutral

Google Page Renderer

Tools and product functions where the end user triggers a fetch.

Operator and family: Google Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
GoogleProducer Safe

Google Publisher Center

Fetches and processes feeds that publishers explicitly supplied for use in Google News landing pages.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Google-Read-Aloud Safe

Google Read Aloud

Google Read Aloud service enables reading web pages using text-to-speech (TTS).

Operator and family: Google Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
Google-Safety Safe

Google Safety

The Google-Safety user agent handles abuse-specific crawling, such as malware discovery for publicly posted links on Google properties.

Operator and family: Google Type: Security
Verified robots.txt: No Block: No Verified Bot
Google-Structured-Data-Testing Safe

Google Schema Markup Testing Tool

The Google Schema Markup Testing Tool bot, now part of the Rich Results Test, crawls pages to validate their structured data. This helps webmasters check if their schema markup is correctly.

Operator and family: Google Type: Search Purpose: Indexing
Verified robots.txt: No Block: No Verified Bot