Google

Browse bots in this family.

AdsBot-Google-Mobile Safe

AdsBot-Google-Mobile

AdsBot-Google-Mobile is a search crawler from Google used for search indexing, page discovery, or content rendering.

Google Google Search Indexing
Verified robots.txt: No Block: Depends Official Documented
chrome-privacy-preserving-prefetch-proxy Safe

Chrome Privacy Preserving Prefetch Proxy

Chrome Privacy Preserving Prefetch Proxy is a preview or prefetch bot from Google used to fetch pages for previews, unfurls, or user-triggered rendering.

Google Google Preview Preview
Verified robots.txt: Unknown Block: Depends Verified Bot
Chrome-Lighthouse Neutral

Chrome-Lighthouse

Chrome-Lighthouse is an automated, open-source tool for auditing web page quality and does not operate as a traditional web crawler. It runs a series of audits against a given page to.

Google Google Search Indexing
Verified robots.txt: No Block: Depends Verified Bot
FeedFetcher-Google Safe

FeedFetcher-Google

FeedFetcher-Google is a feed retrieval bot from Google used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Google Google Feed Feed Fetch
Verified robots.txt: No Block: Depends Official Documented
gemini-deep-research Safe

Gemini Deep Research

Gemini Deep Research is a search crawler from Google used for search indexing, page discovery, or content rendering.

Google Google Search Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
google-admob-reward-verification Safe

Google AdMob Reward Verification

Google AdMob Reward Verification is a webhook callback service from Google used for service notifications, callbacks, or integration events.

Google Google Webhook Webhook
Verified robots.txt: No Block: No Verified Bot
Google-Ads-Creatives-Assistant Neutral

Google Ads Creatives Assistant

User-triggered content retrieval for Google Ads creative generation.

Google Google Ai Ai Assistant
Verified robots.txt: Unknown Block: Depends Verified Bot
AdsBot-Google Neutral

Google AdsBot

Google AdsBot is special-case crawler that monitors websites where Google Ads are served.

Google Google Monitoring Monitoring
Verified robots.txt: No Block: Depends Verified Bot
Mediapartners-Google Neutral

Google Adsense: Mediapartners-Google

The Google AdSense bot monitors the content of websites using Google AdSense.

Google Google Monitoring Monitoring
Verified robots.txt: Yes Block: Depends Verified Bot
APIs-Google Safe

Google API

APIs-Google is the user agent used by Google APIs to deliver push notification messages. Application developers can request these notifications to avoid the need for continually polling.

Google Google Ai Ai Training
Verified robots.txt: No Block: No Verified Bot
Google-BusinessLinkVerification Neutral

Google Business Link Verification

Verifies that Business Profile links are reachable, relevant, and return valid responses.

Google Google Security Security
Verified robots.txt: No Block: Depends Official Documented
GoogleAssociationService Neutral

Google Digital Asset Links

The Digital Asset Links bot verifies statements lists made by website operators.

Google Google Preview Preview
robots.txt: No Block: Depends Observed