Search
Verified: Yes
Google-Pinpoint
Google-Pinpoint is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness.
Google-Pinpoint
Monitor and block bot traffic in real time.
Ai
Verified: Yes
GoogleAgent URLContext
GoogleAgent URLContext is an AI crawler from Google used for assistant-driven browsing, page retrieval.
GoogleAgent-URLContext
Search
Verified: Yes
Googlebot
Googlebot is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness.
Googlebot
Search Engine Crawler
Verified: Yes
Googlebot Discovery
Googlebot Discovery is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness.
Googlebot-Discovery
Control Token
Verified: Yes
Googlebot-News
Googlebot-News is a robots.txt control token for Google News crawling preferences. Google documents that it has no standalone HTTP request User-Agent string.
Content Crawler
Verified: Yes
GoogleDocs
GoogleDocs is a web scraper from Google used for public web data collection, page extraction, content monitoring.
GoogleDocs
Preview
Verified: Yes
GoogleMessages
GoogleMessages is a link preview bot from Google used for link unfurling, rich-card generation, social previews, messaging previews.
GoogleMessages
Search
Verified: Yes
GoogleOther
GoogleOther is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness.
GoogleOther
Ai
Verified: Yes
GoogleOther-Image
GoogleOther-Image is an AI training crawler from Google used for AI model training, dataset discovery.
GoogleOther-Image
Ai
Verified: Yes
GoogleOther-Video
GoogleOther-Video is an AI training crawler from Google used for AI model training, dataset discovery.
GoogleOther-Video
Security
Verified: Yes
ProjectShield Url Check
ProjectShield Url Check is a monitoring bot from Google used for security scanning, malware checks, vulnerability assessment, certificate review.
ProjectShield-UrlCheck