Overview
Googlebot Discovery is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is Googlebot-Discovery.
Googlebot Discovery is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Googlebot Discovery is marked as respecting robots.txt directives for crawler access control.
Googlebot Discovery should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent Pattern
-
Googlebot-Discovery - Aliases
- googlebot-discovery
- HTTP Agent Examples
-
Googlebot-Discovery - Robots Token
- Googlebot-Discovery
- Identity Type
- Observed
- Evidence Method
- Treat `Googlebot-Discovery` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- Search engine crawler
- Kind
- Search engine crawler
- Family
- Purpose
- Discovery crawling
Behavior and handling
- Common Use
- Googlebot Discovery is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- Googlebot Discovery traffic is primarily detected by the `Googlebot-Discovery` user-agent pattern. Compare source IPs, reverse DNS, request paths, and crawl cadence with Google infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Googlebot Discovery has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: Googlebot-Discovery Disallow: /
Relationships
- Operator
- Google Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.