Bot intelligence record
Googlebot Discovery
Review firstGooglebot Discovery is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness; it appears in server logs as `Googlebot-Discovery`.
User-Agent Pattern
GoogleGooglebot-Discovery
User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.
Robots.txt Snippet
Click snippet to copyUser-agent: Googlebot-Discovery
Disallow: /Click the snippet to copy it, or highlight the text manually.
Handling Guidance
DependsUse this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.
Googlebot Discovery is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Record Details
Structured data- Operator
- Family
- Purpose
- Discovery Crawling
- Identity type
- Documented
- Confidence
- High
- Last verified
- 2026-06-23
- Last checked
- 2026-06-23
- Source type
- Official
- Verification
- Verify Googlebot Discovery by matching `Googlebot-Discovery` to Google evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
- Spoofing risk
- Googlebot Discovery has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
Notes
- Googlebot Discovery is a search crawler from Google used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Its primary user-agent pattern is
Googlebot-Discovery. - Googlebot Discovery is verified with High confidence. The identity type is Documented, and the evidence basis is official operator documentation.
- Googlebot Discovery is marked as respecting robots.txt directives for crawler access control.
- Googlebot Discovery should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Evidence and Source
- Verify Googlebot Discovery by matching `Googlebot-Discovery` to Google evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
- Googlebot Discovery traffic is primarily detected by the `Googlebot-Discovery` user-agent pattern. Compare source IPs, reverse DNS, request paths, and crawl cadence with Google infrastructure before trusting the traffic.
- Googlebot Discovery is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Googlebot Discovery has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
Monitor This Bot In Edge
Botcrawl EdgeUse Botcrawl Edge to see matching traffic, create allow or block rules, and control this bot across connected sites.