Overview
Google API is an AI training crawler from Google used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
Its primary user-agent pattern is APIs-Google; related patterns include Google API push notification agent; a representative HTTP user-agent is APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html).
Google API is verified with High confidence. The identity type is Verified Bot, and the evidence basis is official operator documentation.
Google API has context-dependent robots.txt behavior because some requests may be user-triggered, product-triggered, or handled differently by the operator.
Google API can usually be allowed after confirming the source and monitoring request volume.
Identity
- User-Agent Pattern
-
APIs-Google - Aliases
- Google API push notification agent
- HTTP Agent Examples
-
APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html) - Robots Token
- APIs-Google
- Identity Type
- Verified bot
- Evidence Method
- Verify Google API by matching `APIs-Google` to Google evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- AI
- Kind
- Crawler
- Family
- Purpose
- AI training
Behavior and handling
- Common Use
- Google API is used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
- Detection Notes
- Google API traffic is primarily detected by the `APIs-Google` user-agent pattern; related patterns include `Google API push notification agent`; a representative HTTP user-agent is `APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html)`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Google infrastructure before trusting the traffic.
- Respects robots.txt
- Depends
- Spoofing Risk
- Google API has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Safe
- Recommended Handling
- Do not block
Rules and controls
- Robots.txt Snippet
-
# This rule may not apply to user-triggered or special-purpose requests. User-agent: APIs-Google Disallow: /
Relationships
- Operator
- Google Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.