Overview
Google StoreBot is an ecommerce crawler from Google used for product discovery, catalog checks, marketplace crawling, price monitoring, and merchant data review.
Its primary user-agent pattern is Storebot-Google; related patterns include Google Shopping crawler.
Google StoreBot is verified with High confidence. The identity type is Verified Bot, and the evidence basis is official operator documentation.
Google StoreBot has context-dependent robots.txt behavior because some requests may be user-triggered, product-triggered, or handled differently by the operator.
Google StoreBot should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent Pattern
-
Storebot-Google - Aliases
- Google Shopping crawler
- HTTP Agent Examples
-
Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36 Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Mobile Safari/537.36 - Robots Token
- Storebot-Google
- Identity Type
- Verified bot
- Evidence Method
- Verify Google StoreBot by matching `Storebot-Google` to Google evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- Ecommerce
- Kind
- Fetcher
- Family
- Purpose
- Ecommerce
Behavior and handling
- Common Use
- Google StoreBot is used for product discovery, catalog checks, marketplace crawling, price monitoring, and merchant data review.
- Detection Notes
- Google StoreBot traffic is primarily detected by the `Storebot-Google` user-agent pattern; related patterns include `Google Shopping crawler`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Google infrastructure before trusting the traffic.
- Respects robots.txt
- Depends
- Spoofing Risk
- Google StoreBot has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
# This rule may not apply to user-triggered or special-purpose requests. User-agent: Storebot-Google Disallow: /
Relationships
- Operator
- Google Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.