Overview
Google Page Renderer is a web scraper from Google used for public web data collection, page extraction, content monitoring, and third-party crawler activity.
Its primary user-agent pattern is Google-PageRenderer; related patterns include Google Web Snippet; a representative HTTP user-agent is Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36 Google-PageRenderer Google (+https://developers.google.com/+/web/snippet/).
Google Page Renderer is verified with High confidence. The identity type is Verified Bot, and the evidence basis is official operator documentation.
Google Page Renderer is marked as respecting robots.txt directives for crawler access control.
Google Page Renderer should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent
Google-PageRenderer- Aliases
- Google Web Snippet
- HTTP Agent Examples
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36 Google-PageRenderer Google (+https://developers.google.com/+/web/snippet/)- Robots.txt Token
Google-PageRenderer- Identity Type
- Verified Bot
- Evidence Method
- Verify Google Page Renderer by matching `Google-PageRenderer` to Google evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- Scraper
- Kind
- Preview
- Family
- Purpose
- scraping
Behavior and handling
- Common Use
- Google Page Renderer is used for public web data collection, page extraction, content monitoring, and third-party crawler activity.
- Detection Notes
- Google Page Renderer traffic is primarily detected by the `Google-PageRenderer` user-agent pattern; related patterns include `Google Web Snippet`; a representative HTTP user-agent is `Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36 Google-PageRenderer Google (+https://developers.google.com/+/web/snippet/)`. Compare source IPs, reverse DNS, request paths, and crawl cadence with Google infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Google Page Renderer has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
User-agent: Google-PageRenderer Disallow: /