Google Scholar

Safe Block: Depends Verified robots.txt: No

Google Scholar uses a bot to crawl and index scholarly literature from academic publishers, repositories, and university websites. This populates its academic search engine.

Key facts

Operator
Google
Family
Google
Purpose
Search
User-Agent
Googlebot-IA/
Should you block it?
Depends
Verified
Yes
Respects robots.txt
No
Identity type
Official Documented
Confidence
High
Last verified
2026-04-01

Bot details

Identity

User-Agent
Googlebot-IA/
robots.txt token
Googlebot-IA/
HTTP user-agent
Googlebot-IA/2.1

Ownership

Operator
Google
Family
Google
Type
Search
Purpose
Search

Verification and trust

Source type
Official
Confidence
High
Last verified
2026-04-01
Verification
Listed by Cloudflare Radar as a verified bot; match the published robots.txt token and user-agent pattern. Cross-check the operator documentation linked in the source field when available.

Blocking and detection

Robots

User-agent: Googlebot-IA/
Disallow: /

Cloudflare

(http.user_agent contains "Googlebot-IA/")
Advanced server rules

Apache

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Googlebot\-IA\/ [NC]
RewriteRule ^ - [F,L]

Nginx

if ($http_user_agent ~* "Googlebot-IA/") { return 403; }

Notes

Google Scholar is a verified bot listed by Cloudflare Radar. Category: Search Engine Crawler. Operator: Google. Google Scholar uses a bot to crawl and index scholarly literature from academic publishers, repositories, and university websites. This populates its academic search engine. Cloudflare Radar page: https://radar.cloudflare.com/bots/directory/google-scholar

Evidence and source

  • Listed by Cloudflare Radar as a verified bot; match the published robots.txt token and user-agent pattern. Cross-check the operator documentation linked in the source field when available.