Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.
FullStoryBot
Safe
FullStory is your digital experience analytics platform for on-the-fly funnels, pixel-perfect replay, custom events, heat maps, advanced search, Dev Tools, and more. FullStoryBot’s fetches.
Funnelback
Safe
Funnelback is an enterprise search platform, and its crawler indexes content from an organization's websites and data repositories. This powers the organization's internal search function.
Gatus
Safe
Gatus is a monitoring bot from Gatus used to check website availability, performance, or page health.
geedoproductsearchbot
Safe
GeedoProductSearchBot is a commerce-related fetcher from Geedo used for commerce, checkout, advertising, or payment-related checks.
gemini-deep-research
Safe
Gemini Deep Research is a search crawler from Google used for search indexing, page discovery, or content rendering.
Ghost Inspector
Safe
Ghost Inspector is an automated browser testing framework.
Gigabot
Safe
Gigablast is the only non-Big Tech search engine in the U.S. that uses its own search index and algorithms.
github-camo
Safe
GitHub Camo is a preview bot associated with GitHub, used for GitHub's image proxy service.
github-hookshot
Safe
GitHub Hookshot is a webhook callback service from GitHub used for service notifications, callbacks, or integration events.
google-admob-reward-verification
Safe
Google AdMob Reward Verification is a webhook callback service from Google used for service notifications, callbacks, or integration events.
Google-Ads-Creatives-Assistant
Neutral
User-triggered content retrieval for Google Ads creative generation.
AdsBot-Google
Neutral
Google AdsBot is special-case crawler that monitors websites where Google Ads are served.
Mediapartners-Google
Neutral
The Google AdSense bot monitors the content of websites using Google AdSense.
APIs-Google
Safe
APIs-Google is the user agent used by Google APIs to deliver push notification messages. Application developers can request these notifications to avoid the need for continually polling.
Google-BusinessLinkVerification
Neutral
Verifies that Business Profile links are reachable, relevant, and return valid responses.
Google-Calendar-Importer
Safe
Google Calendar fetcher for syncing URL-based calendar feeds.
GoogleAssociationService
Neutral
The Digital Asset Links bot verifies statements lists made by website operators.
google-docs
Safe
Fetches images and page content when users insert links into Google Docs.
google.com/feedfetcher
Safe
Google FeedFetcher is the RSS reader for Google.
Google-Firebase
Neutral
Google Firebase is a crawler used for scraping, SEO analysis, or data collection from Google.
GoogleImageProxy
Neutral
The Google Image Proxy bot is used to render link content sent via email in Gmail.
Googlebot-Image
Safe
The Google Images bot is the search engine crawler for Google Images Search.
Google-InspectionTool
Safe
Google-InspectionTool is the crawler used by Search testing tools such as the Rich Result Test and URL inspection in Search Console. Apart from the user agent and user agent token, it.
Google-PageRenderer
Neutral
Tools and product functions where the end user triggers a fetch.