Bot Directory

Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.

660 bots
YandexWebmaster Safe

YandexWebmaster

YandexWebmaster is a search crawler from Yandex used for search indexing, page discovery, or content rendering.

Operator and family: Yandex Type: Search Purpose: Indexing
Verified robots.txt: Yes Block: Depends Official Documented
Yeti Safe

Yeti

Yeti is the web crawler for Naver, a South Korean search engine. It indexes websites to provide search results and power other services on the Naver platform.

Operator and family: Naver Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
YextBot Neutral

Yext Inc

The Yext Crawler provides Yext customers with a tool to retrieve data from their own websites.

Operator and family: Yext Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
ygs-scraper-bot Neutral

YGS Group Falconer Scraper

A content based scraper only for partners we collaborate with who have given permission to have their website scraped.

Operator: YGS Group Family: YGS Group Falconer Scraper Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
YokoyGroupAG Safe

Yokoy Group Webhooks

Yokoy is a spend management SAAS solution. Webhooks generate requests to book expenses or invoices to customer's ERP system whenever the processing and approval process has been completed.

Operator and family: Yokoy Group AG Type: Webhook
Verified robots.txt: No Block: No Verified Bot
YouBot Safe

YouBot

YouBot is a search crawler associated with You.com, used for search indexing and content discovery.

Operator: You.com Family: YouBot Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
Zapier Safe

Zapier

Zapier is a webhook callback service from Zapier Inc. used for service notifications, callbacks, or integration events.

Operator and family: Zapier Inc. Type: Webhook
Verified robots.txt: No Block: No Verified Bot
Zendesk Webhook Safe

Zendesk Webhook

Webhooks for development of Zendesk ticketing system and apps.

Operator and family: Zendesk Type: Webhook
Verified robots.txt: No Block: No Verified Bot
ZipchatBot Neutral

ZipchatBot

AI assistant for e-commerce stores. Only crawls sites upon request from the site owner.

Operator: Zipchat Inc Family: Zipchat Type: Ecommerce
Verified robots.txt: No Block: Depends Verified Bot
ZoominfoBot Safe

ZoomInfo

Zoominfobot is an indexing robot for a web search engine, similar to Google. Created by Zoom Information Inc.(www.zoominfo.com), Zoominfobot’s patented technology continually scans millions.

Operator and family: ZoomInfo Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
ZumBot Safe

ZumBot

ZumBot is a web crawler that indexes webpages for Zum Open Internet Search.

Operator and family: Zum Internet Corp Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
Zvelo Safe

Zvelo

Zvelo is a monitoring bot from Zvelo used to check website availability, performance, or page health.

Operator and family: Zvelo Type: Monitoring
Verified robots.txt: No Block: No Verified Bot