Bot Directory

Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.

Trellis-Services Neutral

Trellis-Services

Trellis-Services is a crawler used for scraping, SEO analysis, or data collection from Mediavine.

Operator and family: Mediavine Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
trendictionbot Safe

Trendiction Bot

Talkwalker delivers the consumer insights that help brands drive business impact. In a world full of conversations, the most successful global brands have switched to Talkwalker because we.

Operator and family: Trendiction S.A. Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
Trustly Safe

Trustly

Trustly will send notifications / callbacks to merchant's system to provide updates on payment statuses.

Operator and family: Trustly Group AB Type: Webhook
Verified robots.txt: No Block: No Verified Bot
TTD-Content Neutral

TTD Content

The Trade Desk crawler classifies webpage content to allow advertisers to choose where they show ads.

Operator and family: The Trade Desk Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
Tumblr Neutral

Tumblr

On Tumblr, post authors can paste a URL in their post, and we'll "unfurl" that URL into a pretty Link "Block" for their post by making a request to the URL and parsing the response.

Operator and family: Automattic Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
Turnitin Neutral

TurnitinBot

Turnitin.com offers various services to the educational community. Most prominently, we provide a widely used and effective plagiarism detection service. Part of the plagiarism prevention.

Operator and family: Turnitin Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
TurnitinBot/ContentIngest Safe

TurnitinBot ContentIngest

TurnitinBot ContentIngest is a search crawler from Turnitin used for search indexing, page discovery, or content rendering.

Operator and family: Turnitin Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Official Documented
TwilioProxy Safe

Twilio Proxy

Twilio webhook requests triggered by Twilio when there are incoming SMSes, calls, etc.

Operator: Twilio, Inc. Family: Inc. Type: Webhook
Verified robots.txt: No Block: No Verified Bot
TwinAgent Neutral

TwinAgent

TwinAgent is an AI fetcher from Twin used for AI-related crawling, retrieval, search, or assistant activity.

Operator and family: Twin Type: Ai Purpose: Ai Assistant
Verified robots.txt: No Block: Depends Verified Bot
Twitterbot Neutral

twitterbot

A Twitter bot is a type of bot software that controls a Twitter account via the Twitter API. The bot software may autonomously perform actions such as tweeting, re-tweeting, liking.

Operator and family: Twitter Type: Scraper Purpose: Scraping
Verified robots.txt: No Block: Depends Verified Bot
upday Neutral

upday

Upday is a news aggregator app, and its bot crawls news sources. It collects and indexes articles to be recommended to users on its platform.

Operator: upday GmbH & Co. KG Family: upday GmbH & Co. KG Type: Search Purpose: Indexing
Verified robots.txt: Yes Block: Depends Verified Bot
updown.io Safe

UpDownBot

UpDownBot is the HTTP monitoring probe for updown.io.

Operator and family: Updown Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
Uptime Safe

Uptime LLC

Uptime.com HTTP probe for website availability and performance monitoring.

Operator and family: Uptime Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
UptimeMonitoring Safe

Uptime Monitoring

Uptime monitoring is a service that checks if a website is online. It will send you an alert if your website is “down”.

Operator and family: GoDaddy Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
UptimeBot/1 Safe

UptimeBot

UptimeBot is an actionable website monitoring tool that works great with Slack.

Operator and family: UptimeBot Type: Monitoring
Not verified robots.txt: No Block: No Observed
UptimeRobot Safe

UptimeRobot

UptimeRobot is a monitoring bot from Uptimerobot used to check website availability, performance, or page health.

Operator and family: Uptimerobot Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
www.uptimia.com Safe

Uptimia

Uptimia is a website monitoring service, monitoring website performance and availability.

Operator and family: Uptimia Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
uptrends Safe

UptrendsBot

UptrendsBot is a monitoring bot from Uptrends GmbH used to check website availability, performance, or page health.

Operator and family: Uptrends GmbH Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
v0bot Safe

v0bot

v0bot is a search crawler from Vercel used for search indexing, page discovery, or content rendering.

Operator and family: Vercel Type: Search Purpose: Ai Training
Verified robots.txt: Unknown Block: Depends Verified Bot
VaultPress Safe

VaultPress

VaultPress is a subscription service developed by Automattic, the company behind WordPress, that offers automated daily and real-time backups of WordPress websites onto WordPress.com's.

Operator and family: Automattic Type: Security
Verified robots.txt: No Block: No Verified Bot
vemetric-favicon-bot Safe

Vemetric Favicon Bot

Vemetric Favicon Bot is a preview or prefetch bot from Vemetric used to fetch pages for previews, unfurls, or user-triggered rendering.

Operator and family: Vemetric Type: Preview
Verified robots.txt: Unknown Block: Depends Verified Bot
vercel-build-container Neutral

Vercel build container

Vercel build container is an AI crawler from Vercel used for AI-related crawling, retrieval, search, or assistant activity.

Operator and family: Vercel Type: Ai Purpose: Ai Training
Verified robots.txt: Unknown Block: Depends Verified Bot
vercel-favicon-bot Safe

Vercel Favicon Bot

Vercel Favicon Bot is a preview bot associated with Vercel, used for Vercel favicon fetcher bot.

Operator and family: Vercel Type: Preview
Verified robots.txt: Unknown Block: Depends Verified Bot
vercel-screenshot-bot Safe

Vercel Screenshot Bot

Vercel Screenshot Bot is a preview bot associated with Vercel, used for Vercel screenshot preview bot.

Operator and family: Vercel Type: Preview
Verified robots.txt: Unknown Block: Depends Verified Bot