Bot Directory

Search public Botcrawl bot records to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.

AI Crawlers Search Bots Scrapers Scanners Monitoring Preview Bots
See these bots hitting your site in real time

The public directory explains known bots and user-agents. Botcrawl Edge uses BotDB plus datacenter intelligence for live classification, rules, and enforcement.

Try Edge Free Open Edge BotDB
998 bots
imagesiftbot Safe

ImagesiftBot

ImagesiftBot is a web scraper from Hive used for public web data collection, page extraction, content monitoring.

Operator and family: Hive Type: Scraper Purpose: Scraping
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
imageSpider Neutral

imageSpider

imageSpider is an AI crawler from Unknown used for AI crawler discovery, assistant retrieval, AI search support, or model-related web access.

Family: imageSpider Type: Ai Purpose: Image Crawl
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
iMediaEthics Neutral

iMediaEthics

iMediaEthics is an aggregator used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: iMediaEthics Type: Aggregator Purpose: Media Monitoring
Not verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
img2dataset Neutral

img2dataset

img2dataset is an AI training crawler used for AI model training, dataset discovery.

Operator and family: img2dataset Type: Ai Purpose: Ai Training
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
IndeedJobBot Neutral

IndeedJobBot

IndeedJobBot is a search crawler from Indeed used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Indeed Type: Search Purpose: Indexing
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
inngest Safe

Inngest

Inngest is a webhook callback used for webhook delivery, payment notifications, service callbacks.

Operator and family: Inngest Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Innguma Safe

Innguma Fetcher

Innguma Fetcher is a feed fetcher from Innguma used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Innguma Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
inoreader.com Safe

Innologica

Innologica is a feed fetcher used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Innologica Type: Feed Purpose: Feed Fetch
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
Instapaper Neutral

Instapaper

Instapaper is a feed fetcher from Instant Paper used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Instant Paper Type: Feed Purpose: Feed Fetch
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
Integromat Safe

Integromat

Integromat is a webhook callback from Make used for webhook delivery, payment notifications, service callbacks.

Operator and family: Make Type: Webhook
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
archive.org_bot Neutral

Internet Archive

Internet Archive is a feed fetcher used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Internet Archive Type: Feed Purpose: Feed Fetch
Verified robots.txt: Yes Block: Depends Verified Bot
View Record Open in Edge BotDB
Archive-It Neutral

Internet Archive – Archive-It

Internet Archive - Archive-It is a feed fetcher from Archive-It used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Archive-It Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB
IABot Safe

InternetArchiveBot

InternetArchiveBot is a feed fetcher from Internet Archive used for RSS or Atom feed polling, syndication refresh, subscription delivery.

Operator and family: Internet Archive Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
IsDownBot Safe

IsDownBot

IsDownBot is a monitoring bot used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: IsDownBot Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
ISSCyberRiskCrawler Neutral

ISSCyberRiskCrawler

ISSCyberRiskCrawler is a security scanner from ISS Cyber Risk used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: ISS Cyber Risk Type: Security
Not verified robots.txt: Unknown Block: Depends Observed
View Record Open in Edge BotDB
www.getuptime.co Safe

Jagged Pixel UptimeBot

Jagged Pixel UptimeBot is a monitoring bot from Jagged Pixel Inc. used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Jagged Pixel Inc. Type: Monitoring
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
JenkersBot Neutral

JenkersBot

JenkersBot is a crawler framework from Jenkers used for JenkersBot is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator: Jenkers Family: JenkersBot Type: Crawler Purpose: Web Crawling
Not verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
jetmon Safe

Jetpack

Jetpack is a monitoring bot from Automattic used for uptime monitoring, synthetic checks, performance measurement, accessibility review.

Operator and family: Automattic Type: Monitoring
Verified robots.txt: Unknown Block: No Verified Bot
View Record Open in Edge BotDB
Jetslide Neutral

Jetslide

Jetslide is an SEO crawler used for SEO analysis, crawl diagnostics, backlink discovery, technical audit work.

Operator and family: Jetslide Type: Seo Crawler Purpose: Technical Seo Auditing
Not verified robots.txt: Unknown Block: Depends Documented
View Record Open in Edge BotDB
Jigsaw Neutral

Jigsaw

Jigsaw is a validator bot from W3C Jigsaw used for markup validation, accessibility testing, structured-data review.

Operator and family: W3C Jigsaw Type: Validator Purpose: Validation And Testing
Verified robots.txt: Unknown Block: Allow Documented
View Record Open in Edge BotDB
jobswithgptcom Safe

jobswithgptcom-bot

jobswithgptcom-bot is a search crawler from jobswithgptcom used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: jobswithgptcom Type: Search Purpose: Indexing
Verified robots.txt: Unknown Block: Depends Verified Bot
View Record Open in Edge BotDB
jpg-newsbot Caution

jpg-newsbot

jpg-newsbot is a news Crawler used for jpg-newsbot is used for Automated website access, content retrieval, or integration activity associated with the listed operator.

Operator and family: jpg-newsbot Type: News Crawler Purpose: News Crawling
Verified robots.txt: Unknown Block: Monitor Documented
View Record Open in Edge BotDB
Jumio Safe

Jumio

Jumio is a security scanner from Coinbase used for security scanning, malware checks, vulnerability assessment, certificate review.

Operator and family: Coinbase Type: Security
Verified robots.txt: No Block: No Verified Bot
View Record Open in Edge BotDB
Kagibot Safe

Kagi Bot

Kagi Bot is a search crawler from Kagi used for search indexing, URL discovery, page rendering, result freshness.

Operator and family: Kagi Type: Search Purpose: Indexing
Verified robots.txt: No Block: Depends Verified Bot
View Record Open in Edge BotDB