Crawler

1,298 Bot records
Results 63
About

About the Crawler

Search crawlers, AI agents, monitors, scrapers, preview bots, and other automated web clients.

Contribute
Crawler

AboveSpot

Talaro Pty Ltd (unconfirmed)

AboveSpot is a reported bot identity associated with public bullion-market data collection.

Crawler

AffsignalCrawler

Affsignal

AffsignalCrawler is a Affsignal crawler used for affiliate-link, monetization-pattern, and website intelligence collection.

Crawler

AI Course Check Bot

AI Course Check

AI Course Check Bot reads public certification and course sources for research and updates.

Crawler

AluttaBot

Alutta

AluttaBot is a Alutta crawler used for university staff and researcher profile discovery.

Crawler

Arachmo

Unknown

Historical `Arachmo` crawler identity with insufficient current operator documentation.

Crawler

Aranet SearchBot

Unknown

Observed `Aranet-SearchBot/1.0` crawler identity with unresolved operator and purpose.

Crawler

Asterias

Unknown

Unresolved crawler token retained for classification without unsupported operator or purpose claims.

Crawler

AutoclozBot

Autocloz

AutoclozBot is a Autocloz crawler used for building and refreshing a public business directory.

Crawler

BBBike

Unknown

BBBike is an observed bot User-Agent token with insufficient current evidence to assign a definitive operator or purpose.

Crawler

BixelBot

Bixel, Inc.

BixelBot collects publicly available company information for a business-data catalog.

Crawler

BomboraBot

Bombora

BomboraBot is a historically observed web crawler associated with Bombora.

Crawler

Bravebot

Unknown

Bravebot is an observed token that should not be treated as authenticated Brave Search traffic because Brave's current crawler does not expose a…

Crawler

Bravest

Unknown

Bravest is an observed crawler token with insufficient evidence for a definitive operator, purpose, or robots policy.

Crawler

Cincraw

CINC

Cincraw identifies a web crawler attributed to CINC.

Crawler

Desvelio

Desvelio

Desvelio is a Desvelio crawler used for monitoring newsroom homepages, feeds, and popular-story surfaces for local competitive intelligence.

Crawler

EmaIngestBot

PuglieseWeb LTD

EmaIngestBot is a PuglieseWeb LTD crawler used for former PuglieseWeb customer-site ingestion identity used until 2026-09-28, when the crawler was renamed EvrellaBot.

Crawler

EvrellaBot

PuglieseWeb LTD

EvrellaBot is a PuglieseWeb LTD crawler used for ingesting a customer’s own public website so Evrella can answer from the business’s published information.

Crawler

FintelBot

Fintel Connect

FintelBot is a Fintel Connect crawler used for monitoring public financial product, offer, and publisher pages.

Crawler

Forgeby Crawler

Zmart Com West AB

Forgeby Crawler identifies automated website retrieval attributed to Forgeby.

Crawler

GTMDirectoryBot

Jay Mount Consulting Ltd

GTMDirectoryBot reads public SaaS product pages to maintain software listings and product information.

Crawler

HalalVeraBot

HalalVera

HalalVeraBot is a HalalVera crawler used for retrieving public business information for HalalVera listings.

Crawler

InfoYogBot

InfoYog

InfoYogBot is a InfoYog crawler used for public website, RSS, trending-topic, and source discovery.

Crawler

IonCrawl

IONOS

IonCrawl is a reported IONOS crawler user agent.

Crawler

ITProfilesBot

ITProfiles

ITProfilesBot collects public information about IT service providers and their services.