Chathive Crawler
AI

Chathive Crawler

Chathive Crawler is a knowledge base crawler associated with Chathive and used for knowledge base ingestion; candidate traffic can include `ChathiveCrawler`.

Operator Chathive

About this bot

Chathive Crawler is a knowledge base crawler associated with Chathive and used for knowledge base ingestion.

It can be identified in HTTP traffic by the ChathiveCrawler identity family, including ChathiveCrawler/1.0.

Directory status: Active. Identity classification: Verified with High confidence. Identity type: official-documented.

robots.txt behavior is not sufficiently established to claim compliance.

Match the default ChathiveCrawler/1.0 identity and corroborate it with configured knowledge-base crawl behavior.

How to identify this bot

User-agent and crawler identifiers
ChathiveCrawler ChathiveCrawler/1.0
Also known as
ChathiveCrawler/1.0; Oniroco crawler; Chathive AI assistant crawler

Details

Kind
Knowledge base crawler
Family
Chathive
Purpose
Knowledge base ingestion
Common Use
Crawling configured sites and sitemaps to ingest content into Chathive knowledge bases.
Respects robots.txt
Unknown

Verification

Identity Type
Officially documented
Evidence Method
Match the default ChathiveCrawler/1.0 identity and corroborate it with configured knowledge-base crawl behavior.
Detection Notes
Chathive allows the crawler User-Agent to be customized, so absence of the default token does not exclude Chathive traffic.
Website controls
Robots.txt Snippet
User-agent: ChathiveCrawler Disallow: /

Similar Bots

AI

Keenable-User

Keenable.ai, Inc.

Keenable-User fetches specific web pages at the request of users or AI agents.

AI

KeenableBot

Keenable.ai, Inc.

KeenableBot indexes public web pages for search used by AI agents and applications.

AI

AgentReadyWebsiteBot

Omnirithm Inc.

AgentReadyWebsiteBot tests whether requested websites expose information needed by AI agents.

AI

AgenstryBot

Agenstry

AgenstryBot checks public AI agent cards, discovery documents, and MCP endpoints.

AI

A1-User

A1

A1-User retrieves public pages when an A1 assistant user requests a web page.

AI

Gist Crawler

ProRata / Gist

The Gist Crawler retrieves licensed and public web content for Gist.ai search and retrieval.