About this bot
CatalogBot is a product data crawler associated with Agentic Commerce Inc. (Catalog) and used for product catalog indexing.
The primary identifying User-Agent token is CatalogBot. Representative HTTP request identity: CatalogBot/1.0 (+https://getcatalog.ai/bot; crawl@getcatalog.ai).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
robots.txt behavior is currently unconfirmed.
Risk classification: Neutral. Evaluate request context and site policy before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
CatalogBotCatalogBot/1.0 (+https://getcatalog.ai/bot; crawl@getcatalog.ai)
Details
- Kind
- Product data crawler
- Family
- Agentic Commerce Inc. (Catalog)
- Purpose
- Product catalog indexing
- Common Use
- collecting and structuring product names, descriptions, prices, availability, images, and variants for merchant catalogs and AI shopping applications
- Respects robots.txt
- Unknown
Verification
- Identity Type
- Officially documented
- Evidence Method
- Match the exact `CatalogBot/1.0` User-Agent and corroborate the source address against Catalog’s current published egress-range feed. Catalog explicitly states that User-Agent alone is not proof of origin.
- Detection Notes
- CatalogBot has one documented full User-Agent and a current machine-readable egress-range feed. Use both when origin verification matters; requests outside the published ranges cannot be verified from that feed.
Website controls
- Robots.txt Snippet
# robots.txt behavior is unconfirmed. Use server-side controls if restriction is required.