Overview
CatalogBot is a product data crawler associated with Agentic Commerce Inc. (Catalog) and used for product catalog indexing.
The primary identifying User-Agent token is CatalogBot. Representative HTTP request identity: CatalogBot/1.0 (+https://getcatalog.ai/bot; crawl@getcatalog.ai).
Directory status: Active. Identity classification: Verified with High confidence. Identity type: official documented.
robots.txt behavior is currently unconfirmed.
Risk classification: Neutral. Evaluate request context and site policy before allowing, rate-limiting, or blocking.
Identity
- User-Agent Pattern
-
CatalogBot - HTTP Agent Examples
-
CatalogBot/1.0 (+https://getcatalog.ai/bot; crawl@getcatalog.ai) - Identity Type
- Officially documented
- Evidence Method
- Match `CatalogBot` as the claimed identity signal and corroborate it with stronger network, DNS, cryptographic, or request-context signals when authentication matters.
Classification
- Type
- Ecommerce
- Kind
- Product data crawler
- Family
- Agentic Commerce Inc. (Catalog)
- Purpose
- Product catalog indexing
Behavior and handling
- Common Use
- collecting and structuring product names, descriptions, prices, availability, images, and variants for merchant catalogs and AI shopping applications
- Detection Notes
- Match the `CatalogBot` User-Agent identity. Treat the User-Agent as a claimed identity unless a stronger verification signal is available.
- Respects robots.txt
- Unknown
- Spoofing Risk
- The `CatalogBot` User-Agent can be copied by unrelated clients. Treat it as a claimed identity unless corroborated by stronger signals.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Use server-side controls if restriction is required.