Overview
yacybot is a search crawler from YaCy used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is yacybot; related patterns include YaCy-Bot.
yacybot is Verified from current authoritative identity documentation reviewed on 2026-08-07. The identity type is Official Documented.
yacybot is marked as respecting robots.txt directives for crawler access control.
yacybot should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent Pattern
-
yacybot - Aliases
- YaCy-Bot
- HTTP Agent Examples
-
yacybot - Robots Token
- yacybot
- Identity Type
- Officially documented
- Evidence Method
- Match `yacybot` to the current operator documentation and corroborate the request with operator-controlled verification signals where available; User-Agent strings alone can be spoofed.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- YaCy
- Purpose
- Indexing
Behavior and handling
- Common Use
- yacybot is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- yacybot traffic is primarily detected by the `yacybot` user-agent pattern; related patterns include `YaCy-Bot`. Compare source IPs, reverse DNS, request paths, and crawl cadence with YaCy infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- yacybot has medium spoofing risk because the user-agent can be copied, even when the bot has strong source or documentation support.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: yacybot Disallow: /
Relationships
- Operator
- YaCy Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.