Overview
BUbiNG is a crawler framework from University of Milan LAW used for Automated website access, content retrieval, or integration activity associated with the listed operator.
Its primary user-agent pattern is BUbiNG; related patterns include BUbiNG crawler.
BUbiNG is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Robots.txt behavior is not currently confirmed.
BUbiNG should be monitored first, then rate-limited or blocked if the crawl rate, paths, or behavior are unwanted.
Identity
- User-Agent Pattern
-
BUbiNG - Aliases
- BUbiNG crawler
- HTTP Agent Examples
-
BUbiNG - Robots Token
- BUbiNG
- Identity Type
- Observed
- Evidence Method
- Treat `BUbiNG` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- Crawler framework
- Kind
- Crawler framework
- Family
- University of Milan LAW
- Purpose
- Distributed web crawling
Behavior and handling
- Common Use
- BUbiNG is used for Automated website access, content retrieval, or integration activity associated with the listed operator.
- Detection Notes
- BUbiNG traffic is primarily detected by the `BUbiNG` user-agent pattern; related patterns include `BUbiNG crawler`. Compare source IPs, reverse DNS, request paths, and crawl cadence with University of Milan LAW infrastructure before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- BUbiNG has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Caution
- Recommended Handling
- Monitor
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.
Relationships
- Operator
- University of Milan LAW Checked 2026-08-07
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.