Overview
bl.uk_ldfc_bot is associated with British Library and used for uk legal deposit web archiving.
The primary identifying User-Agent token is bl.uk_ldfc_bot. Representative HTTP request identity: bl.uk_ldfc_bot/3.4.0-20220727 (+https://www.bl.uk/legal-deposit/web-archiving).
Directory status: Active. Identity classification: Unverified with Medium confidence. Identity type: observed.
robots.txt behavior is currently unconfirmed.
Verification: Treat `bl.uk_ldfc_bot` as a distinct observed British Library legal-deposit identity and corroborate source hostnames/network before trusting the claim.
Identity
- User-Agent Pattern
-
bl.uk_ldfc_bot - Aliases
- British Library legal deposit crawler; bl.uk_ldfc_bot/3.4.0
- HTTP Agent Examples
-
bl.uk_ldfc_bot/3.4.0-20220727 (+https://www.bl.uk/legal-deposit/web-archiving) - Robots Token
- bl.uk_ldfc_bot
- Identity Type
- Observed
- Evidence Method
- Treat `bl.uk_ldfc_bot` as a distinct observed British Library legal-deposit identity and corroborate source hostnames/network before trusting the claim.
Classification
- Type
- Archive
- Kind
- Legal deposit archiver
- Family
- British Library
- Purpose
- Uk legal deposit web archiving
Behavior and handling
- Common Use
- preserving UK websites under British Library legal-deposit and web-archiving programs
- Detection Notes
- Versioned `bl.uk_ldfc_bot` traffic has been repeatedly observed from British Library crawler infrastructure and points to the UK legal-deposit web-archiving program.
- Respects robots.txt
- Unknown
- Spoofing Risk
- The `bl.uk_ldfc_bot` identity can be copied unless stronger verification signals are validated.
- Risk
- Safe
- Recommended Handling
- Do not block
Rules and controls
- Robots.txt Snippet
-
# robots.txt behavior is unconfirmed. Use server-side controls if restriction is required. - Apache Rule
-
RewriteCond %{HTTP_USER_AGENT} "bl.uk_ldfc_bot" [NC] RewriteRule ^ - [F,L] - Nginx Rule
-
if ($http_user_agent ~* "bl.uk_ldfc_bot") { return 403; }