Overview
deadlinkchecker is a search crawler from DLC Websites used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is deadlinkchecker; a representative HTTP user-agent is www.deadlinkchecker.com Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36.
deadlinkchecker is Unverified at the identity-evidence level. The listed identity remains useful for detection, but this record does not currently contain authoritative evidence sufficient to authenticate the identity claim.
Robots.txt behavior is not currently confirmed.
deadlinkchecker can usually be allowed after confirming the source and monitoring request volume.
Identity
- User-Agent
deadlinkchecker- HTTP Agent Examples
www.deadlinkchecker.com Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36- Robots.txt Token
deadlinkchecker- Identity Type
- Observed
- Evidence Method
- Treat `deadlinkchecker` as an identity signal only. Confirm it with current operator documentation, cryptographic verification, forward-confirmed reverse DNS, source-network ownership, or other authoritative evidence before trusting the claimed identity.
Classification
- Type
- Search
- Kind
- Crawler
- Family
- DLC Websites
- Purpose
- indexing
Behavior and handling
- Common Use
- deadlinkchecker is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- deadlinkchecker traffic is primarily detected by the `deadlinkchecker` user-agent pattern; a representative HTTP user-agent is `www.deadlinkchecker.com Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36`. Compare source IPs, reverse DNS, request paths, and crawl cadence with DLC Websites infrastructure before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- deadlinkchecker has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Safe
- Recommended Handling
- No
Rules and controls
- Robots.txt Snippet
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.