Overview
PageFreezer is an archive crawler used for web archiving, preservation crawls, historical capture, and public record indexing.
Its primary user-agent pattern is PageFreezer; related patterns include PageFreezer crawler; Pagefreezer Website Archiving.
PageFreezer is not independently verified with Medium confidence. The identity type is Documented, and the evidence basis is documented crawler-pattern evidence.
Robots.txt behavior is not currently confirmed.
PageFreezer should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Identity
- User-Agent
PageFreezer- Aliases
- PageFreezer crawler; Pagefreezer Website Archiving
- HTTP Agent Examples
PageFreezer- Robots.txt Token
PageFreezer- Identity Type
- Documented
- Evidence Method
- Verify PageFreezer by matching `PageFreezer` to documented crawler-pattern evidence, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
Classification
- Type
- Archiver
- Kind
- Archiver
- Family
- Pagefreezer
- Purpose
- web-archiving
Behavior and handling
- Common Use
- PageFreezer is used for web archiving, preservation crawls, historical capture, and public record indexing.
- Detection Notes
- PageFreezer traffic is primarily detected by the `PageFreezer` user-agent pattern; related patterns include `PageFreezer crawler; Pagefreezer Website Archiving`. Compare source IPs, reverse DNS, request paths, and crawl cadence before trusting the traffic.
- Respects robots.txt
- Unknown
- Spoofing Risk
- PageFreezer has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
# robots.txt behavior is unconfirmed. Do not rely on this rule without verification.