Bot intelligence record

Readability

Review first

Readability is a web scraper used for public web data collection, page extraction, content monitoring; it appears in server logs as `Readability`.

Content Crawler Content Discovery Documented Confidence: Low Verified: Yes robots.txt: Unknown
Operator
Readability
Family
Readability
Source type
Observed
Last checked
2026-06-22

User-Agent Pattern

Readability
Readability
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy
User-agent: Readability
Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

Monitor

Use this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.

Readability is used for public web data collection, page extraction, content monitoring, and third-party crawler activity.

Record Details

Structured data
Operator
Readability
Family
Readability
Purpose
Content Discovery
Identity type
Documented
Confidence
Low
Last verified
2026-06-22
Last checked
2026-06-22
Source type
Observed
Verification
Verify Readability by matching `Readability` to observed traffic patterns and user-agent evidence, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
Spoofing risk
Readability has high spoofing risk because the pattern is low-confidence or observation-based; do not trust the user-agent by itself.

Notes

  • Readability is a web scraper used for public web data collection, page extraction, content monitoring, and third-party crawler activity.
  • Its primary user-agent pattern is Readability.
  • Readability is verified with Low confidence. The identity type is Documented, and the evidence basis is observed traffic patterns and user-agent evidence.
  • Readability does not have confirmed robots.txt behavior in the available public evidence.
  • Readability should be monitored first, then rate-limited or blocked if the crawl rate, paths, or behavior are unwanted.

Evidence and Source

  • Verify Readability by matching `Readability` to observed traffic patterns and user-agent evidence, then checking reverse DNS, IP ownership, request behavior, and crawl consistency.
  • Readability traffic is primarily detected by the `Readability` user-agent pattern. Compare source IPs, reverse DNS, request paths, and crawl cadence before trusting the traffic.
  • Readability is used for public web data collection, page extraction, content monitoring, and third-party crawler activity.
  • Readability has high spoofing risk because the pattern is low-confidence or observation-based; do not trust the user-agent by itself.

Monitor This Bot In Edge

Botcrawl Edge

Use Botcrawl Edge to see matching traffic, create allow or block rules, and control this bot across connected sites.