Overview
ScrepyBot is the crawler used by Screpy for technical SEO audits, site crawling, uptime checks, and page analysis.
It identifies as ScrepyBot/1.0 (+https://screpy.com/bot) and honors robots.txt directives for ScrepyBot.
The operator publishes a crawler IP list that can be used to corroborate the user-agent claim.
Use both identity and source evidence when distinguishing genuine Screpy traffic from a spoofed user-agent.
Identity
- User-Agent Pattern
-
ScrepyBot - Aliases
- ScrepyBot/1.0
- HTTP Agent Examples
-
ScrepyBot/1.0 (+https://screpy.com/bot) - Robots Token
- ScrepyBot
- Identity Type
- Officially documented
- Evidence Method
- Match the `ScrepyBot` token and corroborate the source address against the current operator-published crawler IP list.
Classification
- Type
- SEO
- Kind
- Crawler
- Family
- Screpy
- Purpose
- Technical SEO auditing
Behavior and handling
- Common Use
- Performs user-requested SEO audits, technical crawling, uptime checks, and page analysis.
- Detection Notes
- Detect by `ScrepyBot`; the operator publishes a stable full user-agent and a machine-readable crawler IP list.
- Respects robots.txt
- Yes
- Spoofing Risk
- The token is spoofable; the operator-published crawler IP list provides stronger corroboration.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: ScrepyBot Disallow: / - Apache Rule
-
RewriteCond %{HTTP_USER_AGENT} "ScrepyBot" [NC] RewriteRule ^ - [F,L] - Nginx Rule
-
if ($http_user_agent ~* "ScrepyBot") { return 403; }
Relationships
- Operator
- Airscarp LLC Checked 2026-09-02
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.