About this bot
Freespoke is a verified crawler associated with Freespoke and is used for indexing.
The primary identifying signal is FreespokeCrawler.
Freespoke uses this crawler for web-search discovery and indexing and documents robots.txt plus Crawl-delay support.
Directory status: Active. Identity classification: Verified with High confidence.
This identity is recorded as honoring robots.txt under FreespokeCrawler.
Risk classification: Safe. Treat User-Agent strings as claims unless corroborated by the verification signals recorded for this entry.
How to identify this bot
- User-agent and crawler identifiers
-
FreespokeCrawlerMozilla/5.0 (compatible; FreespokeCrawler/2.0; +https://crawler.freespoke.com)
Details
- Kind
- Crawler
- Family
- Freespoke
- Purpose
- Indexing
- Common Use
- Freespoke is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Respects robots.txt
- Yes
Verification
- Identity Type
- Verified bot
- Evidence Method
- Match FreespokeCrawler/2.0 and corroborate with expected Freespoke crawler behavior.
- Detection Notes
- Match `FreespokeCrawler` as an identity signal and apply the recorded verification method before granting identity-based trust.
Website controls
- Robots.txt Snippet
User-agent: FreespokeCrawler Disallow: /