About this bot
Marginalia Search is the crawler for the Marginalia independent search engine. It crawls the public web on a deliberately slow schedule to build Marginalia’s search index.
Primary identity signal: search.marginalia.nu. The operator publishes the User-Agent/robots token and source IP range, allowing stronger verification than User-Agent matching alone.
Marginalia documents robots.txt compliance.
How to identify this bot
- User-agent and crawler identifiers
-
search.marginalia.nu
Details
- Kind
- Crawler
- Family
- Marginalia
- Purpose
- Search indexing
- Common Use
- Building and refreshing Marginalia's independent web search index.
- Respects robots.txt
- Yes
Verification
- Identity Type
- operator-documented
- Evidence Method
- Match search.marginalia.nu and corroborate source IP against Marginalia's published crawler range.
- Detection Notes
- Marginalia publishes the crawler token and a dedicated crawler IP range; combine both signals for higher-confidence attribution.
Website controls
- Robots.txt Snippet
User-agent: search.marginalia.nu Disallow: /