About this bot
MRGbot is a crawler associated with MRG Web Services srl and used for search indexing.
The primary identifying User-Agent token is MRGbot. Representative HTTP identity or detection model: Mozilla/5.0 (compatible; MRGbot/1.0; +https://www.mrg.ro/bot.html).
Directory status: Active. Identity classification: Verified with Medium confidence. Identity type: verified-bot.
This identity is documented as honoring robots.txt controls.
Risk classification: Safe. Recommended handling is to evaluate the request context before allowing, rate-limiting, or blocking.
How to identify this bot
- User-agent and crawler identifiers
-
MRGbotMozilla/5.0 (compatible; MRGbot/1.0; +https://www.mrg.ro/bot.html)MRGbot/ - Also known as
- MRGbot/1.0
Details
- Kind
- Crawler
- Family
- MRG Web Services srl
- Purpose
- Search indexing
- Common Use
- Crawling public web content for MRG's search/data corpus.
- Respects robots.txt
- Yes
Verification
- Identity Type
- Verified bot
- Evidence Method
- Match the stable `MRGbot` token and corroborate operator/network context where higher assurance is needed.
- Detection Notes
- Current verified crawler traffic contains `MRGbot/1.0`.
Website controls
- Robots.txt Snippet
User-agent: MRGbot/ Disallow: /