Bot intelligence record
MRGbot
Usually allowUse the MRGbot identifier to separate MRG Web Services srl scraping, SEO, or data-collection traffic from normal visitor requests in server logs.
- Operator
- MRG Web Services srl
- Family
- MRG Web Services srl
- Type
- Scraper
- Source type
- Verified Directory
- Last checked
- 2026-05-20
User-Agent Pattern
MRG Web Services srlMRGbot
User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.
Robots.txt Snippet
Click snippet to copyUser-agent: MRGbot Disallow: /
Click the snippet to copy it, or highlight the text manually.
Handling Guidance
DependsThis bot is usually safe to allow when the request source is verified and the traffic matches your site policy.
Public web data collection, SEO analysis, content extraction, or third-party crawling activity.
Record Details
Structured data- Operator
- MRG Web Services srl
- Family
- MRG Web Services srl
- Type
- Scraper
- Purpose
- Scraping
- Identity type
- Verified Bot
- Confidence
- Medium
- Last verified
- 2026-04-01
- Last checked
- 2026-05-20
- Source type
- Verified Directory
- Verification
- Validate the identifying user-agent or signature against the operator documentation before creating hard allow rules.
- Spoofing risk
- User-agent strings can be spoofed. For allow-listing or low-friction rules, pair the published identifier with operator documentation or cryptographic verification when available.
Notes
MRGbot is listed in the Botcrawl directory as a crawler used for scraping, SEO analysis, or data collection from MRG Web Services srl. The primary identifier for log review is MRGbot.
Identification
- User-agent pattern:
MRGbot - Family: MRG Web Services srl
- Type: Scraper
- Kind: Crawler
Common use
Public web data collection, SEO analysis, content extraction, or third-party crawling activity.
Verification and handling
Confirm the user-agent against server logs and use published operator documentation, IP ranges, reverse DNS, or other trust signals when available.
Directory guidance marks the risk level as Safe and the blocking decision as Depends. Do not rely on the user-agent string alone because user-agent strings can be copied or spoofed.
Robots.txt handling: Yes.
Evidence and Source
- Validate the identifying user-agent or signature against the operator documentation before creating hard allow rules.
- Match `MRGbot` as a case-insensitive substring in HTTP user-agent logs. Review bot_aliases for alternate names or product labels. Use bot_http_agent for full user-agent examples when the client sends a longer browser-like string. Do not treat a user-agent match alone as proof of identity for allow-listing.
- Public web data collection, SEO analysis, content extraction, or third-party crawling activity.
- User-agent strings can be spoofed. For allow-listing or low-friction rules, pair the published identifier with operator documentation or cryptographic verification when available.
Monitor This Bot In Edge
Botcrawl EdgeUse Botcrawl Edge to see matching traffic, create allow or block rules, and control this bot across connected sites.
