Bot intelligence record

Omgili Bot

Review first

Omgili/Webz.io crawler used to index forums, comments, discussion boards, and other public web data.

Scraper Web Data Indexing Verified Bot Confidence: Medium Verified: Yes robots.txt: Yes
Operator
Webz.io / Omgili
Family
Omgili
Type
Scraper
Source type
Verified Directory
Last checked
2026-06-02

User-Agent Pattern

Webz.io / Omgili
omgili
Verification note

User-agent strings are identification signals, not proof of identity. Confirm important allow, block, or rate-limit decisions with logs, DNS or IP evidence, request behavior, or operator documentation when available.

Robots.txt Snippet

Click snippet to copy 
User-agent: omgili Disallow: /

Click the snippet to copy it, or highlight the text manually.

Handling Guidance

Depends

Use this record as bot intelligence, then verify the request source and behavior before allowing, blocking, or rate limiting.

Discussion-board, forum, comment, media-monitoring, and market-research data collection.

Record Details

Structured data
Operator
Webz.io / Omgili
Family
Omgili
Type
Scraper
Purpose
Web Data Indexing
Identity type
Verified Bot
Confidence
Medium
Last verified
2026-06-02
Last checked
2026-06-02
Source type
Verified Directory
Verification
Validate the identifying user-agent against operator documentation, reverse DNS, published IP ranges, signatures, or other trust signals before creating hard allow rules.
Spoofing risk
User-agent strings can be spoofed. Pair the claimed identifier with operator documentation, IP verification, reverse DNS, signatures, or other available trust signals before creating low-friction allow rules.

Notes

Omgili Bot is listed in the Botcrawl directory as a scraper bot from Omgili. The primary identifier for log review is omgili.

Identification

  • User-agent pattern: omgili
  • Family: Omgili
  • Type: Scraper
  • Kind: Crawler

Common use

Discussion-board, forum, comment, media-monitoring, and market-research data collection.

Verification and handling

Confirm the user-agent against server logs and use published operator documentation, IP ranges, reverse DNS, signatures, or other trust signals when available.

Directory guidance marks the risk level as Neutral and the blocking decision as Depends. Do not rely on the user-agent string alone because user-agent strings can be copied or spoofed.

Robots.txt handling: Yes.

Evidence and Source

  • Validate the identifying user-agent against operator documentation, reverse DNS, published IP ranges, signatures, or other trust signals before creating hard allow rules.
  • Match `omgili` as a case-insensitive substring in HTTP user-agent logs. Do not treat a user-agent match alone as proof of identity for allow-listing.
  • Discussion-board, forum, comment, media-monitoring, and market-research data collection.
  • User-agent strings can be spoofed. Pair the claimed identifier with operator documentation, IP verification, reverse DNS, signatures, or other available trust signals before creating low-friction allow rules.

https://webz.io/blog/web-data/what-is-the-omgili-bot-and-why-is-it-crawling-your-website/

Monitor This Bot In Edge

Botcrawl Edge

Use Botcrawl Edge to see matching traffic, create allow or block rules, and control this bot across connected sites.

Get Edge Now Open BotDB