Overview
Omgili Bot is a web scraper from Webz.io / Omgili used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
Its primary user-agent pattern is omgili; related patterns include omgilibot; omgili/0.5 +http://omgili.com; a representative HTTP user-agent is omgili/0.5 +http://omgili.com.
Omgili Bot is verified with Medium confidence. The identity type is Verified Bot, and the evidence basis is a public crawler reference or source-linked documentation.
Omgili Bot is marked as respecting robots.txt directives for crawler access control.
Omgili Bot should be reviewed against site policy, source evidence, crawl rate, and requested paths before a permanent allow or block rule is created.
Omgili Bot belongs to the Omgili bot family.
Identity
- User-Agent Pattern
-
omgili - Aliases
- omgilibot; omgili/0.5 +http://omgili.com
- HTTP Agent Examples
-
omgili/0.5 +http://omgili.com - Robots Token
- omgili
- Identity Type
- Verified bot
- Evidence Method
- Verify Omgili Bot by matching `omgili` to Webz.io / Omgili evidence, then checking reverse DNS, source-network ownership, signed request data, or published crawler documentation when available.
Classification
- Type
- Scraper
- Kind
- Crawler
- Family
- Omgili
- Purpose
- Web data indexing
Behavior and handling
- Common Use
- Omgili Bot is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Detection Notes
- Omgili Bot traffic is primarily detected by the `omgili` user-agent pattern; related patterns include `omgilibot; omgili/0.5 +http://omgili.com a representative HTTP user-agent is `omgili/0.5 +http://omgili.com Compare source IPs, reverse DNS, request paths, and crawl cadence with Webz.io / Omgili infrastructure before trusting the traffic.
- Respects robots.txt
- Yes
- Spoofing Risk
- Omgili Bot has medium spoofing risk because user-agent strings can be copied; pair the match with DNS, IP, behavior, or operator evidence.
- Risk
- Neutral
- Recommended Handling
- Depends
Rules and controls
- Robots.txt Snippet
-
User-agent: omgili Disallow: /
Relationships
- Operator
- Webz.io / Omgili Checked 2026-06-23
- Owner / parent organization
- Webz.io Checked 2026-06-23
Relationships without an Evidence link are normalized from the canonical directory record. They should not be interpreted as independent proof of physical presence or request origin.