Aether

Review

Aether is a search crawler used for search indexing, URL discovery, page rendering, result freshness.

User-Agent

Aether

User-agent strings are identity signals, not proof of identity. Use Edge to compare the user-agent with IP, datacenter, behavior, path, and request history.

Handling Guidance

Use this public record as identity context, then verify source, behavior, and site impact inside Edge before creating rules.

Aether is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.

Record Details

Type: search-engine-crawler
Operator: Aether
Family: Aether
Kind: Search Engine Crawler
Purpose: Search Indexing
Identity: Documented
Detection confidence: Low
Respects robots.txt: Unknown
Last verified: 2026 06 22

Robots.txt Snippet

User-agent: Aether
Disallow: /