Meta-ExternalAgent

Review

Meta-ExternalAgent is an AI training crawler from Meta used for AI model training, dataset discovery.

User-Agent

meta-externalagent

User-agent strings are identity signals, not proof of identity. Use Edge to compare the user-agent with IP, datacenter, behavior, path, and request history.

Handling Guidance

Use this public record as identity context, then verify source, behavior, and site impact inside Edge before creating rules.

Meta-ExternalAgent is used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.

Record Details

Type: search
Operator: Meta
Family: Meta
Kind: Crawler
Purpose: Ai Training
Identity: Verified Bot
Detection confidence: High
Respects robots.txt: Yes
Last verified: 2026 06 23

Robots.txt Snippet

User-agent: meta-externalagent
Disallow: /

Evidence and Source

Source reference
Operator reference