AI safety and alignment · MLD-0858
Outer alignment
The problem of specifying an external training objective that adequately captures the intended goal.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Check whether the reward rewards actual task success.
Original caveat
Terminology varies, and no objective covers every deployment contingency.
Context and aliases
Level: Advanced. Stages: Training · Evaluation · Research · Governance.
Tags: Safety · RL · SLM · LLM.
Aliases: None recorded.