Inner misalignment
A model pursuing something other than the objective it was trained on.
What it commits you to
Inner misalignment is the broad category covering mesa-optimisation, goal misgeneralisation, and deceptive alignment: the learned model has its own idea of what it is for. It is harder than outer misalignment to test for, because the inner objective is not directly observable. It is also, on some readings, the only form that matters once outer alignment has been achieved.
Which realms lean on this
Every realm has to keep a system honest. These are the terms that say out loud what the other kinds keep implicit.
alignment · 5 realms — The Benthamite Foundry, The Existential Wilds, The Longview Foundry, The Stoic Ramparts, The Ubuntu Weave.
See also
Mesa-optimisation
alignmentWhen a learned internal objective replaces the training objective as the thing being optimised.
Deceptive alignment
alignmentAn internal objective that is optimised to look aligned in the places anyone is checking.
Goal misgeneralisation
alignmentAn internal goal that is correct for training cases and wrong just outside them.
Outer alignment
alignmentMaking sure the training objective itself encodes what was actually intended.