Supervised fine-tuning
Continued training on labelled examples of the behaviour you want.
What it commits you to
Fine-tuning adapts a pretrained model on demonstrations, which makes it the ordinary way to give a system a style, a task, or a persona. It is simple and it inherits everything in the demonstrations, including the parts nobody defended. It is also the method whose outputs are most easily mistaken for the model's own views.
Which realms lean on this
The vocabulary of measurement, and therefore of the disagreements measurement cannot settle.
technical · 1 realm — The Longview Foundry.
See also
Reinforcement learning
technicalLearning a policy by optimising cumulative reward against an environment.
RLHF
technicalReinforcement learning from human feedback: optimising a policy against learned preferences.
Catastrophic forgetting
technicalThe loss of previously learned capability when a model is trained on new data.
Model organism
alignmentA small system studied closely enough that its failures teach you something general.