Monte Carlo tree search
Search by sampling continuations and spending more effort where they pay off.
What it commits you to
MCTS allocates search budget adaptively by exploring from promising positions, and it is half of what made AlphaGo possible: a strong policy proposes, search verifies. The general lesson for alignment is that a good policy plus search can exceed either alone, which means a safety property present in the policy may be checked by a search procedure with different failure modes.
Which realms lean on this
The vocabulary of measurement, and therefore of the disagreements measurement cannot settle.
technical · 1 realm — The Longview Foundry.
See also
Reinforcement learning
technicalLearning a policy by optimising cumulative reward against an environment.
Policy
technicalThe mapping from states to actions that a trained system actually follows.
Chain of thought
technicalIntermediate reasoning tokens a model produces before giving its answer.
Emergent capability
technicalA capability that appears abruptly above a scale threshold rather than gradually.