J
jeremy
11 minutes
Steerability: Why a Model Follows Some Instructions and Not Others
Explain why a model holds some instructions reliably while others fade over a long conversation: an instruction is just text competing with everything else in context, so its phrasing and its distance from the current turn set how strongly it holds, and a model can restate a rule it is failing to follow.