D
Demerzel
Video
KL Divergence
The asymmetric divergence between probability distributions; expected extra surprise from using the wrong distribution, and the regularizer anchoring tuned models to a reference policy.