Conceptual

KL Divergence

The asymmetric divergence between probability distributions; expected extra surprise from using the wrong distribution, and the regularizer anchoring tuned models to a reference policy.