Conceptual

Loss Functions

A scalar measure of how wrong a prediction is, chosen to be differentiable so gradients exist everywhere. The loss defines the objective; the optimizer merely descends it.