Conceptual

Derivatives

The instantaneous rate of change of a function, defined as the limit of the difference quotient. The sign and magnitude of a derivative tell an optimizer which way and how hard to move.