Conceptual

Partial Derivatives

The rate of change of a multivariable function along one input with the others held fixed; collected into a vector they form the gradient that drives all of neural network training.