Conceptual

Exponential Function

e^x, the function that is its own derivative, strictly positive and growing multiplicatively. Sigmoid, tanh, and softmax are all built from it.