D
Demerzel
Video
Activation Functions
Nonlinearities (sigmoid, tanh, ReLU, GELU) between linear layers; why depth without nonlinearity collapses, and vanishing-gradient tradeoffs.