Conceptual

Hyperbolic Tangent Function

Squashes inputs into (-1,1) with zero-centered output, making it the standard choice for candidate values and cell-state readout in LSTMs, where updates must be able to push memory in both directions. Like sigmoid it saturates at the tails.