Conceptual

Hadamard Product

Elementwise multiplication of same-shaped tensors, written as a circled dot. LSTM gating is Hadamard products throughout: each gate dimension independently scales one memory dimension, with no cross-dimension mixing.