Conceptual

One-Hot Encoding

Represents a categorical value as a vector with a single 1 at that category's index. Multiplying a one-hot vector by a weight matrix selects one row, which is why an embedding layer is mathematically just a lookup.