The Transpose and Why K^T Appears in Attention

the transpose is the notational move that turns 'compare every query with every key' into one matrix product

This Concept is waiting for its first lesson!

the transpose is the notational move that turns 'compare every query with every key' into one matrix product

Are you a teacher? Sign in to start contributing.