Oversmoothing and Rank Collapse as the Steady State of Attention Diffusion

… more less Repeated averaging by row-stochastic attention shrinks every non-constant mode, so token vectors converge toward a common value and the token matrix approaches rank one, just as the heat equation flattens to its steady state.