schristoph.online
5 minutes
Why every token attending to every other makes cost grow with the square of the input, and why halving sequence length quarters the work.