AI Coffee Break with Letitia
9 minutes
BERT-style retrieval encoders and standard ViTs still use learned absolute positions, so 'absolute is obsolete' is the wrong lesson to take away