Context Rot: Accuracy Decay Well Before the Window Is Full

AI context rot explained: how excessive information dilutes accuracy in large language models

Context rot is a cognitive mechanism within large language models wherein excessive accumulation of information leads to diluted attention weights and degraded recall accuracy for specific data point…