Browse Teach Curate

Spurious Memorization in a Few Neurons Drives Imbalanced Group Performance

A small subset of neurons/channels in a network selectively memorizes minority-group information under spurious correlations; this 'spurious memorization' is identified (via three converging experiments) as a key cause of poor worst-group accuracy, and eliminating these localized memorization patterns during training measurably changes minority-group performance across architectures (ResNet-50, ViT-small) and benchmarks (Waterbirds).

Rosie Text

Uncovering Memorization Effect in the Presence of Spurious Correlations Chenyu You∗,†,1,6,7

Investigates why models trained by Empirical Risk Minimization show imbalanced accuracy across majority and minority groups when spurious correlations (non-causal patterns like image backgrounds) are…