The Score Is Not the Structure: Brain Alignment and Cross-Lingual Transfer
Saman Rahbar
A model can score as if it matches the brain even after the brain information has been destroyed. And a language pattern can look real when the test measuring it is failing. A model can score highly against the brain, or transfer beautifully across languages, while the score mostly reflects something other than the structure researchers hoped to measure. This paper tests exactly how much correspondence survives when that structure is removed.