DeKosky and Scheff

Language Models Show 'Aphasia' After Neuronal Ablation

Researchers have explored how language models might exhibit 'aphasia' through simulated neuronal ablation. By systematically removing computational units in LSTM and Transformer architectures, they observed distinct pat…