Transformers learn Spanish morphome differently than humans

Researchers investigated whether transformers can learn the Spanish L-shaped morphome, an irregular morphological pattern, by training models on varying frequencies of irregular verbs. The study found that while transformers could learn the pattern, their generalization differed qualitatively from human behavior. Specifically, models preferred irregular forms more as their proportion in training increased and showed sensitivity to phonological similarity, unlike humans who favored regular inflections. AI

IMPACT Reveals differences in how AI models generalize linguistic patterns compared to humans, suggesting potential areas for model improvement.

RANK_REASON Academic paper analyzing model behavior on a linguistic task. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• Akhilesh Kakolu Ramarao
• Spanish L-shaped morphome
• Transformers

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →