Differences in Typological Alignment in Language Models' Treatment of Differential Argument Marking
Researchers investigated how language models handle differential argument marking (DAM), a linguistic feature where marking depends on semantic prominence. Using GPT-2 models trained on synthetic data, they found that models could replicate human-like preferences for natural markedness directions, favoring systems where overt marking targets semantically atypical arguments. However, the models did not reproduce the human tendency to more frequently mark objects over subjects in DAM systems, suggesting different typological tendencies may stem from distinct origins. AI
IMPACT Reveals nuances in how LLMs process linguistic structures, suggesting distinct underlying mechanisms for different typological features.