Brief

Researchers have developed a new benchmark, LexNeo-Bench, to evaluate how well large language models understand lexical borrowing in low-resource languages like Luxembourgish. The benchmark, derived from a Luxembourgish news corpus, labels tokens as native or borrowed from French, German, or English. When prompted with a linguistic knowledge graph, LLMs showed significantly improved accuracy in classifying borrowed words, narrowing the performance gap between smaller and larger models. AI

Researchers have proposed a new hypothesis called "collocational bootstrapping" to explain how statistical patterns in language input can aid in learning syntactic dependencies. This mechanism suggests that word co-occurrence regularities can signal syntactic relationships, specifically focusing on how subject-verb agreement might be acquired. Computational simulations using neural networks trained on synthetic data demonstrated that these models could robustly learn subject-verb agreement within a specific range of statistical variability. Analysis of child-directed language revealed that the variability in subject-verb pairings in such input falls within this effective range, supporting the idea that collocational bootstrapping is a viable learning strategy for children. AI

Researchers have reframed the phenomenon of model collapse, where large language models degrade when trained on their own outputs, as a cultural evolution process. By applying iterated learning theory, they derived and tested five predictions using LLaMA-2-7B and Mistral-7B models across multiple languages. A key finding was that compositionality initially increases then decreases during unfiltered self-training, a pattern that persists even with regularized data and is only mitigated by task-grounded filtering. AI

Two new research papers highlight challenges in developing AI for non-English languages and cultures. One paper reflects on two decades of building Arabic NLP resources, concluding that social and institutional factors are harder to overcome than linguistic ones. The other paper introduces a benchmark for evaluating how well Multimodal Large Language Models (MLLMs) can adapt to different cultures without negatively impacting their performance in other cultural contexts. AI

Researchers are exploring how large language models (LLMs) align with human brain activity across different languages and tasks. Studies show that intermediate LLM layers best predict brain responses, and this alignment is influenced by training data language dominance rather than inherent model typology. Furthermore, instruction-tuned multimodal LLMs demonstrate stronger brain alignment, particularly when organized around task-specific demands rather than just surface semantics. AI