Researchers have investigated how Large Language Models (LLMs) handle plural references, specifically how they represent and retrieve singular and plural entities. Using mechanistic interpretability and attention pattern analysis, the study identified specific attention heads responsible for coreference information, identifying plural references, and predicting pronouns. The findings indicate that LLMs align with human preferences for plural pronouns, especially when entities are ontologically similar and connected by 'and'. AI
IMPACT Provides insight into LLM reasoning capabilities for coreference resolution, potentially improving their understanding of complex linguistic structures.
RANK_REASON The cluster contains a research paper detailing a study on LLM mechanisms. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- Coreference Resolution
- CORE Recommender
- DagsHub
- Gotit.pub
- Hugging Face
- LLMs
- ScienceCast
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →