Does Slightly Mean Somewhat? Measuring Vague Intensity Words in LLM Numeric Actions
A new research paper investigates how large language models interpret vague intensity words when tasked with producing numerical actions. The study found that Claude Haiku, when given instructions involving words like "slightly" or "drastically," compressed ten distinct intensity words into only five median numerical outputs. Furthermore, the model's interpretation of these words was heavily dependent on the current system state, with lexical distinctions disappearing as the system approached its capacity. AI
IMPACT Reveals limitations in LLM's nuanced understanding of language, impacting their reliability in tasks requiring precise interpretation of intensity.