Large Language Models Lack Temporal Awareness of Medical Knowledge
Researchers have developed TempoMed-Bench, a new benchmark designed to assess the temporal awareness of large language models (LLMs) in the medical domain. Existing evaluations often overlook the dynamic nature of medical knowledge, which evolves with new evidence and treatments. The benchmark's analysis revealed that LLMs struggle with recalling outdated medical information and exhibit temporally inconsistent behaviors, indicating a significant gap in their ability to handle time-specific medical knowledge. AI
IMPACT Highlights a critical limitation in LLMs for time-sensitive domains like medicine, necessitating future research into temporal knowledge encoding.