Brief

Researchers have developed a new diagnostic framework to analyze user-side memory in large language models, revealing that personalization capabilities are not a single metric but rather factor into distinct axes: behavioral consistency, factual presence, and factual absence. Their findings indicate that different memory substrates excel at different axes, with parametric memory (gamma-LoRA) favoring style and retrieval-based methods (RAG) excelling at factual absence. The study also identified an "alignment tax" on parametric user-memory in heavily RLHF-tuned models and proposed that substrate selection is a question-classification task rather than calibration. AI