LayerMix

LLM Hallucination Signal Identified as Simple Mean Shift

Researchers have identified that the primary signal for detecting hallucinations in large language models is a simple mean shift within the model's hidden states. Across various 7B-scale models and datasets, complex pro…