Dimitris Dimakopoulos

New MoRFI method identifies latent directions causing LLM hallucinations

Researchers have developed MoRFI (Monotonic Sparse Autoencoder Feature Identification) to better understand how large language models hallucinate. By fine-tuning models like Llama 3.1 8B and Gemma 2 9B on new knowledge,…