Mistral 7B v03

New MoRFI method identifies latent directions causing LLM hallucinations

Researchers have developed MoRFI (Monotonic Sparse Autoencoder Feature Identification) to better understand how large language models hallucinate. By fine-tuning models like Llama 3.1 8B and Gemma 2 9B on new knowledge,…