KItCAT

KItCAT training method enhances LLM knowledge injection with input corruption

Researchers have developed a new training strategy called KItCAT (Knowledge Injection via Corrupted Auto-regressive Training) designed to improve the ability of large language models (LLMs) to acquire specialized knowle…