Tatsuya Ichinose

New CoDIT method enhances LLM instruction tuning by separating knowledge and instruction-following

Researchers have developed a new method called CoDIT (Contrastive Decoding for Instruction Tuning) to improve the effectiveness of instruction tuning for large language models. This technique disentangles instruction-fo…