text completion

Base language models outperform instruction-tuned versions on factual recall task

A new paper submitted to arXiv explores the phenomenon of "instruction tax" in language models, where instruction tuning can negatively impact factual recall. Researchers found that a base model, when prompted for text …