The Future of Facts: Tracing the Factual Generation-Verification Gap
A new research paper explores the gap between how well language models can generate and verify factual information. The study found that models consistently learn to verify facts before they learn to generate them accurately. Furthermore, factual updates can lead to models being in a state where they accept both old and new information as correct, a phenomenon observed across multiple open-source model families and at larger scales. AI