BoolQ

Regret Pre-training boosts language model knowledge grounding

Researchers have developed a new self-supervised learning framework called Regret Pre-training to improve causal language models. This method leverages future information typically unavailable during standard causal tra…