Pretrained Language Models

New theory explains AI's balance of generalization and memorization

Researchers have developed a new mathematical theory to explain how learning systems balance generalization with memorization of exceptions. They introduced a novel task, transitive inference with exceptions, to study t…