El-Naggar

Curriculum learning significantly impacts language model inductive bias, study finds

Researchers investigated how language models learn under curriculum learning (CL), a method where models are trained on simpler inputs before progressing to more complex ones. The study explored whether LMs can reproduc…