Masked Pair Encoder

New framework unifies in-context learning analysis for causal and masked models

Researchers have developed a unified statistical learning framework to analyze in-context learning (ICL) capabilities in both causal and masked language models. This framework places autoregressive and masked pretrainin…