Tomoya Wakayama

Paper links in-context learning to Bayesian inference and meta-learning

A new paper proposes a statistical theory to explain in-context learning (ICL) within a meta-learning framework. The theory decomposes ICL risk into a Bayes Gap, which measures how well a model approximates the optimal …