Rushil Chandrupatla

Researchers investigate transformer in-context learning scaling and overfitting

This paper systematically investigates the in-context learning capabilities of Transformer models, focusing on Gaussian-mixture binary classification tasks. It empirically analyzes how factors like input dimension, numb…