Rohan Saha

Transformer models learn latent structure in distinct stages, study finds

A new research paper published on arXiv explores how transformer models learn latent structures during training. Using the Alchemy benchmark, researchers observed that transformers acquire different components of struct…