Jayden Teoh

NextLat Transformers Learn Compact World Models for Better Generalization

Researchers have developed a new training method called Next-Latent Prediction (NextLat) for transformers, which encourages them to build more compact internal world models. This approach adds a self-supervised objectiv…