InfiLoop

InfiLoop architecture scales Transformer reasoning to tens of thousands of iterations

Researchers have developed InfiLoop, a novel loop-native residual connection for Transformers designed to improve performance on complex reasoning tasks. This new architecture addresses the degradation seen in tradition…