Niklas Muennighoff

Prefix Sliding technique boosts LLM reasoning efficiency

Researchers have introduced Prefix Sliding, a novel technique designed to improve the efficiency of language models during test-time scaling. This method addresses the challenge of retaining long reasoning traces in mem…