Prefix Sliding

Prefix Sliding technique boosts LLM reasoning speed and length

Researchers have introduced Prefix Sliding, a novel technique designed to enhance the efficiency of language models during test-time scaling. This method addresses the computational cost of retaining entire reasoning tr…