MiniWin

New Periodic RoPE method enables LLMs with infinite context windows

Researchers have introduced Periodic RoPE (P-RoPE), a novel positional encoding method designed to enable Large Language Models (LLMs) to handle effectively infinite context windows. This approach combines sliding windo…