2D-RoPE

New 2D Positional Encoding Method Boosts LLM Copying Ability

Researchers have identified a significant limitation in current large language models, even those considered "frontier" models, which struggle with the simple task of exactly copying input text within their context wind…