Draft-KV

Draft-KV enables latent communication between frozen language models

Researchers have introduced Draft-KV, a novel method for enabling language models to communicate useful information through their internal states, rather than just decoded text. This approach allows a receiver model to …