Seq-Drifting

Seq-Drifting enables one-step text generation in language models

Researchers have introduced Seq-Drifting, a novel framework for language models that enables one-step text generation. This method applies a "drifting" mechanism to sequences of continuous token representations, learnin…