AdaMTP

New AdaMTP paradigm improves LLM training with adaptive prediction

Researchers have introduced AdaMTP, an adaptive training paradigm designed to improve Multi-Token Prediction (MTP) for large language models. Unlike existing MTP frameworks that use a fixed prediction horizon, AdaMTP dy…