Régate

ReGATE method accelerates multimodal LLM training by selectively pruning tokens

Researchers have developed ReGATE, a novel method to accelerate the training of multimodal large language models (MLLMs) by adaptively pruning tokens. This technique uses a teacher-student framework where a frozen teach…