LLaVA-CKD

LLaVA-CKD framework improves vision-language model efficiency via cascaded distillation

Researchers have developed LLaVA-CKD, a novel bottom-up cascaded knowledge distillation framework designed to improve the efficiency of large Vision-Language Models (VLMs). This method addresses the challenge of knowled…