vertical mixture-of-experts

New HiVe framework enhances LLM multitask learning with adaptive prompts

Researchers have introduced HiVe, a novel prompt tuning framework designed to enhance multitask learning in large language models (LLMs). Unlike existing methods that use static or fixed hierarchical prompt structures, …