K-Merge

K-Merge offers efficient on-device LLM adapter merging

Researchers have introduced K-Merge, a novel strategy for efficiently merging multiple Low-Rank Adapters (LoRAs) for on-device large language models (LLMs). This method addresses the challenge of incrementally adding ne…