SigMerge

SigMerge framework enhances dense expert merging for language models

Researchers have introduced SigMerge, a novel framework for dense expert merging in language models. This method addresses key challenges in combining domain-specialized models by systematically determining where to all…