Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation
Researchers have developed a new method called Inverse Asymmetric Tuning (IAT) to improve federated fine-tuning of medical segmentation models. Existing federated LoRA methods struggle with the inherent asymmetry between a model's encoder and decoder, leading to issues with generalization. IAT addresses this by personalizing module-specific components to handle appearance shifts in the encoder and supervision variations in the decoder, while maintaining a shared pathway for common knowledge. The method also incorporates a Subspace Orthogonality Regularizer to prevent site-specific updates from interfering with shared parameters, showing consistent improvements in experiments. AI
IMPACT Enhances federated learning techniques for medical imaging, potentially improving model generalization across different healthcare institutions.