New framework adds invariance to pretrained models without fine-tuning

Researchers have developed a new framework for post-training augmentation invariance, allowing pretrained neural networks to gain new invariance properties without affecting their performance on original data. This method uses lightweight adapter networks appended to the latent space, trained with novel Markov-Wasserstein minimization or Wasserstein correlation maximization losses. Empirical results show significant improvements in classification accuracy for rotated and noisy images, with minimal corruption to the original features and no fine-tuning of the base network. AI

IMPACT Enables models to generalize better to augmented data without performance degradation on original inputs.

RANK_REASON This is a research paper detailing a new framework and methodology for improving model invariance. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv stat.ML →

• DINO
• Keenan Eikenberry

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →