What Linear Probes Miss: Multi-View Probing for Weight-Space Learning
Researchers have developed MVProbe, a novel multi-view probing framework designed to analyze large open-source AI models directly from their parameters. This method addresses the computational limitations of processing full model weights by extracting representations through learnable probe vectors. MVProbe enhances existing single-view probing techniques by incorporating higher-order correlation patterns, outperforming previous methods on the Model Jungle benchmark across various architectures like ResNet and Stable Diffusion LoRA adapters. AI
IMPACT Provides a more efficient method for analyzing and understanding the vast number of open-source AI models available.