Covariance Targeted Weight Adaptation

Researchers study cross-objective interference in LLM alignment

Researchers have identified a common issue in aligning large language models where improving one objective leads to the degradation of others, a phenomenon termed cross-objective interference. Their study shows this int…