Generalized Hebbian Algorithm

New STAR method enhances MoE routing with structure-aware subspace learning

Researchers have introduced STAR, a novel approach to Mixture-of-Experts (MoE) routing that treats routing as a structure-aware subspace learning problem. Unlike traditional MoE methods that use limited linear projectio…