Salu

SaluNet replaces normalization layers with learnable activation

Researchers have developed SaluNet, a novel deep network architecture that eliminates the need for traditional normalization layers like BatchNorm and LayerNorm. This is achieved through a new learnable activation funct…