DyadicAxisPE

Neural network symmetry readout depends on positional encoding

A new paper explores how the symmetries within neural network weights are influenced by the positional encoding (PE) and the specific readout methods used for analysis. Researchers found that the PE can obscure or revea…