Discrete Transformer

Discrete Transformer extracts algorithms from model weights

Researchers have developed a "Discrete Transformer" architecture designed to extract interpretable algorithms from trained models. This approach addresses the challenge of representation entanglement in standard Transfo…