Discrete Transformer extracts algorithms from model weights

Researchers have developed a "Discrete Transformer" architecture designed to extract interpretable algorithms from trained models. This approach addresses the challenge of representation entanglement in standard Transformers, where overlapping features obscure symbolic expression recovery. By incorporating discreteness through temperature-annealed sampling, the Discrete Transformer facilitates the synthesis of human-readable programs, achieving performance comparable to existing methods on discrete tasks and extending extraction capabilities to tasks with continuous intermediate computations. The architecture also offers fine-grained control over synthesized programs, serving as a platform for algorithm extraction and Transformer interpretability research. AI

IMPACT Introduces a novel architecture for improving AI model interpretability and algorithm extraction.

RANK_REASON This is a research paper detailing a new model architecture and its capabilities. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• Discrete Transformer
• Transformer
• Yifan Zhang

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →