Yaniv Livertovsky

New CAHP method prunes Transformer attention heads for efficiency

Researchers have introduced Complementary Attention Head Pruning (CAHP), a novel post-hoc framework designed to make Transformer models more efficient. Unlike existing methods that often rely on unstable gradient-based …