Mostafa 'Neo' Mohsenvand

New research challenges transformer limits with novel layer designs

A new research paper explores the limitations of standard transformer models in learning complex graph structures and games like SET. The authors propose a novel approach using higher-order layers and specific channel d…