RelFlexformers

RelFlexformers introduce efficient 3D-Transformer attention with novel positional encodings

Researchers have introduced RelFlexformers, a novel class of 3D-Transformer models that utilize efficient attention mechanisms with integrable relative positional encodings. These models achieve a time complexity of O(L…