Parity

AI theory paper shows transformers need at least two layers for parity task

Researchers have demonstrated that a two-layer transformer model is the minimum required to compute the PARITY task, which determines if a binary sequence has an even or odd number of ones. They proved that a one-layer …