Gal Kesten-Pomerants

Protein language models use specialized mechanisms to detect sequence repeats

Researchers have investigated how protein language models (PLMs) identify repeating segments within protein sequences. Their findings indicate that PLMs first create feature representations using general positional atte…