Amir Mohammad Karimi Mamaghan

Protein language models show depth inefficiency similar to LLMs

Researchers have investigated the "Curse of Depth" phenomenon in protein language models (PLMs), finding that, similar to large language models, many layers in PLMs contribute minimally to final predictions. This study …