KoMMLU

Llamion language models transform Orion-14B into Llama architecture

Researchers have introduced Llamion, a new family of 14B-parameter open-weight language models. These models are created by transforming the Orion-14B model into the Llama architecture using a technique called Efficient…