Kronecker Embeddings

Kronecker Embeddings slash language model parameters, boost performance

Researchers have developed Kronecker Embeddings, a novel method for representing tokens in language models that significantly reduces the number of trainable parameters. This approach replaces large embedding tables wit…