Emil Laftchiev

New SPD decoding strategy dramatically speeds up LLM reranking

Researchers have developed a new decoding strategy called SPD (Single Forward Pass) that significantly speeds up generative reranking for large language models (LLMs). This method decodes all ordinal values in a permuta…