ProphetKV

QCFuse speeds up RAG serving with novel cache fusion technique

Researchers have developed QCFuse, a novel method to optimize Retrieval-Augmented Generation (RAG) serving efficiency. This technique addresses the high cost associated with processing retrieved contexts in LLMs by inte…