Pedro Memoli Buffa

New method monitors LLM accuracy using decoding entropy

Researchers have developed a method called Entropy Sentinel to continuously monitor the accuracy of large language models (LLMs) during deployment. This technique analyzes the entropy of next-token probabilities during …