Lianmin Zheng

LLM judges introduce systematic biases, skewing evaluations

Using Large Language Models (LLMs) as judges for evaluating other LLM outputs introduces systematic biases, such as position, verbosity, and self-preference, which cannot be averaged out like random noise. These biases …