Noy Sternlicht

LLM novelty evaluations unstable due to prompt design, study finds

A new study published on arXiv reveals significant instability in how large language models (LLMs) evaluate the novelty of ideas. Researchers found that minor changes in prompt design for LLM judges can drastically alte…