Peter Banyasz

New benchmark tests LLM factual consistency across user demographics

A new benchmark called ConsistencyAI has been developed to evaluate how factually consistent large language models (LLMs) are when responding to users from different demographic groups. The benchmark tests whether LLMs …