Kata Naszadi

New benchmark tests LLMs' ability to infer context and clarify instructions

Researchers have developed a new benchmark called Build What I Mean (BWIM) to test how well large language models can handle contextual inference and cancelability in interactive instruction-following tasks. The benchma…