ENTITY
evalmut
evalmut
PulseAugur coverage of evalmut — every cluster mentioning evalmut across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New tool evalmut tests LLM evaluation suites with intentionally broken models
A new tool called evalmut has been developed to address the limitations of LLM evaluation suites by introducing mutation testing. The tool features a "reference-fleet" of six deterministic models, each intentionally bro…
-
New tool evalmut tests LLM evaluation suites for hidden flaws
A new open-source tool called evalmut has been released to address the issue of LLM evaluation suites potentially failing to detect regressions. The tool functions by injecting known defects into a system under test and…