NQ-Open
PulseAugur coverage of NQ-Open — every cluster mentioning NQ-Open across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
AI evaluation flaw: Incomplete references reverse model rankings
A new paper published on arXiv, titled "Unmatched Does Not Mean False: Incomplete Reference Sets Can Reverse Calibration Rankings in Open-Ended Theory-of-Mind Tracking," highlights a critical flaw in evaluating open-end…
-
J-space entropy shows mixed results as an error predictor in Qwen3-4B
A recent study explored using "J-space entropy," an internal metric within language models, to predict errors, particularly hallucinations. The research tested this hypothesis on the Qwen3-4B model across seven diverse …
-
New method predicts and mitigates order sensitivity in AI adjudication
Researchers have developed a new method called Quantified Martingale Violation (QMV) to address order sensitivity in transformer models used for evidence-based decision-making. This approach aims to reduce unreliable an…