PulseAugur
EN
LIVE 09:31:24
ENTITY FlipGate

FlipGate

PulseAugur coverage of FlipGate — every cluster mentioning FlipGate across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
  1. TOOL · CL_285725 ·

    Small LLM judges show high error rates and biases in new evaluation

    A recent analysis evaluated the performance of small, open-source LLM judges, specifically Qwen2.5-3B and Qwen2.5-0.5B, against deterministic oracles for tasks like legal clause identification and arithmetic. The study …

  2. TOOL · CL_281263 ·

    FlipGate tool measures per-item answer flips in quantized LLMs

    A new tool called FlipGate has been developed to evaluate the per-item answer consistency of quantized large language models, going beyond traditional accuracy metrics. FlipGate measures how often a quantized model flip…