PulseAugur
EN
LIVE 03:46:34
ENTITY eval set drift

eval set drift

PulseAugur coverage of eval set drift — every cluster mentioning eval set drift across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
0
1 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 1 TOTAL
  1. RESEARCH · CL_46875 ·

    LLM Ops: Detect Eval Drift and Track Customer Costs

    The author discusses two common challenges in managing LLM applications: eval set drift and per-customer cost reporting. For eval set drift, they propose using Maximum Mean Discrepancy (MMD) on embeddings to detect when…