Alpaca-Eval
PulseAugur coverage of Alpaca-Eval — every cluster mentioning Alpaca-Eval across labs, papers, and developer communities, ranked by signal.
-
LLM evaluation costs can be 10x baseline workload, study finds
The cost of evaluating large language models (LLMs) is often overlooked, creating a "shadow bill" beyond the direct inference costs. This hidden expense arises from multiple rollouts needed to prove reliability, extensi…
-
BayLing-Duplex enables native full-duplex speech dialogue with single LLM
Researchers have developed BayLing-Duplex, a novel full-duplex speech language model that enables simultaneous listening and speaking without relying on external turn-taking modules. This single autoregressive LLM can m…
-
Researchers explore in-context learning vs. instruction tuning for multilingual models
Researchers are exploring alternatives to traditional instruction tuning for language models, particularly for smaller and multilingual models. One paper investigates the effectiveness of in-context learning (ICL) for i…