safety benchmarks
PulseAugur coverage of safety benchmarks — every cluster mentioning safety benchmarks across labs, papers, and developer communities, ranked by signal.
-
New HiRoute Framework Enhances LLM Safety Alignment
Researchers have developed HiRoute, a novel hierarchical prompt-tuning framework designed to enhance the safety alignment of large language models (LLMs). This framework utilizes an input-adaptive approach, employing a …
-
Hugging Face paper defines limits of AI red-teaming evaluations
A new paper from Hugging Face introduces the concept of an "evidential ceiling" to quantify the limits of AI red-team evaluations. This ceiling determines how much belief can shift based on an evaluation's results withi…
-
Researchers develop test-time safety alignment for LLMs using input embeddings
Researchers have developed a novel method for enhancing the safety of aligned AI models by manipulating input word embeddings. This technique uses gradient descent on embeddings, guided by a black-box text moderation AP…