LLM guardrails
PulseAugur coverage of LLM guardrails — every cluster mentioning LLM guardrails across labs, papers, and developer communities, ranked by signal.
1 天有情绪数据
-
Databricks adds AI cost controls and safety guardrails to Unity AI Gateway
Databricks has introduced new AI governance features within its Unity AI Gateway, focusing on cost controls and safety. The platform now offers proactive budget alerts at various granularities, including user, workspace…
-
Forge 项目将 8B 模型在 agentic 任务上的表现提升至 99%
Forge 项目是一个新的开源工具，显著提高了小型语言模型在复杂 agentic 任务上的性能。通过集成 guardrails，一个拥有 80 亿参数的模型在这些具有挑战性的基准测试中的成功率从 53% 跃升至 99%。这一进展为提高更易于访问的 AI 模型的能力提供了一种有前景的方法。
-
AI agents use memory and guardrails for smarter, safer development
This article discusses how to build smarter and safer AI agents by implementing memory and guardrails. It details the use of message history and working memory for agent recall, alongside prompt injection detection to e…
-
AWS Bedrock LLM 护栏需要双层检测以应对高级攻击
一位开发者发现 AWS Bedrock 内置的护栏不足以应对高级提示注入攻击。单层过滤难以处理多轮对话和间接注入，即恶意内容嵌入检索到的数据中。为解决此问题，开发了一种双重检测模式，结合了分析完整对话上下文的语义意图分类器以及 Bedrock 现有的输入和输出过滤器。