研究人员推出OS-SPEAR，一个旨在严格评估操作系统代理的新工具包。该工具包横跨四个关键维度评估代理：安全、性能、效率和鲁棒性。OS-SPEAR包含每个领域的专用数据集和一个生成诊断报告的自动化分析工具。对22个操作系统代理的评估揭示了效率与安全或鲁棒性之间普遍存在的权衡。 AI
影响 为评估操作系统代理提供了一个标准化框架，这对于开发更可靠、更高效的AI系统至关重要。
排序理由 该集群描述了一篇介绍用于评估操作系统代理的工具包的新学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2604.24348v1 Announce Type: new Abstract: The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS agents navigating complex GUIs. However, the transition of these agents into tr…
The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS agents navigating complex GUIs. However, the transition of these agents into trustworthy daily partners is hindered by a lack o…