English(EN) ScreenSearch: Uncertainty-Aware OS Exploration

ScreenSearch系统改进了AI代理对桌面GUI的探索

作者 PulseAugur 编辑部 · [1 个来源] · 2026-05-15 14:58

研究人员开发了ScreenSearch，一个旨在改进AI代理对桌面图形用户界面（GUI）状态探索的新颖系统。该系统解决了部分可观察性带来的挑战，在这种情况下，视觉上相似的屏幕可能代表不同的底层工作流状态，导致局部合理操作产生不可预测的结果。ScreenSearch结合了结构化屏幕检索和去重，以及一个具有歧义感知能力的图-赌博机算法，以管理大规模桌面探索，在十一个应用程序中收集了超过一百万张截图和三万个去重状态。 AI

影响通过改进状态探索和减少歧义，增强了AI代理与复杂桌面环境交互的能力。

排序理由该集群包含一篇详细介绍AI代理探索新系统的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇详细介绍AI代理探索新系统的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, product, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 117 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Justin Wagle · 2026-05-15 14:58

ScreenSearch：不确定性感知操作系统探索

Desktop GUI agents operate under partial observability: visually similar screens can correspond to different underlying workflow states, so locally plausible actions can lead to sharply different outcomes. We frame this as a problem of computer/OS state exploration, where effecti…

本文如何被排名

报道来源 [1]

ScreenSearch：不确定性感知操作系统探索

相关实体

相关话题