English(EN) Benchmarking General Mobile Assistants in Challenging Real-World Scenarios

新的GMA基准测试揭示了当前移动AI助手的局限性

作者 PulseAugur 编辑部 · [1 个来源] · 2026-08-31 04:00

一项名为GMA的新基准测试已被开发出来，用于评估通用移动AI助手在复杂真实场景中的表现。GMA包含七个应用程序和300个任务，涵盖四个难度级别，旨在比AndroidWorld和MobileWorld等现有基准测试捕捉到更多的多样性和复杂性。对八个前沿模型的评估显示，随着任务复杂性的增加，性能显著下降，表明当前的代理距离可靠满足用户需求还有很长的路要走。研究还强调，适当的工具设计，如上下文保留和显式状态跟踪，可以显著提高代理在要求苛刻的工作流上的性能，尽管有效性因基础模型而异。 AI

影响强调需要更强大的AI代理来处理复杂的、真实的移动任务。

排序理由该集群包含一篇介绍AI代理评估新基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 14 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇介绍AI代理评估新基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, product; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.CV TIER_1 English(EN) · Yiqi Zhu, Feiyu Gao, Jiaxing Fan, Jiahui Zeng, Minggang Wu, Chenliang Li, Haiyang Xu, Peng Li, Ming Yan, Yang Liu · 2026-08-31 04:00

在充满挑战的真实场景中对通用移动助手进行基准测试

arXiv:2608.27477v1 Announce Type: cross Abstract: Graphical user interfaces have emerged as an important environment for evaluating autonomous AI agents on multimodal interactive tasks. Existing benchmarks such as AndroidWorld and MobileWorld provide strong foundations for mobile…

本文如何被排名

报道来源 [1]

在充满挑战的真实场景中对通用移动助手进行基准测试

相关实体

相关话题