PulseAugur
EN
LIVE 22:41:35

New UI-MOPD method enables cross-platform GUI agent learning · 3 sources tracked

Researchers have developed UI-MOPD, a novel method for training GUI agents that can operate across multiple platforms. This approach addresses the scarcity of cross-platform data and the challenge of maintaining performance on existing platforms while adapting to new ones. UI-MOPD utilizes multi-teacher on-policy distillation, dynamically selecting a platform-specific teacher to transfer knowledge and prevent catastrophic forgetting. Experiments on OSWorld and MobileWorld demonstrated the method's effectiveness, achieving task success rates of 38.2% and 12.0% respectively. AI

IMPACT Enables more versatile and adaptable GUI agents, potentially streamlining cross-platform automation and user interaction.

RANK_REASON The cluster contains an academic paper detailing a new method and dataset for AI research.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

New UI-MOPD method enables cross-platform GUI agent learning · 3 sources tracked

COVERAGE [3]

  1. arXiv cs.AI TIER_1 English(EN) · Niu Lian, Alan Chen, Zhehao Yu, Chengzhen Duan, Fazhan Liu, Hui Liu, Pei Fu, Jian Luan, Yaowei Wang, Shu-Tao Xia, Jinpeng Wang ·

    UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    arXiv:2607.04425v1 Announce Type: cross Abstract: Recent advances in multimodal foundation models and agent systems have driven GUI agents from single-platform task execution toward cross-platform interaction. However, building multi-platform GUI agents remains challenging. On on…

  2. arXiv cs.CL TIER_1 English(EN) · Jinpeng Wang ·

    UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    Recent advances in multimodal foundation models and agent systems have driven GUI agents from single-platform task execution toward cross-platform interaction. However, building multi-platform GUI agents remains challenging. On one hand, high-quality and executable cross-platform…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    Uni-GUI dataset and UI-MOPD method enable cross-platform GUI agent training by addressing limited data and platform-specific capability degradation through multi-teacher on-policy distillation.