Researchers have introduced MAGE, a framework designed to enhance the capabilities of computer use agents (CUAs) by leveraging user manuals. MAGE improves agent performance on new software by using manuals for both execution and training, reducing the need for human-annotated data. The system retrieves relevant manual content to guide agent actions and adapts the policy through interaction with the environment. For training, MAGE converts manuals into executable task-plan pairs, which then guide the agent's learning process. Experiments across six applications show MAGE's effectiveness in increasing task success rates compared to existing baselines. AI
IMPACT This framework could significantly reduce the cost and effort required to train AI agents for new software applications.
RANK_REASON The cluster contains an academic paper detailing a new framework for AI agents. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →