A new research paper evaluates the effectiveness of computer-use agents, specifically OLLA, for blind users interacting with desktop applications. In a three-week study involving 8 blind users, OLLA processed 1,258 commands across 12 applications. The study found that GPT-5 achieved the highest success rate at 52.5%, though trace analysis indicated failures in grounding, planning, and constraint tracking. User interviews also highlighted needs beyond simple automation. AI
IMPACT This research highlights the potential of AI agents to improve accessibility for visually impaired users, while also identifying key areas for future development in agent reliability and user experience.
RANK_REASON Research paper evaluating AI agent performance on a specific user group and task. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →