Researchers have developed a new method for improving on-policy distillation (OPD) for multi-turn tool-use agents. This technique casts successful-reference selection as a free-target optimal transport problem, aiming to match failed trajectories with the most compatible successful ones. By using action-sequence alignment, specifically the longest common subsequence (LCS) algorithm, as a proxy for compatibility, the method identifies a shared action backbone while allowing for detours. Experiments on ALFWorld and $\tau^3$-bench demonstrated that LCS improves performance over reference-free OPD and shows transferability to new domains. AI
IMPACT This research could lead to more effective training methods for AI agents that use tools, potentially improving their performance in complex, multi-turn tasks.
RANK_REASON The cluster contains a research paper detailing a new method for AI agent training. [lever_c_demoted from research: ic=1 ai=1.0]
- ALFWorld
- $au^3$-bench
- free-target optimal transport
- longest common subsequence problem
- On-Policy Distillation
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →