New method enhances policy synthesis for continuous systems using temporal logic

Researchers have developed a novel approach to policy synthesis for continuous-state stochastic dynamic systems, addressing high-level specifications using linear temporal logic. Their method involves composing the dynamic system with an automaton derived from the specification and solving an optimal planning problem on the resulting product system. To overcome sparse rewards in this hybrid state space, they introduce a generalized optimal backup order that guides value backups and accelerates learning, while preserving optimality. An actor-critic reinforcement learning algorithm is presented, utilizing the augmented Lagrangian method for policy evaluation and employing modular learning with individual neural networks for each automaton state to avoid spurious ordinal relationships. AI

影响 This research could lead to more robust and efficient AI systems capable of handling complex, high-level specifications in continuous environments.

排序理由 The cluster contains an academic paper detailing a new methodology for AI research. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

• CartPole
• Dubins car
• Lening Li

• 论文
• 其他

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →