PulseAugur
EN
LIVE 20:11:15

New framework formalizes risk-aware decision-making in Markov processes

Researchers have introduced risk-aware general-utility Markov decision processes (GUMDPs) to allow agents to optimize risk measures of objective values, enabling a trade-off between expected performance and risk aversion. The proposed framework focuses on the entropic risk measure (ERM) and demonstrates how these risk-aware GUMDPs can be solved using online planning techniques, specifically Monte Carlo Tree Search (MCTS). Experimental results show the approach's effectiveness across various tasks, including standard MDPs, exploration, imitation learning, and multi-objective MDPs. AI

IMPACT Introduces a formal framework for risk-aware decision-making in AI agents, potentially improving robustness in complex environments.

RANK_REASON The cluster contains an academic paper detailing a new theoretical framework and method for Markov decision processes.

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New framework formalizes risk-aware decision-making in Markov processes

COVERAGE [2]

  1. arXiv cs.AI TIER_1 English(EN) · Pedro P. Santos, F\'abio Vital, Alberto Sardinha, Francisco S. Melo ·

    Risk-Aware General-Utility Markov Decision Processes

    arXiv:2607.09298v1 Announce Type: cross Abstract: We study general-utility Markov decision processes (GUMDPs) with risk-aware objectives. In this framework, an agent aims to optimize a risk measure of the distribution of objective values, where the objective function depends on t…

  2. arXiv cs.AI TIER_1 English(EN) · Francisco S. Melo ·

    Risk-Aware General-Utility Markov Decision Processes

    We study general-utility Markov decision processes (GUMDPs) with risk-aware objectives. In this framework, an agent aims to optimize a risk measure of the distribution of objective values, where the objective function depends on the frequency of visitation of states induced by th…