partially observable Markov decision process
PulseAugur coverage of partially observable Markov decision process — every cluster mentioning partially observable Markov decision process across labs, papers, and developer communities, ranked by signal.
- 2026-05-13 research_milestone A new framework for adaptive mine planning using POMDPs was proposed in a research paper. source
4 day(s) with sentiment data
-
Research Paper Highlights Exponential Hardness in Off-Policy Evaluation
A new research paper published on arXiv explores the inherent difficulty in evaluating off-policy performance in partially observable Markov decision processes (POMDPs) when the logging mechanism depends on historical d…
-
New TRUST-SQL framework enables Text-to-SQL over unknown schemas
Researchers have developed TRUST-SQL, a novel framework for Text-to-SQL parsing that operates effectively even with unknown database schemas. This system uses a structured four-phase protocol and a Dual-Track GRPO strat…
-
New AI model learns automated intrusion response for industrial systems
Researchers have developed a new method for automatically responding to cyberattacks on Operational Technology (OT) systems, which are crucial for monitoring and controlling industrial processes. The approach models int…
-
New Belief-State Engine Enhances LLM Planning in Uncertain Environments
Researchers have introduced the Belief-State Engine (BSE), an architectural modification designed to enhance the planning capabilities of Large Language Models (LLMs) in partially observable environments. The BSE functi…
-
LLM AI agents bypass complex probability calculations despite theoretical frameworks
Large Language Models (LLMs) used in AI agents do not inherently calculate probabilities, despite theoretical frameworks like Partially Observable Markov Decision Processes (POMDPs) suggesting they should. While POMDPs …
-
New framework defines canonical world models for AI agents
This paper introduces a framework for understanding world models in reinforcement learning by categorizing them based on the channel they model: the environment, the agent, or the joint agent-environment system. Utilizi…
-
New method simplifies partial observability in reinforcement learning
Researchers have developed a method called Minimal Markovization to address the challenge of agents acting under partial observability. This technique characterizes the minimal Markov sufficient statistic for holonomy-c…
-
New method enables AI agents to learn complex hidden-state systems
Researchers have developed a new method for autonomous agents to learn and reason about systems with hidden states, a problem often framed as learning a discrete Partially Observable Markov Decision Process (POMDP). The…
-
New research highlights AI's struggle with ambiguous user tasks
A new research paper introduces a framework for evaluating language models' ability to align with user tasks, even when those tasks are ambiguous or incompletely specified. Formalized as a partially observable Markov de…
-
New method accelerates Bayesian inference on edge GPUs with up to 5x speedup
Researchers have developed a new hardware-oriented methodology to accelerate Bayesian inference on embedded GPUs, addressing the computational cost that typically hinders deployment on resource-constrained edge devices.…
-
VOiLA framework uses diffusion models for robot planning under uncertainty
Researchers have developed VOiLA, a new framework for planning under uncertainty using learned diffusion models for POMDP agents. VOiLA learns task-agnostic POMDP models by employing conditional diffusion models for tra…
-
New POMDP Framework Optimizes Lithium Production Under Uncertainty
Researchers have developed a new framework using a partially observable Markov decision process (POMDP) to optimize lithium production decisions. This approach addresses uncertainties in geology, demand, and pricing, wh…
-
OmniAgent uses active perception for efficient video understanding · 2 sources tracked
Researchers have introduced OmniAgent, a novel omni-modal agent designed for video understanding that utilizes an iterative Observation-Thought-Action cycle based on Partially Observable Markov Decision Processes (POMDP…
-
New POMDP framework enables adaptive mine planning under geological uncertainty
Researchers have developed a new framework for mine planning that adapts to geological uncertainty by treating it as an active component of value creation. This approach uses a Partially Observable Markov Decision Proce…
-
New theory separates prediction, compression, and empowerment in AI agency
A new paper proposes a theoretical framework for understanding agency in AI systems operating under partial observability. The research introduces the concept of 'bridge interfaces' to model how agents interact with the…
-
New causal models offer framework for digital economy policy simulation
Researchers have introduced two novel classes of causal models designed for decision-making agents, termed Structural Causal Decision Models (SCDMs) and Structural Causal Decision Processes (SCDPs). These models expand …
-
AI routing framework boosts LEO satellite network performance and efficiency
Researchers have developed a novel spatial-temporal learning-based distributed routing framework designed for dynamic Low Earth Orbit (LEO) satellite networks. This framework integrates Graph Attention Networks (GAT) an…
-
Robotics research uses neural beliefs for robust grasping under uncertainty
Researchers have developed a new method for robust dexterous grasping in robotics by employing variational neural belief parameterizations. This approach models uncertainty in contact parameters and object pose using a …