Tootfinder

Omega-regular Verification and Control for Distributional Specifications in MDPs
S. Akshay (Dept of CSE, Indian Institute of Technology Bombay), Ouldouz Neysari (Singapore Management University, University of Tehran), {\DJ}or{\dj}e \v{Z}ikeli\'c (Singapore Management University)
https://arxiv.org/abs/2507.04286

Omega-regular Verification and Control for Distributional Specifications in MDPs
A classical approach to studying Markov decision processes (MDPs) is to view them as state transformers. However, MDPs can also be viewed as distribution transformers, where an MDP under a strategy generates a sequence of probability distributions over MDP states. This view arises in several applications, even as the probabilistic model checking problem becomes much harder compared to the classical state transformer counterpart. It is known that even distributional reachability and safety probl…