Tootfinder

Solving Zero-Sum Convex Markov Games
Fivos Kalogiannis, Emmanouil-Vasileios Vlatakis-Gkaragkounis, Ian Gemp, Georgios Piliouras
https://arxiv.org/abs/2506.16120

Solving Zero-Sum Convex Markov Games
We contribute the first provable guarantees of global convergence to Nash equilibria (NE) in two-player zero-sum convex Markov games (cMGs) by using independent policy gradient methods. Convex Markov games, recently defined by Gemp et al. (2024), extend Markov decision processes to multi-agent settings with preferences that are convex over occupancy measures, offering a broad framework for modeling generic strategic interactions. However, even the fundamental min-max case of cMGs presents signi…

On fast Lyapunov spectra for Markov-R\'{e}nyi maps
Lulu Fang, Carlos Gustavo Moreira, Zhichao Wang, Yiwei Zhang
https://arxiv.org/abs/2506.16291 https:…

On fast Lyapunov spectra for Markov-Rényi maps
In this paper, we study the multifractal analysis for Markov-Rényi maps, which form a canonical class of piecewise differentiable interval maps, with countably many branches and may contain a parabolic fixed point simultaneously, and do not assume any distortion hypotheses. We develop a geometric approach, independent of thermodynamic formalism, to study the fast Lyapunov spectrum for Markov-Rényi maps. Our study can be regarded as a refinement of the Lyapunov spectrum at infinity. We demonst…

Die ePetition 178586 an den Bundestag aus dem Bereich Kontrolle von Kriegswaffen und sonstigen Rüstungsgütern mit dem Titel
Keine Lieferung von Taurus-Marschflugkörpern an die Ukraine
kann bis zum Montag 04. August 2025 01:00 UTC mitgezeichnet werden und lautet
Mit der Petition wird gefordert, keine Taurus-Marschflu…

Die ePetition 178586 an den Bundestag aus dem Bereich Kontrolle von Kriegswaffen und sonstigen Rüstungsgütern mit dem Titel
Keine Lieferung von Taurus-Marschflugkörpern an die Ukraine
kann bis zum Montag 04. August 2025 01:00 UTC mitgezeichnet werden und lautet
Mit der Petition wird gefordert, keine Taurus-Marschflu…

Searching for a Hidden Markov Anomaly over Multiple Processes
Levli Citron, Kobi Cohen, Qing Zhao
https://arxiv.org/abs/2506.17108 https://

Searching for a Hidden Markov Anomaly over Multiple Processes
We address the problem of detecting an anomalous process among a large number of processes. At each time t, normal processes are in state zero (normal state), while the abnormal process may be in either state zero (normal state) or state one (abnormal state), with the states being hidden. The transition between states for the abnormal process is governed by a Markov chain over time. At each time step, observations can be drawn from a selected subset of processes. Each probed process generates a…

Transformers Beyond Order: A Chaos-Markov-Gaussian Framework for Short-Term Sentiment Forecasting of Any Financial OHLC timeseries Data
Arif Pathan
https://arxiv.org/abs/2506.17244

Transformers Beyond Order: A Chaos-Markov-Gaussian Framework for Short-Term Sentiment Forecasting of Any Financial OHLC timeseries Data
Short-term sentiment forecasting in financial markets (e.g., stocks, indices) is challenging due to volatility, non-linearity, and noise in OHLC (Open, High, Low, Close) data. This paper introduces a novel CMG (Chaos-Markov-Gaussian) framework that integrates chaos theory, Markov property, and Gaussian processes to improve prediction accuracy. Chaos theory captures nonlinear dynamics; the Markov chain models regime shifts; Gaussian processes add probabilistic reasoning. We enhance the framework…

Instantaneous Failure, Repair and Mobility Rates for Markov Reliability Systems: A Wind-Farm application
Guglielmo D'Amico, Filippo Petroni
https://arxiv.org/abs/2506.17280

Instantaneous Failure, Repair and Mobility Rates for Markov Reliability Systems: A Wind-Farm application
The Rate of Occurrence of Failures (ROCOF) is a widely utilized indicator for assessing a system's performance over time, yet it does not fully disclose the instantaneous behavior of a system. This paper introduces new measures to complement the ROCOF, providing a more comprehensive understanding of system reliability, particularly for Markov systems. We define the Rate of Occurrence of Repairs (ROCOR), which quantifies the system's instantaneous tendency to transition from failure to working s…

Stability of universal properties against perturbations of the Markov Chain Monte Carlo algorithm
Matteo Bacci, Claudio Bonati
https://arxiv.org/abs/2506.18561

Stability of universal properties against perturbations of the Markov Chain Monte Carlo algorithm
We numerically investigate the stability of universal properties at continuous phase transitions against perturbations of the Markov Chain Monte Carlo algorithm used to simulate the system. We consider the three dimensional XY model as test bed, and both local (single site Metropolis) and global (single cluster) updates, introducing deterministic truncation-like perturbations and stochastic perturbations in the acceptance probabilities. In (almost) all the cases we find a remarkable stability o…

Efficient Strategy Synthesis for MDPs via Hierarchical Block Decomposition
Alexandros Evangelidis, Gricel V\'azquez, Simos Gerasimou
https://arxiv.org/abs/2506.17792

Efficient Strategy Synthesis for MDPs via Hierarchical Block Decomposition
Software-intensive systems, such as software product lines and robotics, utilise Markov decision processes (MDPs) to capture uncertainty and analyse sequential decision-making problems. Despite the usefulness of conventional policy synthesis methods, they fail to scale to large state spaces. Our approach addresses this issue and accelerates policy synthesis in large MDPs by dynamically refining the MDP and iteratively selecting the most fragile MDP regions for refinement. This iterative procedu…

Infinite horizon discounted LQ optimal control problems for mean-field switching diffusions
Kai Ding, Xun Li, Siyu Lv, Zuo Quan Xu
https://arxiv.org/abs/2506.16033

Infinite horizon discounted LQ optimal control problems for mean-field switching diffusions
This paper investigates an infinite horizon discounted linear-quadratic (LQ) optimal control problem for stochastic differential equations (SDEs) incorporating regime switching and mean-field interactions. The regime switching is modeled by a finite-state Markov chain acting as common noise, while the mean-field interactions are characterized by the conditional expectation of the state process given the history of the Markov chain. To address system stability in the infinite horizon setting, a …