Tootfinder

Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients
Johannes M\"uller, Semih \c{C}ayc{\i}, Guido Mont\'ufar
https://arxiv.org/abs/2403.19448

Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients
Kakade's natural policy gradient method has been studied extensively in the last years showing linear convergence with and without regularization. We study another natural gradient method which is based on the Fisher information matrix of the state-action distributions and has received little attention from the theoretical side. Here, the state-action distributions follow the Fisher-Rao gradient flow inside the state-action polytope with respect to a linear potential. Therefore, we study Fisher…