Tootfinder

A Riemannian AdaGrad-Norm Method
Glaydston de C. Bento, Geovani N. Grapiglia, Mauricio S. Louzeiro, Daoping Zhang
https://arxiv.org/abs/2509.19682 https://…

A Riemannian AdaGrad-Norm Method
We propose a manifold AdaGrad-Norm method (\textsc{MAdaGrad}), which extends the norm version of AdaGrad (AdaGrad-Norm) to Riemannian optimization. In contrast to line-search schemes, which may require several exponential map computations per iteration, \textsc{MAdaGrad} requires only one. Assuming the objective function $f$ has Lipschitz continuous Riemannian gradient, we show that the method requires at most $\mathcal{O}(\varepsilon^{-2})$ iterations to compute a point $x$ such that $\|\…

A regret minimization approach to fixed-point iterations
Joon Kwon
https://arxiv.org/abs/2509.21653 https://arxiv.org/pdf/2509.21653

A regret minimization approach to fixed-point iterations
We propose a conversion scheme that turns regret minimizing algorithms into fixed point iterations, with convergence guarantees following from regret bounds. The resulting iterations can be seen as a grand extension of the classical Krasnoselskii--Mann iterations, as the latter are recovered by converting the Online Gradient Descent algorithm. This approach yields new simple iterations for finding fixed points of non-self operators. We also focus on converting algorithms from the AdaGrad family…

Exploring the Relationship between Brain Hemisphere States and Frequency Bands through Deep Learning Optimization Techniques
Robiul Islam, Dmitry I. Ignatov, Karl Kaberg, Roman Nabatchikov
https://arxiv.org/abs/2509.14078

Exploring the Relationship between Brain Hemisphere States and Frequency Bands through Deep Learning Optimization Techniques
This study investigates classifier performance across EEG frequency bands using various optimizers and evaluates efficient class prediction for the left and right hemispheres. Three neural network architectures - a deep dense network, a shallow three-layer network, and a convolutional neural network (CNN) - are implemented and compared using the TensorFlow and PyTorch frameworks. Results indicate that the Adagrad and RMSprop optimizers consistently perform well across different frequency bands,…