Tootfinder

Bridging Classical and Learning-based Iterative Registration through Deep Equilibrium Models
Yi Zhang, Yidong Zhao, Qian Tao
https://arxiv.org/abs/2507.00582

Bridging Classical and Learning-based Iterative Registration through Deep Equilibrium Models
Deformable medical image registration is traditionally formulated as an optimization problem. While classical methods solve this problem iteratively, recent learning-based approaches use recurrent neural networks (RNNs) to mimic this process by unrolling the prediction of deformation fields in a fixed number of steps. However, classical methods typically converge after sufficient iterations, but learning-based unrolling methods lack a theoretical convergence guarantee and show instability empir…

Organizational Regularities in Recurrent Neural Networks
Claus Metzner, Achim Schilling, Andreas Maier, Patrick Krauss
https://arxiv.org/abs/2505.22047 htt…

Organizational Regularities in Recurrent Neural Networks
Previous work has shown that the dynamical regime of Recurrent Neural Networks (RNNs) - ranging from oscillatory to chaotic and fixpoint behavior - can be controlled by the global distribution of weights in connection matrices with statistically independent elements. However, it remains unclear how network dynamics respond to organizational regularities in the weight matrix, as often observed in biological neural networks. Here, we investigate three such regularities: (1) monopolar output weigh…

This https://arxiv.org/abs/2506.02475 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csLG_…

Comba: Improving Nonlinear RNNs with Closed-loop Control
Recent efficient sequence modeling methods such as Gated DeltaNet, TTT, and RWKV-7 have achieved performance improvements by supervising the recurrent memory management through Delta learning rule. Unlike previous state-space models (e.g., Mamba) and gated linear attentions (e.g., GLA), these models introduce interactions between the recurrent state and the key vector, resulting in a nonlinear recursive structure. In this paper, we first introduce the concept of Nonlinear RNNs with a comprehens…

RCNet: $\Delta\Sigma$ IADCs as Recurrent AutoEncoders
Arnaud Verdant, William Guicquero, J\'er\^ome Chossat
https://arxiv.org/abs/2506.16903 https://…

RCNet: $ΔΣ$ IADCs as Recurrent AutoEncoders
This paper proposes a deep learning model (RCNet) for Delta-Sigma ($ΔΣ$) ADCs. Recurrent Neural Networks (RNNs) allow to describe both modulators and filters. This analogy is applied to Incremental ADCs (IADC). High-end optimizers combined with full-custom losses are used to define additional hardware design constraints: quantized weights, signal saturation, temporal noise injection, devices area. Focusing on DC conversion, our early results demonstrate that $SNR$ defined as an Effective Numb…

Transient Dynamics in Lattices of Differentiating Ring Oscillators
Peter DelMastro, Arjun Karuvally, Hananel Hazan, Hava Siegelmann, Edward Rietman
https://arxiv.org/abs/2506.07253

Transient Dynamics in Lattices of Differentiating Ring Oscillators
Recurrent neural networks (RNNs) are machine learning models widely used for learning temporal relationships. Current state-of-the-art RNNs use integrating or spiking neurons -- two classes of computing units whose outputs depend directly on their internal states -- and accordingly there is a wealth of literature characterizing the behavior of large networks built from these neurons. On the other hand, past research on differentiating neurons, whose outputs are computed from the derivatives of …

This https://arxiv.org/abs/2505.22083 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_qu…

Hyperbolic recurrent neural network as the first type of non-Euclidean neural quantum state ansatz
In this work, we introduce the first type of non-Euclidean neural quantum state (NQS) ansatz, in the form of the hyperbolic GRU (a variant of recurrent neural networks (RNNs)), to be used in the Variational Monte Carlo method of approximating the ground state wavefunction for quantum many-body systems. In particular, we examine the performances of NQS ansatzes constructed from both conventional or Euclidean RNN/GRU and from hyperbolic GRU in the prototypical settings of the one- and two-dimensi…

This https://arxiv.org/abs/2502.17433 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_qbi…

Dynamical phases of short-term memory mechanisms in RNNs
Short-term memory is essential for cognitive processing, yet our understanding of its neural mechanisms remains unclear. Neuroscience has long focused on how sequential activity patterns, where neurons fire one after another within large networks, can explain how information is maintained. While recurrent connections were shown to drive sequential dynamics, a mechanistic understanding of this process still remains unknown. In this work, we introduce two unique mechanisms that can support this f…