Tootfinder

Google debuts Titans, an architecture combining RNN speed with transformer performance for real-time learning, able to scale effectively to a 2M context window (Google Research)
https://research.google/blog/titans-miras-helping-ai-have-long-term-memory/

Titans + MIRAS: Helping AI have long-term memory

Native Hybrid Attention for Efficient Sequence Modeling
Jusen Du, Jiaxi Hu, Tao Zhang, Weigao Sun, Yu Cheng
https://arxiv.org/abs/2510.07019 https://arxiv.…

Native Hybrid Attention for Efficient Sequence Modeling
Transformers excel at sequence modeling but face quadratic complexity, while linear attention offers improved efficiency but often compromises recall accuracy over long contexts. In this work, we introduce Native Hybrid Attention (NHA), a novel hybrid architecture of linear and full attention that integrates both intra \& inter-layer hybridization into a unified layer design. NHA maintains long-term context in key-value slots updated by a linear RNN, and augments them with short-term tokens fro…

Optimised neural networks for online processing of ATLAS calorimeter data on FPGAs
Georges Aad, Raphael Bertrand, Lauri Laatu, Emmanuel Monnier, Arno Straessner, Nairit Sur, Johann C. Voigt
https://arxiv.org/abs/2510.11469

Optimised neural networks for online processing of ATLAS calorimeter data on FPGAs
A study of neural network architectures for the reconstruction of the energy deposited in the cells of the ATLAS liquid-argon calorimeters under high pile-up conditions expected at the HL-LHC is presented. These networks are designed to run on the FPGA-based readout hardware of the calorimeters under strict size and latency constraints. Several architectures, including Dense, Recurrent (RNN), and Convolutional (CNN) neural networks, are optimised using a Bayesian procedure that balances energy …

🇺🇦 #NowPlaying on BBCRadio3's #Breakfast
Trad., Rune Tonsgaard SŸrensen, Frederik Øland, AsbjŸrn NŸrgaard, Fredrik Sjölin & Danish String Quartet:
🎵 As I Walked Out
#Trad #RuneTonsgaardSørensen #FrederikØland #AsbjørnNørgaard #FredrikSjölin #DanishStringQuartet