Tootfinder

Manifolds and Modules: How Function Develops in a Neural Foundation Model
Johannes Bertram, Luciano Dyballa, T. Anderson Keller, Savik Kinger, Steven W. Zucker
https://arxiv.org/abs/2512.07869 https://arxiv.org/pdf/2512.07869 https://arxiv.org/html/2512.07869
arXiv:2512.07869v1 Announce Type: new
Abstract: Foundation models have shown remarkable success in fitting biological visual systems; however, their black-box nature inherently limits their utility for under- standing brain function. Here, we peek inside a SOTA foundation model of neural activity (Wang et al., 2025) as a physiologist might, characterizing each 'neuron' based on its temporal response properties to parametric stimuli. We analyze how different stimuli are represented in neural activity space by building decoding man- ifolds, and we analyze how different neurons are represented in stimulus-response space by building neural encoding manifolds. We find that the different processing stages of the model (i.e., the feedforward encoder, recurrent, and readout modules) each exhibit qualitatively different representational structures in these manifolds. The recurrent module shows a jump in capabilities over the encoder module by 'pushing apart' the representations of different temporal stimulus patterns; while the readout module achieves biological fidelity by using numerous specialized feature maps rather than biologically plausible mechanisms. Overall, we present this work as a study of the inner workings of a prominent neural foundation model, gaining insights into the biological relevance of its internals through the novel analysis of its neurons' joint temporal response patterns.
toXiv_bot_toot

Around 56 million years ago,
Earth suddenly got much hotter.
Over about 5,000 years, the amount of carbon in the atmosphere drastically increased and global temperatures shot up by some 6°C.
As we show in new research published in Nature Communications,
one consequence was that many of the world’s plants could no longer thrive.
As a result, they soaked up less carbon from the atmosphere,
which may have contributed to another interesting thing about this pre…

56 million years ago, the Earth suddenly heated up – and many plants stopped working properly
It could be a sign of what’s to come.

In Ukraine, a reporter is working on the front lines when the troops he is interviewing are suddenly overwhelmed by Russian troops.
Escaping from one hideout to another just moments before they explode, the reporter dives into a freshly dug ditch at a cemetery, dug for the many new coffins that are coming.
Somehow, the reporter escapes death and rises from the cemetery to share this report with you.
This is Giorgio, he is a true hero and journalist, reporting from the trenc…