Tootfinder

Erasing Classical Memory with Quantum Fluctuations: Shannon Information Entropy of Reverse Quantum Annealing
Elijah Pelofske, Cristiano Nisoli
https://arxiv.org/abs/2509.10927 h…

Erasing Classical Memory with Quantum Fluctuations: Shannon Information Entropy of Reverse Quantum Annealing
Quantum annealers can provide non-local optimization by tunneling between states in a process that ideally eliminates memory of the initial configuration. We study the crossover between memory loss and retention due to quantum fluctuations, in a transverse Ising model on odd numbered antiferromagnetic rings of thousands of spins with periodic boundary conditions, by performing reverse quantum annealing experiments on three programmable superconducting flux qubit quantum annealers. After initial…

Two tales for a geometric Jensen--Shannon divergence
Frank Nielsen
https://arxiv.org/abs/2508.05066 https://arxiv.org/pdf/2508.05066

Two tales for a geometric Jensen--Shannon divergence
The geometric Jensen--Shannon divergence (G-JSD) gained popularity in machine learning and information sciences thanks to its closed-form expression between Gaussian distributions. In this work, we introduce an alternative definition of the geometric Jensen--Shannon divergence tailored to positive densities which does not normalize geometric mixtures. This novel divergence is termed the extended G-JSD as it extends to more general positive measures. We give explicitly the gap between the extend…

Information-Theoretic Graph Fusion with Vision-Language-Action Model for Policy Reasoning and Dual Robotic Control
Shunlei Li, Longsen Gao, Jin Wang, Chang Che, Xi Xiao, Jiuwen Cao, Yingbai Hu, Hamid Reza Karimi
https://arxiv.org/abs/2508.05342

Information-Theoretic Graph Fusion with Vision-Language-Action Model for Policy Reasoning and Dual Robotic Control
Teaching robots dexterous skills from human videos remains challenging due to the reliance on low-level trajectory imitation, which fails to generalize across object types, spatial layouts, and manipulator configurations. We propose Graph-Fused Vision-Language-Action (GF-VLA), a framework that enables dual-arm robotic systems to perform task-level reasoning and execution directly from RGB and Depth human demonstrations. GF-VLA first extracts Shannon-information-based cues to identify hands and …

Minimizing and Maximizing the Shannon Entropy for Fixed Marginals
Paula Franke, Kay Hamacher, Paul Manns
https://arxiv.org/abs/2509.05099 https://arxiv.org…

Minimizing and Maximizing the Shannon Entropy for Fixed Marginals
The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distribution is the variable part under fixed marginals. We aim to minimize and maximize it to obtain the largest and smallest MI possible in this case, leading to a scaled MI ratio for better comparability. We present algorithmic approaches and optimal solutions for a set of problem instances based on data from molecular evolution. We show th…

Disentangling Vortex-driven Dynamics in the Solar Atmosphere Using Information Theory
Suzana S. A. Silva, Erico Rempel, Gary Verth, Istvan Ballai, Viktor Fedun
https://arxiv.org/abs/2509.04329

Disentangling Vortex-driven Dynamics in the Solar Atmosphere Using Information Theory
Solar tornadoes are believed to influence plasma dynamics and create conditions for heating, yet a direct quantitative link is lacking. Here, for the first time, we directly measure vortex-driven dynamics using information-theoretic diagnostics in a Bifrost simulation. By combining Shannon Entropy (SE) and Normalized Mutual Information (NMI), we track how vortices restructure plasma-magnetic interactions and channel energy into heat. The vortex flow originates in the upper photosphere and exten…

Revisiting the Question of Information Content of EXAFS Spectra through a Bayesian Approach
Lucy Haddad, Diego Gianolio, Andrei Sapelkin
https://arxiv.org/abs/2509.07950 https:/…

Revisiting the Question of Information Content of EXAFS Spectra through a Bayesian Approach
Over the last several decades the Shannon-Nyquist criterion has been widely used as a measure of the maximum information content in EXAFS spectra and provided an upper limit on the number of parameters used in fitting data. However, the criterion implicitly assumes independent parameters which is never the case in EXAFS analysis. Here we introduce a new criterion to measure the information content in EXAFS based on Bayesian approach that lifts the above condition. We test the new criterion by f…

Exploiting Information Redundancy in Attention Maps for Extreme Quantization of Vision Transformers
Lucas Maisonnave, Karim Haroun, Tom Pegeot
https://arxiv.org/abs/2508.16311 h…

Exploiting Information Redundancy in Attention Maps for Extreme Quantization of Vision Transformers
Transformer models rely on Multi-Head Self-Attention (MHSA) mechanisms, where each attention head contributes to the final representation. However, their computational complexity and high memory demands due to MHSA hinders their deployment at the edge. In this work, we analyze and exploit information redundancy in attention maps to accelerate model inference. By quantifying the information captured by each attention head using Shannon entropy, our analysis reveals that attention heads with lowe…

Energy and information: a chronicle of hesitations on the role of the observer in physics
Didier Lairez
https://arxiv.org/abs/2509.06957 https://arxiv.org/…

Energy and information: a chronicle of hesitations on the role of the observer in physics
Energy has no definition, except that given by a conservation principle which essentially amounts to defining it as the elements of an open list of unknown cardinality. Entropy, identified by Shannon as information we lack, has too many definitions. This results in an unstable and hesitant interpretation of their link. Thermodynamics, the science of changes in form of energy, is phenomenological, all its laws are induced from observation. From the origin, the concept of energy is linked to th…

Back to Bits: Extending Shannon's communication performance framework to computing
Max Hawkins, Richard Vuduc
https://arxiv.org/abs/2508.05621 https://…

Back to Bits: Extending Shannon's communication performance framework to computing
This work proposes a novel computing performance unit grounded in information theory. Modern computing systems are increasingly diverse, supporting low-precision formats, hardware specialization, and emerging paradigms such as analog, quantum, and reversible logic. Traditional metrics like floating-point operations (flops) no longer accurately capture this complexity. We frame computing as the transformation of information through a channel and define performance in terms of the mutual informat…

Zero-Error Nash Equilibrium: Harnessing Nonlocal Correlation in Incomplete Information Games
Ambuj, Tushar, Siddharth R. Pandey, Ram Krishna Patra, Anandamay Das Bhowmik, Kuntal Som, Amit Mukherjee
https://arxiv.org/abs/2509.02947

Zero-Error Nash Equilibrium: Harnessing Nonlocal Correlation in Incomplete Information Games
Claude Shannon's zero-error communication paradigm reshaped our understanding of fault-tolerant information transfer. Here, we adapt this notion into game theory with incomplete information. We ask: can players with private information coordinate on a Nash equilibrium with zero probability of error? We identify Bayesian games in which such coordination is impossible classically, yet achievable by harnessing Bell nonlocal correlations. We formalize this requirement as zero-error Nash equilibrium…

Entropy measures as indicators of connectivity paths in the human brain
Ania Mesa-Rodr\'iguez, Ernesto Estevez-Rams, Holger Kantz
https://arxiv.org/abs/2507.04442

Entropy measures as indicators of connectivity paths in the human brain
How does the information flow between different brain regions during various stimuli? This is the question we aim to address by studying complex cognitive paradigms in terms of Information Theory. To assess creativity and the emergence of patterns from a Shannon perspective, we applied a range of tools, including Entropy Density, Effective Measure Complexity, and the Lempel-Ziv distance. These entropic tools enable the detection of both linear and non-linear dynamics without relying on pre-esta…

Enhancing Mega-Satellite Networks with Generative Semantic Communication: A Networking Perspective
Binquan Guo, Wanting Yang, Zehui Xiong, Zhou Zhang, Baosheng Li, Zhu Han, Rahim Tafazolli, Tony Q. S. Quek
https://arxiv.org/abs/2508.07573

Enhancing Mega-Satellite Networks with Generative Semantic Communication: A Networking Perspective
The advance of direct satellite-to-device communication has positioned mega-satellite constellations as a cornerstone of 6G wireless communication, enabling seamless global connectivity even in remote and underserved areas. However, spectrum scarcity and capacity constraints imposed by the Shannon's classical information theory remain significant challenges for supporting the massive data demands of multimedia-rich wireless applications. Generative Semantic Communication (GSC), powered by artif…

Additivity of quantum relative entropies as a single-copy criterion
Salman Beigi, Roberto Rubboli, Marco Tomamichel
https://arxiv.org/abs/2507.05696 https:…

Additivity of quantum relative entropies as a single-copy criterion
The fundamental goal of information theory is to characterize complex operational tasks using efficiently computable information quantities, Shannon's capacity formula being the prime example of this. However, many tasks in quantum information can only be characterized by regularized entropic measures that are often not known to be computable and for which efficient approximations are scarce. It is thus of fundamental importance to understand when regularization is not needed, opening the door …

Patterns and Dynamics of Netflix TV Show Popularity
Nahyeon Lee, Jongsoo Lim, Hyeong-Chai Jeong
https://arxiv.org/abs/2507.01620 https://

Patterns and Dynamics of Netflix TV Show Popularity
We investigate the global dynamics of media consumption by analyzing daily top-ranked Netflix TV shows across 71 countries over a span of 822 days. Using an information-theoretic framework, we quantify diversity, similarity, and directional influence in consumption trends through three core measures, Shannon entropy, mutual information, and Kullback-Leibler (KL) divergence. Entropy reveals that content diversity varies by region, with North America and Europe exhibiting highly dynamic viewing p…

Bounds of Shannon entropy and Extropy and their application in exploring the extreme value behavior of a large set of data
Konstantinos Zografos
https://arxiv.org/abs/2507.13656

Bounds of Shannon entropy and Extropy and their application in exploring the extreme value behavior of a large set of data
This paper derives bounds for two omnipresent information theoretic measures, the Shannon entropy and its complementary dual, the extropy. Based on a large size data set from a logconcave model, the said bounds are obtained for the entropy and the extropy of the distribution of the largest order statistic and the respective normalized sequence, in the extreme value theory setting. A characterization of the exponential distribution is provided as the model that maximizes the Shannon entropy and …

Local interface effects modulate global charge order and optical properties of 1T-TaS$_2$/1H-WSe$_2$ heterostructures
Samra Husremovi\'c, Valerie S. McGraw, Medha Dandu, Lilia S. Xie, Sae Hee Ryu, Oscar Gonzalez, Shannon S. Fender, Madeline Van Winkle, Karen C. Bustillo, Takashi Taniguchi, Kenji Watanabe, Chris Jozwiak, Aaron Bostwick, Eli Rotenberg, Archana Raja, Katherine Inzani, D. Kwabena Bediako

Local interface effects modulate global charge order and optical properties of 1T-TaS$_2$/1H-WSe$_2$ heterostructures
1T-TaS$_2$ is a layered charge density wave (CDW) crystal exhibiting sharp phase transitions and associated resistance changes. These resistance steps could be exploited for information storage, underscoring the importance of controlling and tuning CDW states. Given the importance of out-of-plane interactions in 1T-TaS$_2$, modulating interlayer interactions by heterostructuring is a promising method for tailoring CDW phase transitions. In this work, we investigate the optical and electronic pr…

Replaced article(s) found for cs.IT. https://arxiv.org/list/cs.IT/new
[1/1]:
- Metrization of powers of the Jensen-Shannon divergence
Kazuki Okamura

Constraints on Lorentz Invariance Violation from GRB 221009A Using the DisCan Method
Yu Xi, Fu-Wen Shu
https://arxiv.org/abs/2508.00656 https://arxiv.org/p…

Constraints on Lorentz Invariance Violation from GRB 221009A Using the DisCan Method
Lorentz symmetry is a cornerstone of modern physics, and testing its validity remains a critical endeavor. In this work, we analyze the photon time-of-flight and time-shift data from LHAASO observations of Gamma-Ray Burst GRB 221009A to search for signatures of Lorentz violation. We employed the DisCan (dispersion cancellation) method with various information entropies as cost functions, designating the results obtained with Shannon entropy as our representative outcome. This choice is attribut…

Do triangles matter? Replicating hypergraph disease dynamics with lower-order interactions
Eugene Tan, Michael Small, Shannon D. Algar
https://arxiv.org/abs/2508.20380 https://

Do triangles matter? Replicating hypergraph disease dynamics with lower-order interactions
Disease spreading models such as the ubiquitous SIS compartmental model and its numerous variants are widely used to understand and predict the behaviour of a given epidemic or information diffusion process. A common approach to imbue more realism to the spreading process is to constrain simulations to a network structure, where connected nodes update their disease state based on pairwise interactions along the edges of their local neighbourhood. Simplicial contagion models (SCM) extend this to…

Information Theoretic Analysis of a Dual-Band MIMO Cellphone Antenna with ANSYS HFSS SBR
Volodymyr Shyianov, Bamelak Tadele, Vladimir I. Okhmatovski, Amine Mezghani
https://arxiv.org/abs/2507.14704

Information Theoretic Analysis of a Dual-Band MIMO Cellphone Antenna with ANSYS HFSS SBR+
Historically, the design of antenna arrays has evolved separately from Shannon theory. Shannon theory adopts a probabilistic approach in the design of communication systems, while antenna design approaches have relied on the deterministic Maxwell theory alone. In this paper, we investigate an information-theoretic analysis approach which we apply to evaluate the design of a dual-band, dual-polarized multiple-input multiple-output (MIMO) array on a cellphone. To this end, we use ANSYS HFSS, a co…

Replaced article(s) found for cs.IT. https://arxiv.org/list/cs.IT/new
[1/1]:
- Two tales for a geometric Jensen--Shannon divergence
Frank Nielsen
https://

Capacity Based Design of Slot Array Antennas
Volodymyr Shyianov, Bamelak Tadele, Vladimir I. Okhmatovski, Faouzi Bellili, Amine Mezghani
https://arxiv.org/abs/2506.17845

Capacity Based Design of Slot Array Antennas
Historically, the design of antenna arrays has evolved separately from Shannon theory. Shannon theory adopts a probabilistic approach in the design of communication systems, while antenna design approaches have relied on deterministic Maxwell theory alone. In this paper, we introduce a new approach to the design of antenna arrays based on information theoretic metrics. To this end, we develop a statistical model suitable for the numerical optimization of antenna systems. The model is utilized t…

The Relationship between Cognition and Computation: "Global-first" Cognition versus Local-first Computation
Lin Chen
https://arxiv.org/abs/2506.17970

The Relationship between Cognition and Computation: "Global-first" Cognition versus Local-first Computation
What fundamental research questions are essential for advancing toward brain-like AI or AGI (Artificial General Intelligence) capable of performing any intellectual task a human can? Should it be something like the Turing machine (1936), which answers the question "What is computation?" and lays the foundation for the entire field of computer science? Or should it be something like Shannon's mathematical theory of communication (1948), which answers the question "What is information?" and forms…

End-to-End Learning of Probabilistic Constellation Shaping through Importance Sampling
Shrinivas Chimmalgi, Laurent Schmalen, Vahid Aref
https://arxiv.org/abs/2506.16098

End-to-End Learning of Probabilistic Constellation Shaping through Importance Sampling
Probabilistic constellation shaping enables easy rate adaption and has been proven to reduce the gap to Shannon capacity. Constellation point probabilities are optimized to maximize either the mutual information or the bit-wise mutual information. The optimization problem is however challenging even for simple channel models. While autoencoder-based machine learning has been applied successfully to solve this problem [1], it requires manual computation of additional terms for the gradient which…

Round-Preserving Asymptotic Compression of Prior-Free Interactive Protocols
Gurleen Padda, Dave Touchette
https://arxiv.org/abs/2507.13464 https://

Round-Preserving Asymptotic Compression of Prior-Free Interactive Protocols
There is a close relationship between the communication complexity and information complexity of communication problems, as demonstrated by results such as Shannon's noiseless source coding theorem, and the Slepian-Wolf theorem. Here, we study this relationship in the prior-free and interactive setting, where we provide an alternate proof for the result of Braverman [SIAM Review, vol. 59, no. 4, 2017], that the amortized communication complexity of simulating a prior-free interactive communicat…