Tootfinder

This https://arxiv.org/abs/2304.00848 has been replaced.
link: https://scholar.google.com/scholar?q=a

Towards Goal-Oriented Semantic Communications: New Metrics, Open Challenges, and Future Research Directions
Since Shannon's pioneering masterpiece which established the prototype of modern information theory, the goal of communications has long been promising accurate message reconstruction at a refined bit-by-bit level, which deliberately neglects the semantics/effectiveness aspect of information. Nevertheless, the recent development of wireless technologies and the spurt of deep learning (DL) techniques allow us to reclaim the meaning/usefulness aspect in the design of future 6G communication parad…

This https://arxiv.org/abs/2202.09393 has been replaced.
link: https://scholar.google.com/scholar?q=a

Information Decomposition Diagrams Applied beyond Shannon Entropy: A Generalization of Hu's Theorem
In information theory, one major goal is to find useful functions that summarize the amount of information contained in the interaction of several random variables. Specifically, one can ask how the classical Shannon entropy, mutual information, and higher interaction information relate to each other. This is answered by Hu's theorem, which is widely known in the form of information diagrams: it relates shapes in a Venn diagram to information functions, thus establishing a bridge from set theor…

This https://arxiv.org/abs/1908.01696 has been replaced.
link: https://scholar.google.com/scholar?q=a

A two-parameter entropy and its fundamental properties
This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized entropy and divergence, for instance, the sub-additive property, strong sub-additive property, joint convexity, and information monotonicity. This article presents an exposit investigation on the information-theoretic and information-geometric characteristics o…

Trustworthy Dimensionality Reduction
Subhrajyoty Roy
https://arxiv.org/abs/2405.05868 https://arxiv.org/pdf/2405.05868

Trustworthy Dimensionality Reduction
Different unsupervised models for dimensionality reduction like PCA, LLE, Shannon's mapping, tSNE, UMAP, etc. work on different principles, hence, they are difficult to compare on the same ground. Although they are usually good for visualisation purposes, they can produce spurious patterns that are not present in the original data, losing its trustability (or credibility). On the other hand, information about some response variable (or knowledge of class labels) allows us to do supervised dimen…

The asymptotic spectrum distance, graph limits, and the Shannon capacity
David de Boer, Pjotr Buys, Jeroen Zuiddam
https://arxiv.org/abs/2404.16763 https:/…

The asymptotic spectrum distance, graph limits, and the Shannon capacity
Determining the Shannon capacity of graphs is a long-standing open problem in information theory, graph theory and combinatorial optimization. Over decades, a wide range of upper and lower bound methods have been developed to analyze this problem. However, despite tremendous effort, even small instances of the problem have remained open. In recent years, a new dual characterization of the Shannon capacity of graphs, asymptotic spectrum duality, has unified and extended known upper bound metho…

This https://arxiv.org/abs/2402.03554 has been replaced.
link: https://scholar.google.com/scholar?q=a

Explicit Formula for Partial Information Decomposition
Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion. Specifically, Shannon's mutual information does not capture fine-grained interactions between those three variables, resulting in limited insights in complex systems. To capture these fine-grained interactions, in 2010 Williams and Beer proposed to decompose t…

This https://arxiv.org/abs/2404.15764 has been replaced.
link: https://scholar.google.com/scholar?q=a

Assessment of the quality of a prediction
Shannon defined the mutual information between two variables. We illustrate why the true mutual information between a variable and the predictions made by a prediction algorithm is not a suitable measure of prediction quality, but the apparent Shannon mutual information (ASI) is; indeed it is the unique prediction quality measure with either of two very different lists of desirable properties, as previously shown by de Finetti and other authors. However, estimating the uncertainty of the ASI is…

This https://arxiv.org/abs/2402.03554 has been replaced.
link: https://scholar.google.com/scholar?q=a

Explicit Formula for Partial Information Decomposition
Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion. Specifically, Shannon's mutual information does not capture fine-grained interactions between those three variables, resulting in limited insights in complex systems. To capture these fine-grained interactions, in 2010 Williams and Beer proposed to decompose t…

Shannon invented information.
The medium is not the message.
If self-referential limericks
Have no data potential
Your one-time pad’s inconsequential.
#HashtagGames
#LimerickAFamousPerson

This https://arxiv.org/abs/2302.07331 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_hept…

Shannon information entropy, soliton clusters and Bose-Einstein condensation in log gravity
We give a probabilistic interpretation of the configurational partition function of the logarithmic sector of critical cosmological topologically massive gravity, in which the Hurwitz numbers considered in our previous works assume the role of probabilities in a distribution on cycles of permutations. In particular, it is shown that the permutations are distributed according to the Ewens sampling formula which plays a major role in the theory of partition structures and their applications to di…

Semantic Information in MC: Chemotaxis Beyond Shannon
Lukas Brand, Yan Wang, Maurizio Magarini, Robert Schober, Sebastian Lotter
https://arxiv.org/abs/2402.18465

Semantic Information in MC: Chemotaxis Beyond Shannon
The recently emerging molecular communication (MC) paradigm intents to leverage communication engineering tools for the design of synthetic chemical communication systems. These systems are envisioned to operate on nanoscale and in biological environments, such as the human body, and catalyze the emergence of revolutionary applications in the context of early disease monitoring and drug targeting. However, while a plethora of theoretical (and more recently also more and more practical) MC syste…

This https://arxiv.org/abs/2305.03571 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_ees…

Model-free Reinforcement Learning of Semantic Communication by Stochastic Policy Gradient
Following the recent success of Machine Learning tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon's classic design paradigm by aiming to transmit the meaning, i.e., semantics, of a message instead of its exact version, allowing for information rate savings. In this work, we apply the Stochastic Policy Gradient (SPG) to design a semantic communication system by reinforcement learning, separating transmitter and …

This https://arxiv.org/abs/2402.18465 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_csIT_…

Semantic Information in MC: Chemotaxis Beyond Shannon
The recently emerged molecular communication (MC) paradigm intends to leverage communication engineering tools for the design of synthetic chemical communication systems. These systems are envisioned to operate at nanoscale and in biological environments, such as the human body, and catalyze the emergence of revolutionary applications in the context of early disease monitoring and drug targeting. Despite the abundance of theoretical (and recently also experimental) MC system designs proposed ov…

This https://arxiv.org/abs/2404.00665 has been replaced.
link: https://scholar.google.com/scholar?q=a

On cumulative and relative cumulative past information generating function
In this paper, we introduce the cumulative past information generating function (CPIG) and relative cumulative past information generating function (RCPIG). We study its properties. We establish its relation with generalized cumulative past entropy (GCPE). We defined CPIG stochastic order and its relation with dispersive order. We provide the results for the CPIG measure of the convoluted random variables in terms of the measures of its components. We found some inequality relating to Shannon e…

This https://arxiv.org/abs/2401.16063 has been replaced.
link: https://scholar.google.com/scholar?q=a

Shannon Capacity of Channels with Markov Insertions, Deletions and Substitutions
We consider channels with synchronization errors modeled as insertions and deletions. A classical result for such channels is their information stability, hence the existence of the Shannon capacity, when the synchronization errors are memoryless. In this paper, we extend this result to the case where the insertions and deletions have memory. Specifically, we assume that the synchronization errors are governed by a stationary and ergodic finite state Markov chain, and prove that such channel is…

Semantics-Empowered Space-Air-Ground-Sea Integrated Network: New Paradigm, Frameworks, and Challenges
Siqi Meng, Shaohua Wu, Jiaming Zhang, Junlan Cheng, Haibo Zhou, Rongxing Lu, Qinyu Zhang
https://arxiv.org/abs/2402.14297

Semantics-Empowered Space-Air-Ground-Sea Integrated Network: New Paradigm, Frameworks, and Challenges
In the coming sixth generation (6G) communication era, to provide seamless and ubiquitous connections, the space-air-ground-sea integrated network (SAGSIN) is envisioned to address the challenges of communication coverage in areas with difficult conditions, such as the forest, desert, and sea. Considering the fundamental limitations of the SAGSIN including large-scale scenarios, highly dynamic channels, and limited device capabilities, traditional communications based on Shannon information the…