Research
Information entropy as an anthropomorphic concept
arXiv:1503.01967v3 Announce Type: replace-cross Abstract: According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermod
arXiv:1503.01967v3 Announce Type: replace-cross Abstract: According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view each time examining different variables and calculating entropy differently. In this paper we discuss how this concept may be applied in information entropy; how Shannon's definition of entropy can fit in Jayne's and Wigner's statement. This is achieved by generalizing Shannon's notion of information entropy and this is the main contribution of the paper. Then we discuss how entropy under these considerations may be used for the comparison of password complexity and as a measure of diversity useful in the analysis of the behavior of genetic algorithms.
Related
- Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems
- Information Processing by Neuron Populations in the Central Nervous System: A Theory of the Mathematical Structure of Data and Operations
- Mechanism of Task-oriented Information Removal in In-context Learning
- EAGer: Entropy-Aware GEneRation for Adaptive Inference-Time Scaling
Source: arXiv cs.AI | 2026-09-10