An Intrinsic Characterization of Shannon’s and Rényi’s Entropy
2024
Understanding Shannon's and Rényi's Entropy
publication
Evidence: high
Author Information
Author(s): Martin Schlather, Carmen Ditscheid, Boris Ryabko
Primary Institution: Institute of Mathematics, University of Mannheim
Hypothesis
Can the chain rule of Shannon entropy be split into intrinsic components?
Conclusion
The study shows that the chain rule can be divided into two natural components, enhancing our understanding of Shannon and Rényi entropies.
Supporting Evidence
- The chain rule can be split into two components: additivity and a proportionality relation.
- Characterizations of Shannon and Rényi entropy are provided.
- The study emphasizes the role of geometric distributions in understanding entropy.
Takeaway
This study looks at how we can break down a formula used to measure information, making it easier to understand and apply.
Digital Object Identifier (DOI)
Want to read the original?
Access the complete publication on the publisher's website