image thumbnail

Entropy Calculator

version 1.1.0.0 (1.61 KB) by Vallabha Hampiholi
Calculates entropy for data (probability of events) in an array.

721 Downloads

Updated 14 Mar 2012

View License

In information theory, entropy is a measure of the uncertainty associated
with a random variable. In this context, the term usually refers to the
Shannon entropy, which quantifies the expected value of the information
% contained in a message, usually in units such as bits. In this context, a
'message' means a specific realization of the random variable.
Shannon denoted the entropy H of a discrete random variable X with possible
values {x1, ..., xn} as,

H(X) = E(I(X)).

E is the expected value,
I is the information content of X

Example usage
-------------
in = [.25 .25 .25 .25];
b = 'bit';
Entropy = info_entropy (in, b)

Cite As

Vallabha Hampiholi (2021). Entropy Calculator (https://www.mathworks.com/matlabcentral/fileexchange/35611-entropy-calculator), MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2008a
Compatible with any release
Platform Compatibility
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!