August 29, 2015 Lovisa Sundin Information Theory VI. Thermodynamic Entropy August 29, 2015 Lovisa Sundin Information Theory Shannon’s measure of information is actually known as “entropy”, a word better known from thermodynamics, whose famous second law states that, in a closed system, it always increases to a maximum