Landauer's Principle

VI. Thermodynamic Entropy

VI. Thermodynamic Entropy

Shannon’s measure of information is actually known as “entropy”, a word better known from thermodynamics, whose famous second law states that, in a closed system, it always increases to a maximum