August 29, 2015 Lovisa Sundin Information Theory VII. Randomness, Probability, Compression and Redundancy August 29, 2015 Lovisa Sundin Information Theory “Order” and “disorder”, we have seen, are observer-dependent categories of a dynamical system’s state space. What characterizes disordered states, relative to any observer, is that different disordered states do not differ in any meaningful way.