Claude Shannon

VII. Randomness, Probability, Compression and Redundancy

VII. Randomness, Probability, Compression and Redundancy

“Order” and “disorder”, we have seen, are observer-dependent categories of a dynamical system’s state space. What characterizes disordered states, relative to any observer, is that different disordered states do not differ in any meaningful way.

V. Basic Information Theory

V. Basic Information Theory

Most psychologists studying perception and cognition today argue that Gibson’s radio-metaphor is flawed because a brain, unlike a radio, identifies a “signal” not directly, but in a memory-dependent way.