In last week's post on entropy and information, I started off complaining about the most common definition of entropy as disorder or disorganization. One of the nice things about blogging is you often learn something in the subsequent discussion. My chief complaint about the disorder definition was that it's value-laden. I asked: disordered according to … Continue reading Reconciling the disorder definition of entropy
Tag: information science
Entropy, information, and causality
I've long struggled with the concept of entropy. Part of the reason is the way it's often described in popular science accounts, which typically seem subjective and value laden. The most common way of describing it is the amount of disorder in a system. But disorder according to who? A room that appears messy and … Continue reading Entropy, information, and causality

