Tuesday, March 11, 2008

Claude E. Shannon




Choice, Uncertainty and Entropy

We have represented a discrete information source as a Markoff process. Can we define a quantity which will measure, in some sense, how much information is "produced" by such a process, or better, at what rate information is produced?
...
A Mathematical Theory of Communication