An Introduction to Information Theory: Symbols, Signals and Noise
Covers encoding and binary digits, entropy, language and meaning, efficient encoding and the noisy channel, and explores ways in which information theory relates to physics, cybernetics, psychology, and art. "Uncommonly good...the most satisfying discussion to be found." — Scientific American....
show more
Covers encoding and binary digits, entropy, language and meaning, efficient encoding and the noisy channel, and explores ways in which information theory relates to physics, cybernetics, psychology, and art. "Uncommonly good...the most satisfying discussion to be found." — Scientific American. 1980 edition.
show less
Format: paperback
ISBN:
9780486240619 (0486240614)
Publish date: November 1st 1980
Publisher: Dover Publications
Pages no: 336
Edition language: English
(Original Review, 1980-12-05)Final answer to question, "How many joules to send a bit?"The unit of information is determined by the choice of the arbitrary scale factor K in Shannon's entropy formula:{ s(Q|X) = -K SUM(p*ln(p)) }If K is made equal to 1/ln(2), then S is said to be measured in "bits" o...