logo
Wrong email address or username
Wrong email address or username
Incorrect verification code
back to top
Search tags: Engineering
Load new posts () and activity
Like Reblog Comment
show activity (+)
text 2017-02-24 17:00
Reading progress update: I've read 92 out of 260 pages.
Information Theory: A Tutorial Introduct... Information Theory: A Tutorial Introduction - James V. Stone

Yep; looks like I can use Mutual Information if I can obtain an appropriate table of probabilities of input and output for the system I have in mind. I need to check more thoroughly if anything like it has been done before. Pretty exciting!

Like Reblog Comment
show activity (+)
text 2017-02-23 17:38
Reading progress update: I've read 85 out of 260 pages.
Information Theory: A Tutorial Introduct... Information Theory: A Tutorial Introduction - James V. Stone

Mutual information; I can see potential uses for this concept.

Like Reblog Comment
show activity (+)
text 2017-02-22 16:04
Reading progress update: I've read 76 out of 260 pages.
Information Theory: A Tutorial Introduct... Information Theory: A Tutorial Introduction - James V. Stone

No rigorous proof of Shannon's Source Coding Theorem is given; presumably it's difficult.

Like Reblog Comment
show activity (+)
text 2017-02-20 15:31
Reading progress update: I've read 66 out of 260 pages.
Information Theory: A Tutorial Introduct... Information Theory: A Tutorial Introduction - James V. Stone

I've never found an XKCD cartoon in a formal textbook before!
Fascinating discussion of the information of letters in English; the informational entropy of Romeo and Juliet is approx. 4.12 bits/letter. The correlation length of blocks of English text is 10 letters (including a space). No account seems to be taken of punctuation or upper vs. lower case in this discussion.

Like Reblog Comment
show activity (+)
text 2017-02-19 17:35
Reading progress update: I've read 54 out of 260 pages.
Information Theory: A Tutorial Introduct... Information Theory: A Tutorial Introduction - James V. Stone

Shannon's Source Coding Theorem is one of those results that tells you a thing is possible but nothing at all about how to achieve it!

More posts
Your Dashboard view:
Need help?