A Mathematical Theory of Communication
by Claude Shannon
Number of pages: 79
The person who wrote this paper is the father of modern communication theory, Claude Shannon. In this seminal work Shannon presents results that were previously found nowhere else, and today many professors refer to it as the best exposition still on the subject of the mathematical limits on communication (such as bandwidth). Further, it laid the modern foundations for what is now coined Information Theory. Classic work.
Download or read it online for free here:
by Felix Effenberger - arXiv
This chapter is supposed to give a short introduction to the fundamentals of information theory, especially suited for people having a less firm background in mathematics and probability theory. The focus will be on neuroscientific topics.
by Venkatesan Guruswami, Atri Rudra, Madhu Sudan - University at Buffalo
Error-correcting codes are clever ways of representing data so that one can recover the original information even if parts of it are corrupted. The basic idea is to introduce redundancy so that the original information can be recovered ...
by Alexander Shen - arXiv.org
Algorithmic information theory studies description complexity and randomness. This text covers the basic notions of algorithmic information theory: Kolmogorov complexity, Solomonoff universal a priori probability, effective Hausdorff dimension, etc.
Data compression is useful in some situations because 'compressed data' will save time (in reading and on transmission) and space if compared to the unencoded information it represent. In this book, we describe the decompressor first.