An Introduction to Information Theory
An Introduction to Information Theory. Instructor: Prof. Adrish Banerjee, Department of Electrical Engineering, IIT Kanpur. Information Theory answers two fundamental questions: what is the maximum data rate at which we can transmit over a communication link, and what is the fundamental limit of data compression. In this course we will explore answers to these two questions. We will study some practical source compression algorithms. We will also study how to compute channel capacity of simple channels. (from nptel.ac.in)
| Lecture 15 - Channel Capacity |
In this lecture, we first explain what is a discrete memoryless channel (DMC). We describe two special cases of DMC, namely, uniformly dispersive channel and uniformly focusing channel and give expressions for their channel capacity. We then define a strongly symmetric channel and give expression for its channel capacity. Finally, we show that a special class of DMC called symmetric channel can be decomposed into strongly symmetric channel and hence their channel capacity can be calculated in terms of capacity of decomposed strongly symmetric channel.
Go to the Course Home or watch other lectures: