1. Source Encoder Channel Encoder Noisy channel Source Decoder Channel Decoder Figure 1.1. A communication system: source and channel coding

2. Discrete Memoryless Source Figure 1.2. A Discrete Memoryless Source

3. y 2 =ln(x) y 1 =x-1 Figure 1.3. Inequality ln(x) <= x-1

4. Figure 1.4. Entropy function for the binary source

5. Figure 1.5. A discrete transmission channel

6. Figure 1.6. Binary symmetric channel

7. Figure 1.7. Binary erasure channel

8. Figure 1.8. Example 1.7

9. Figure 1.9. Relationships among the different entropies

10. Figure 1.10. BSC of Example 1.9

11. Figure 1.11. Channel capacity for the BSC

12. Figure 1.12. Example 1.11

13. Figure 1.13. Vector representation of signals

14. Figure 1.14. Vector addition of signals and noise

15. Figure 1.15. Gaussian channel

16. Figure 1.16. A representation of the output vector space

17. Figure 1.17. An encoder for the BSC

18. Figure 1.18. An ideal communication system

19. Figure 1.19. Practical and non-practical operation regions

20. Figure 1.20. Practical and non-practical operating regions. The Shannon limit