Source Encoder Channel Encoder Noisy channel Source Decoder Channel Decoder Figure 1.1. A communication system: source and channel coding

Discrete Memoryless Source Figure 1.2. A Discrete Memoryless Source

y 2 =ln(x) y 1 =x-1 Figure 1.3. Inequality ln(x) <= x-1

Figure 1.4. Entropy function for the binary source

Figure 1.5. A discrete transmission channel

Figure 1.6. Binary symmetric channel

Figure 1.7. Binary erasure channel

Figure 1.8. Example 1.7

Figure 1.9. Relationships among the different entropies

Figure BSC of Example 1.9

Figure Channel capacity for the BSC

Figure Example 1.11

Figure Vector representation of signals

Figure Vector addition of signals and noise

Figure Gaussian channel

Figure A representation of the output vector space

Figure An encoder for the BSC

Figure An ideal communication system

Figure Practical and non-practical operation regions

Figure Practical and non-practical operating regions. The Shannon limit