Electrical Communications Systems ECE

Slides:



Advertisements
Similar presentations
CY2G2 Information Theory 1
Advertisements

EE 4780 Huffman Coding Example. Bahadir K. Gunturk2 Huffman Coding Example Suppose X is a source producing symbols; the symbols comes from the alphabet.
Sampling and Pulse Code Modulation
Huffman code and ID3 Prof. Sin-Min Lee Department of Computer Science.
Bounds on Code Length Theorem: Let l ∗ 1, l ∗ 2,..., l ∗ m be optimal codeword lengths for a source distribution p and a D-ary alphabet, and let L ∗ be.
CSc 461/561 CSc 461/561 Multimedia Systems Part B: 1. Lossless Compression.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems ECE Spring 2007 Shreekanth Mandayam ECE Department Rowan University.
ENGS Assignment 3 ENGS 4 – Assignment 3 Technology of Cyberspace Winter 2004 Thayer School of Engineering Dartmouth College Assignment 3 – Due Sunday,
S. Mandayam/ DIP/ECE Dept./Rowan University Digital Image Processing / Fall 2001 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems ECE Spring 2010 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems ECE Spring 2010 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ DIP/ECE Dept./Rowan University Digital Image Processing ECE /ECE Fall 2007 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems ECE Spring 2007 Shreekanth Mandayam ECE Department Rowan University.
Information Theory Eighteenth Meeting. A Communication Model Messages are produced by a source transmitted over a channel to the destination. encoded.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems ECE Spring 2011 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems ECE Spring 2007 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems Spring 2005 Shreekanth Mandayam ECE Department Rowan University.
Huffman Coding. Main properties : –Use variable-length code for encoding a source symbol. –Shorter codes are assigned to the most frequently used symbols,
EEE377 Lecture Notes1 EEE436 DIGITAL COMMUNICATION Coding En. Mohd Nazri Mahmud MPhil (Cambridge, UK) BEng (Essex, UK) Room 2.14.
S. Mandayam/ECE Dept./Rowan University Digital Communications / Fall 2002 Shreekanth Mandayam ECE Department Rowan University
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems Spring 2005 Shreekanth Mandayam ECE Department Rowan University.
1 Lossless Compression Multimedia Systems (Module 2) r Lesson 1: m Minimum Redundancy Coding based on Information Theory: Shannon-Fano Coding Huffman Coding.
Management Information Systems Lection 06 Archiving information CLARK UNIVERSITY College of Professional and Continuing Education (COPACE)
Huffman Coding Vida Movahedi October Contents A simple example Definitions Huffman Coding Algorithm Image Compression.
Session 11: Coding Theory II
Lecture 1 Contemporary issues in IT Lecture 1 Monday Lecture 10:00 – 12:00, Room 3.27 Lab 13:00 – 15:00, Lab 6.12 and 6.20 Lecturer: Dr Abir Hussain Room.
Entropy coding Present by 陳群元. outline constraints  Compression efficiency  Computational efficiency  Error robustness.
Linawati Electrical Engineering Department Udayana University
Huffman coding Content 1 Encoding and decoding messages Fixed-length coding Variable-length coding 2 Huffman coding.
Abdullah Aldahami ( ) April 6,  Huffman Coding is a simple algorithm that generates a set of variable sized codes with the minimum average.
MAT 1000 Mathematics in Today's World Winter 2015.
Foundation of Computing Systems
بسم الله الرحمن الرحيم My Project Huffman Code. Introduction Introduction Encoding And Decoding Encoding And Decoding Applications Applications Advantages.
ECE 101 An Introduction to Information Technology Information Coding.
Estimation and Computation By: Your Name (First, Last) Section: O-
Huffman Coding (2 nd Method). Huffman coding (2 nd Method)  The Huffman code is a source code. Here word length of the code word approaches the fundamental.
Entropy vs. Average Code-length Important application of Shannon’s entropy measure is in finding efficient (~ short average length) code words The measure.
Lossless Compression-Statistical Model Lossless Compression One important to note about entropy is that, unlike the thermodynamic measure of entropy,
Information Theory Information Suppose that we have the source alphabet of q symbols s 1, s 2,.., s q, each with its probability p(s i )=p i. How much.
Huffman Codes ASCII is a fixed length 7 bit code that uses the same number of bits to define each character regardless of how frequently it occurs. Huffman.
EE465: Introduction to Digital Image Processing
CSI-447: Multimedia Systems
Data Compression.
Data Compression CS 147 Minh Nguyen.
Electrical Communications Systems ECE Spring 2007
MODULATION AND DEMODULATION
Huffman Encoding Huffman code is method for the compression for standard text documents. It makes use of a binary tree to develop codes of varying lengths.
Electrical Communications Systems ECE Spring 2008
Electrical Communications Systems ECE Spring 2007
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE Spring 2019
Digital Communications / Fall 2002
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Electrical Communications Systems ECE
Presentation transcript:

Electrical Communications Systems ECE.09.433 Huffman Coding Dr. Shreek Mandayam Electrical & Computer Engineering Rowan University

Plan Digital Baseband Communications Source Encoding Huffman Coding

ECOMMS: Topics

Source Encoding Why are we doing this? Encoder Source Encoded Symbols Analog Message A/D Converter Digital Source Encoder Source Symbols (0/1) Source Entropy Encoded Symbols (0/1) Source-Coded Symbol Entropy Why are we doing this?

Source Encoding Requirements Decrease Lav Unique decoding Instantaneous decoding

Huffman Coding 2-Step Process Reduction Splitting Example List symbols in descending order of probability Reduce the two least probable symbols into one symbol equal to their combined probability Reorder in descending order of probability at each stage Repeat until only two symbols remain Splitting Assign 0 and 1 to the final two symbols remaining and work backwards Expand code at each split by appending a 0 or 1 to each code word Example m(j) A B C D E F G H P(j) 0.1 0.18 0.4 0.05 0.06 0.1 0.07 0.04

Summary