1. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 1 ENEE408G: Capstone Design Project: Multimedia Signal Processing Design Project 2: Video Processing

2. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 2 Today’s Schedule Introduction to Design Project 2 Check in Digital Camera and Pocket PC Check out PC camera and Pocket PC

3. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 3 Outline of Design Project 2 Part I : Video Capturing by PC Camera Part II : Motion Estimation and Compensation Part III: MPEG Video Part IV: Detect Scene Change in Video Part V: Mobile Computing and Pocket PC Programming Bonus Part I : MPEG-7 Visual Descriptor Bonus Part II: Video Conference

4. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 4 Part I. Video Capturing by PC Camera

5. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 5 Pat II. Motion Estimation and Compensation Inter-Frame Encoder

6. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 6 ME: Exhaustive Block Matching

7. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 7 ME: Example Reference Frame Current Frame

8. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 8 Exhaustive Block Matching (cont.1) Demo: http://www.ece.umd.edu/class/enee408g/labs/labV/Moti on_Estimation_v3.exe http://www.ece.umd.edu/class/enee408g/labs/labV/Moti on_Estimation_v3.exe http://www.ece.umd.edu/class/enee408g/labs/labV/moti on_estimation_3step.exe http://www.ece.umd.edu/class/enee408g/labs/labV/moti on_estimation_3step.exe

9. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 9 Exhaustive Block Matching (cont.2) Reference Frame Current FrameMotion Vectors

10. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 10 Motion Compensation Estimated frameResidual

11. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 11 3-step approach

12. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 12 Part III.MPEG Video MPEG-1 Video Use mpgwrite.m and mpgread.m. Tradeoff between bit rate and quality

13. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 13 Part IV. Detect Scene Change Cut Scene Change Dissolve Scene Change Wipe Scene Change Multi-scene Change Design scene change detector Hint: Use statistical characteristics for each frame

14. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 14 Part V. Pocket PC Programming Apply what you learned from previous parts and design a simple application related to digital video processing by Microsoft eMbedded Tools for Pocket PC.

15. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 15 Bonus Part I. MPEG-7 Visual Descriptor MPEG-7 Texture Descriptor http://nayana.ece.ucsb.edu/M7TextureDemo/Demo/clien t/M7TextureDemo.html http://nayana.ece.ucsb.edu/M7TextureDemo/Demo/clien t/M7TextureDemo.html MPEG-7 Shape Descriptor http://www.ee.surrey.ac.uk/Research/VSSP/imagedb/de mo.html http://www.ee.surrey.ac.uk/Research/VSSP/imagedb/de mo.html

16. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 16 MPEG-7 Texture Descriptor

17. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 17 MPEG-7 Shape Descriptor

18. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 18 Bonus Part II. Video Conference Experience video conferencing using Microsoft NetMeeting Two scenarios: video conferencing with different image modes video conferencing with different available bandwidths Do this part at home

19. 02/17/05ENEE408G Spring 2005 Multimedia Signal Processing 19 PC Camera / Digital Camera Digital Camera and Pocket PC Check In PC Camera and Pocket PC Check Out