1. Instructor: Dr. Wen-Hung Liao 3/7/2017

2. Outline Course Instructor Multimedia Basics
Graphics and Image Data Representation
Color in Image and Video
Fundamental Concepts in Video
Basic of Digital Audio
Social Multimedia Computing
Readings

3. Multimedia Basics Chapter 3 : Graphics and Image Data Representation
Chapter 4: Color in Image and Video
Chapter 5: Fundamental Concepts in Video
Chapter 6: Basic of Digital Audio

4. Chapter 5 Fundamental Concepts in Video 5.1 Analog video
5.2 Digital video
5.3 Video display interfaces
5.4 3D Video and TV

5. Chapter 5 Fundamental Concepts in Video 5.1 Analog video
5.2 Digital video
5.3 Video display interfaces
5.4 3D Video and TV

6. Chapter 5: Digital Video
Ultra High Definition TV (UHDTV):
4K UHDTV: 2160P
8K UHDTV: 4320P
Aspect ratio is 16:9
Bit-depth can be up to 12 bits
Chroma subsampling can be 4:2:0 or 4:2:2.
The supported frame rate has been gradually increased to 120 fps.

7. Chapter 5
Video Display Interfaces: Analog

8. Chapter 5
Video Display Interfaces: Digital

9. Chapter 5: 3D Video and TV Monocular cues for 3D Perception Shading
Perspective scaling
Relative size
Texture gradient
Blur gradient
Haze
Occlusion
Motion parallax

10. Chapter 5: 3D Video and TV
Binocular cues for 3D Perception: Stereo Vision
Middlebury Stereo Datasets

11. Chapter 5 Viewing 3D content with glasses:
3D Movie Using Colored Glasses
3D Movies Using Circularly Polarized Glasses
3D TV with Shutter Glasses

12. Chapter 5
The Vergence-Accommodation Conflict

13. Chapter 5
Autostereoscopic (Glasses-Free) Display Devices

14. Chapter 5: 3D Video and TV
Disparity Manipulation in 3D Content Creation
3D-TV content creation: automatic 2D-to-3D video conversion.

15. Chapter 6 Basics of Digital Audio 6.1 Digitization of sound
6.2 MIDI: Music Instrument Digital Interface
6.3 Quantization and transmission of audio

16. The Ponoplayer
Can you hear the difference?

17. Spectrogram
Praat: doing phonetics by computer

18. Tian, Yonghong, et al. "Social multimedia computing. " Computer 43

19. CHARACTERIZATION OF SOCIAL MULTIMEDIA
Mor Naaman’s definition of social multimedia:
an online source of multimedia resources that fosters an environment of significant individual participation and that promotes community curation, discussion and re-use of content.

20. Three Types of Interaction
Content interaction between multimedia
Social interaction around multimedia
Social interaction captured in multimedia

21. Expanded Definition
“multimedia resources and applications designed to be disseminated through social interaction or be used to capture social activity and interaction”

22. Two views of social multimedia computing

23. Related Research Areas

24. Major Application Areas
Online content-sharing services and communities
Multimedia communication
Social multimedia search
Interactive services and entertainment
Healthcare
Security applications

25. Research Issues