Instructor: Dr. Wen-Hung Liao 3/7/2017

Outline Course Instructor Multimedia Basics Graphics and Image Data Representation Color in Image and Video Fundamental Concepts in Video Basic of Digital Audio Social Multimedia Computing Readings

Multimedia Basics Chapter 3 : Graphics and Image Data Representation Chapter 4: Color in Image and Video Chapter 5: Fundamental Concepts in Video Chapter 6: Basic of Digital Audio

Chapter 5 Fundamental Concepts in Video 5.1 Analog video 5.2 Digital video 5.3 Video display interfaces 5.4 3D Video and TV

Chapter 5 Fundamental Concepts in Video 5.1 Analog video 5.2 Digital video 5.3 Video display interfaces 5.4 3D Video and TV

Chapter 5: Digital Video Ultra High Definition TV (UHDTV): 4K UHDTV: 2160P 8K UHDTV: 4320P Aspect ratio is 16:9 Bit-depth can be up to 12 bits Chroma subsampling can be 4:2:0 or 4:2:2. The supported frame rate has been gradually increased to 120 fps.

Chapter 5 Video Display Interfaces: Analog

Chapter 5 Video Display Interfaces: Digital

Chapter 5: 3D Video and TV Monocular cues for 3D Perception Shading Perspective scaling Relative size Texture gradient Blur gradient Haze Occlusion Motion parallax

Chapter 5: 3D Video and TV Binocular cues for 3D Perception: Stereo Vision Middlebury Stereo Datasets

Chapter 5 Viewing 3D content with glasses: 3D Movie Using Colored Glasses 3D Movies Using Circularly Polarized Glasses 3D TV with Shutter Glasses

Chapter 5 The Vergence-Accommodation Conflict

Chapter 5 Autostereoscopic (Glasses-Free) Display Devices

Chapter 5: 3D Video and TV Disparity Manipulation in 3D Content Creation 3D-TV content creation: automatic 2D-to-3D video conversion.

Chapter 6 Basics of Digital Audio 6.1 Digitization of sound 6.2 MIDI: Music Instrument Digital Interface 6.3 Quantization and transmission of audio

The Ponoplayer Can you hear the difference?

Spectrogram Praat: doing phonetics by computer

Tian, Yonghong, et al. "Social multimedia computing. " Computer 43

CHARACTERIZATION OF SOCIAL MULTIMEDIA Mor Naaman’s definition of social multimedia: an online source of multimedia resources that fosters an environment of significant individual participation and that promotes community curation, discussion and re-use of content.

Three Types of Interaction Content interaction between multimedia Social interaction around multimedia Social interaction captured in multimedia

Expanded Definition “multimedia resources and applications designed to be disseminated through social interaction or be used to capture social activity and interaction”

Two views of social multimedia computing

Related Research Areas

Major Application Areas Online content-sharing services and communities Multimedia communication Social multimedia search Interactive services and entertainment Healthcare Security applications

Research Issues