Instructor: Dr. Wen-Hung Liao 2/21/2017
Outline Course Instructor Social Multimedia Computing: Why and How Multimedia Basics Graphics and Image Data Representation Color in Image and Video Fundamental Concepts in Video Basic of Digital Audio Social Multimedia Computing Readings
About the Instructor Dr. Wen-Hung Liao whliao@gmail.com Dept. of Computer Science, National Chengchi University Course website: http://www.cs.nccu.edu.tw/~whliao/mm2017 Textbook (for this part): Fundamentals of Multimedia, 2nd edition, 2014. (local copy)
Quick Survey Prior background in: Digital signal processing Digital image processing Computer vision Multimedia Machine learning, Deep learning Data mining Social network
Applications and Tools (1/3)
Applications and Tools (2/3) Multimedia Grand Challenges 2016 Master’s thesis under my supervision Identifying User Profile Using Facebook Photos Color Analysis of Instagram Photos and Its Application
Applications and Tools (3/3) Object recognition: http://cloudacademy.com/blog/google-vision-vs-amazon-rekognition/ Content-Based Image Retrieval (CBIR) http://www.lire-project.net/ Text Parsing Stanford CoreNLP: http://stanfordnlp.github.io/CoreNLP/ JIEBA https://github.com/fxsjy/jieba Academia Sinica: http://ckipsvr.iis.sinica.edu.tw/ Word2vec https://en.wikipedia.org/wiki/Word2vec
Multimedia Basics Chapter 3 : Graphics and Image Data Representation Chapter 4: Color in Image and Video Chapter 5: Fundamental Concepts in Video Chapter 6: Basic of Digital Audio
Chapter 3 3.1 Graphics/Image Data Types 3.2 Popular File Formats 1-bit images 8-bit gray-level images Image data types 24-bit color images Higher bit-depth images 8-bit color images Color lookup tables (LUTs) 3.2 Popular File Formats
Multimedia Viewer XnView http://www.xnview.com/en/xnview/ Perception of gray scale images
More on Dithering http://www.visgraf.impa.br/Courses/ip00/proj/Dithering1/algoritmos_desenvolvidos.htm http://www.tannerhelland.com/3643/grayscale-image-algorithm-vb6/ Median Cut Algorithm Color Quantization
Higher bit-depth images Medical imaging (10-bit gray level) Multispectral imaging
EXIF Not supported in JPEG 2000, PNG and GIF. Q1: What information can be obtained by analyzing the EXIF? Q2: Can you read exif data from pictures on facebook or instagram?
PTM Format Polynomial texture mapping: a technique for storing a representation of a camera scene that contains information about a set of images taken under a set of lights that each have the same spectrum, but with each placed at a different direction from the scene.
PTM Example
Chapter 4 4.1 Color Science 4.2 Color Models in Images 4.3 Color Models in Video
Color Space Conversions http://www.poynton.com/PDFs/coloureq.pdf OpenCV function: cvtColor http://docs.opencv.org/modules/imgproc/doc/miscellaneous_transformations.html
Readings Chapter 3, 4 of the textbook (required) Social multimedia computing. (required) User-centric social multimedia computing. (optional)