Multimedia Cloud Computing Wenwu Zhu, Senior Internet Media Microsoft Research Asia Chong Luo, Member of the IEEE Jianfeng Wang, Master Student in MOE-Microsoft Key Laboratory Shipeng Li, Microsoft Research Asia IEEE SINGAL PROCESSING MAGAZINE, MAY 2011

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 2

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 3

Introduction What is and why needs cloud computing? Challenges of multimedia on cloud ◦ Multimedia and service heterogeneity ◦ QoS heterogeneity ◦ Network heterogeneity ◦ Device heterogeneity Multimedia-aware cloud (media cloud) v.s cloud-aware multimedia (cloud media) 4

Multimedia on Cloud 5

Media Cloud v.s Cloud Media 6

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 7

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 8

Multimedia-aware Cloud Media-cloud-computing architecture ◦ Media edge cloud (MEC) architecture Distributed parallel multimedia processing Case study ◦ Photosynth [1] 9

MEC Architecture 10 Like CDN [2] edge servers architecture

MEC Architecture 11

Distributed parallel multimedia processing 12 DHT Load Balancer

Case Study - Photosynth 13

Case Study - Photosynth Major computation task ◦ Image Conversion ◦ Feature extration ◦ Image matching ◦ Reconstruction User-level parallel synthing in the MEC Task-level parallel synthing in the MEC 14

User-level Parallel Synthing 15

Task-level Parallel Synthing 16

Simulation Result 17

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 18

Cloud-aware Multimedia 19

Cloud-aware Multimedia Storage and sharing Authoring and mashup Adaptation and delivery Media rendering 20

Storage and sharing Advantage ◦ High reliability ◦ High data rate Issues ◦ High bandwidth demand of load balancing algorithms for streaming 21

Authoring and Mashup Offline tools ◦ Adobe ◦ Windows Movie Maker Online service ◦ Jaycut  XML-based file format 22

Authoring and Mashup 23

Adaptation and Delivery A large amount of computing Request service simultaneously Example – Cloudcoder ◦ Offload much of the processing to the cloud ◦ Transcoder instances scales up automatically 24

Adaptation and Delivery 25

Media Rendering A large amount of computing ◦ Fully render ◦ Partially render Multimedia retrieval ◦ Content-based image retrieval (CBIR)  Feature extraction  Similarity measurement 26

Media Rendering 27

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 28

Summary Media cloud ◦ Propose an MEC-computing architecture to achieve high QoS support for various services. Cloud media ◦ Propose how multimedia service can optimally utilize cloud-computing resources. 29

Overview Introduction Related Works Multimedia-aware Cloud Cloud-aware Multimedia Summary Reference 30

Reference [1] Photosynth ◦ [2] CDN ◦ -cdn(content-delivery- network)%E6%87%89%E7%94%A8%E7%B0%A 1%E5%96%AE%E8%AA%AA%E6%98%8E -cdn(content-delivery- network)%E6%87%89%E7%94%A8%E7%B0%A 1%E5%96%AE%E8%AA%AA%E6%98%8E 31