1 Adaptable applications Towards Balancing Network and Terminal Resources to Improve Video Quality D. Jarnikov.

Slides:



Advertisements
Similar presentations
2005/01/191/14 Overview of Fine Granularity Scalability in MPEG-4 Video Standard Weiping Li Fellow, IEEE IEEE Transactions on Circuits and Systems for.
Advertisements

Multicast and Unicast Real-Time Video Streaming Over Wireless LANs Abhik Majumdar, Daniel Grobe Sachs, Igor V. Kozintsev, Kannan Ramchandran, and Minerva.
Capacity of Wireless Channels
1 Wireless Sensor Networks Akyildiz/Vuran Administration Issues  Take home Mid-term Exam  Assign April 2, Due April 7  Individual work is required 
Presented by Scott Kristjanson CMPT-820 Multimedia Systems Instructor: Dr. Mohamed Hefeeda 1 Cross-Layer Wireless Multimedia.
Presented by Santhi Priya Eda Vinutha Rumale.  Introduction  Approaches  Video Streaming Traffic Model  QOS in WiMAX  Video Traffic Classification.
1 “Multiplexing Live Video Streams & Voice with Data over a High Capacity Packet Switched Wireless Network” Spyros Psychis, Polychronis Koutsakis and Michael.
Rate Distortion Optimized Streaming Maryam Hamidirad CMPT 820 Simon Fraser Univerity 1.
Kuang-Hao Liu et al Presented by Xin Che 11/18/09.
SCHOOL OF COMPUTING SCIENCE SIMON FRASER UNIVERSITY CMPT 820 : Error Mitigation Schaar and Chou, Multimedia over IP and Wireless Networks: Compression,
1 Layer-Encoded Video in Scalable Adaptive Streaming Michael Zink, Jens Schmitt, and Ralf Steinmetz, Fellow, IEEE IEEE TRANSACTIONS ON MULTIMEDIA, VOL.
Dynamic Tuning of the IEEE Protocol to Achieve a Theoretical Throughput Limit Frederico Calì, Marco Conti, and Enrico Gregori IEEE/ACM TRANSACTIONS.
1 Lecture 8: Genetic Algorithms Contents : Miming nature The steps of the algorithm –Coosing parents –Reproduction –Mutation Deeper in GA –Stochastic Universal.
Fine Grained Scalable Video Coding For Streaming Multimedia Communications Zahid Ali 2 April 2006.
A Layered Hybrid ARQ Scheme for Scalable Video Multicast over Wireless Networks Zhengye Liu, Joint work with Zhenyu Wu.
Video Transmission Adopting Scalable Video Coding over Time- varying Networks Chun-Su Park, Nam-Hyeong Kim, Sang-Hee Park, Goo-Rak Kwon, and Sung-Jea Ko,
End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video Over Wireless Internet Fan Yang, Qian Zhang, Wenwu Zhu, and Ya-Qin Zhang.
Analysis of Using Broadcast and Proxy for Streaming Layered Encoded Videos Wilson, Wing-Fai Poon and Kwok-Tung Lo.
An Error-Resilient GOP Structure for Robust Video Transmission Tao Fang, Lap-Pui Chau Electrical and Electronic Engineering, Nanyan Techonological University.
Two-Dimensional Channel Coding Scheme for MCTF- Based Scalable Video Coding IEEE TRANSACTIONS ON MULTIMEDIA,VOL. 9,NO. 1,JANUARY Yu Wang, Student.
An Integrated Source Transcoding and Congestion Control Paradigm for Video Streaming in the Internet Proposed by R. Puri, K.W. Lee, K. Ramchandran and.
Robust Scalable Video Streaming over Internet with Network-Adaptive Congestion Control and Unequal Loss Protection Quan Zang, Guijin Wang, Wenwu Zhu, and.
Overview of Fine Granularity Scalability in MPEG-4 Video Standard Weiping Li, Fellow, IEEE.
Real-time smoothing for network adaptive video streaming Kui Gao, Wen Gao, Simin He, Yuan Zhang J. Vis. Commun. Image R. 16 (2005)
7C Cimini-9/97 RANDOM ACCESS TECHNIQUES ALOHA Efficiency Reservation Protocols Voice and Data Techniques - PRMA - Variable rate CDMA.
On Combining Temporal Scaling and Quality Scaling for Streaming MPEG Huahui Wu, Mark Claypool, Robert Kinicki Computer Science, Worcester Polytechnic Institute.
An End-to-End Multipath Smooth Handoff Scheme for Stream Media Yi Pan Meejeong Lee Jaime Bae Kim Tatsuya Suda IEEE Journal On Selected Areas In Communications.
A Real-Time Video Multicast Architecture for Assured Forwarding Services Ashraf Matrawy, Ioannis Lambadaris IEEE TRANSACTIONS ON MULTIMEDIA, AUGUST 2005.
Efficient Fine Granularity Scalability Using Adaptive Leaky Factor Yunlong Gao and Lap-Pui Chau, Senior Member, IEEE IEEE TRANSACTIONS ON BROADCASTING,
Wireless FGS video transmission using adaptive mode selection and unequal error protection Jianhua Wu and Jianfei Cai Nanyang Technological University.
Streaming Video Gabriel Nell UC Berkeley. Outline Scalable MPEG-4 video – Layered coding method – Integrated transport-decoder buffer model RAP streaming.
Adaptive Rate Control for Streaming Stored Fine- Grained Scalable Video Philippe de Cuetos, Keith W. Ross NOSSDAV 2002, May 12-14,2002.
Multi-Path Transport of FGS Video Jian Zhou, Huai-Rong Shao, Chia Shen and Ming-Ting Sun ICME 2003.
H.264/AVC for Wireless Applications Thomas Stockhammer, and Thomas Wiegand Institute for Communications Engineering, Munich University of Technology, Germany.
Receiver Capability Heterogeneity in the Internet.
1 Quality of Experience Control Strategies for Scalable Video Processing Wim Verhaegh, Clemens Wüst, Reinder J. Bril, Christian Hentschel, Liesbeth Steffens.
4/24/2002SCL UCSB1 Optimal End-to-end Distortion Estimation for Drift Management in Scalable Video Coding H. Yang, R. Zhang and K. Rose Signal Compression.
09/24/02ICIP20021 Drift Management and Adaptive Bit Rate Allocation in Scalable Video Coding H. Yang, R. Zhang and K. Rose Signal Compression Lab ECE Department.
CEFRIEL Deliverable R4.1.5 MAIS adaptive and reconfigurable modem Giovanni Paltenghi Roma – 24 Novembre 2005.
Variable Bit Rate Video Coding April 18, 2002 (Compressed Video over Networks: Chapter 9)
MPEG2 FGS Implementation ECE 738 Advanced Digital Image Processing Author: Deshan Yang 05/01/2003.
On Error Preserving Encryption Algorithms for Wireless Video Transmission Ali Saman Tosun and Wu-Chi Feng The Ohio State University Department of Computer.
Farid Molazem Network Systems Lab Simon Fraser University Scalable Video Transmission for MobileTV.
Sharanya Eswaran, Penn State University Matthew Johnson, CUNY Archan Misra, Telcordia Technolgoies Thomas La Porta, Penn State University Utility-driven.
 Coding efficiency/Compression ratio:  The loss of information or distortion measure:
A New Algorithm for Improving the Remote Sensing Data Transmission over the LEO Satellite Channels Ali Payandeh and Mohammad Reza Aref Applied Science.
Performance Analysis of MPEG-4 Video Stream with FEC Error Recovery over IEEE DCF WLAN Cheng-Han Lin, Huai-Wen Zhang, Ce-Kuen Shieh Department of.
Distributing Layered Encoded Video through Caches Authors: Jussi Kangasharju Felix HartantoMartin Reisslein Keith W. Ross Proceedings of IEEE Infocom 2001,
MPEG MPEG : Motion Pictures Experts Group MPEG : ISO Committee Widely Used Video Compression Standard.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar Networking and Telecommunications Group Georgia.
Compression video overview 演講者:林崇元. Outline Introduction Fundamentals of video compression Picture type Signal quality measure Video encoder and decoder.
報告人:林祐沁 學生 指導教授:童曉儒 老師 March 2, Wireless Video Surveillance Server Based on CDMA1x and H.264.
Scalable Video Coding and Transport Over Broad-band wireless networks Authors: D. Wu, Y. Hou, and Y.-Q. Zhang Source: Proceedings of the IEEE, Volume:
Run-time Adaptive on-chip Communication Scheme 林孟諭 Dept. of Electrical Engineering National Cheng Kung University Tainan, Taiwan, R.O.C.
Multimedia Computing and Networking Jan Reduced Energy Decoding of MPEG Streams Malena Mesarina, HP Labs/UCLA CS Dept Yoshio Turner, HP Labs.
Transcoding based optimum quality video streaming under limited bandwidth *Michael Medagama, **Dileeka Dias, ***Shantha Fernando *Dialog-University of.
Adaptive QoS Control of Multimedia Transmission Over Band-limited Networks Presenter: Hu Huang Nov G.Y.Hong 1, Member, IEEE, A.C.M.Fong 1, Member,
Blind Quality Assessment System for Multimedia Communications Using Tracing Watermarking P. Campisi, M. Carli, G. Giunta and A. Neri IEEE Transactions.
A Comparison of RaDiO and CoDiO over IEEE WLANs May 25 th Jeonghun Noh Deepesh Jain A Comparison of RaDiO and CoDiO over IEEE WLANs.
Video Content AdaptationQoS by using the tree algorithm Jaepil Han Jinho Choo Sunwoo Yang.
Accurate WiFi Packet Delivery Rate Estimation and Applications Owais Khan and Lili Qiu. The University of Texas at Austin 1 Infocom 2016, San Francisco.
Performance Analysis of MPEG-4 Video Stream with FEC Error Recovery over IEEE DCF WLAN Cheng-Han Lin, Huai-Wen Zhang, Ce-Kuen Shieh Department of.
Video scheduling algorithm
Rate Adaptations.
Scalable Speech Coding for IP Networks: Beyond iLBC
Yiannis Andreopoulos et al. IEEE JSAC’06 November 2006
of the IEEE Distributed Coordination Function
Kyoungwoo Lee, Minyoung Kim, Nikil Dutt, and Nalini Venkatasubramanian
Unequal Error Protection for Video Transmission over Wireless Channels
Video Streaming over Cognitive radio networks
Presentation transcript:

1 Adaptable applications Towards Balancing Network and Terminal Resources to Improve Video Quality D. Jarnikov

2 Contents Introduction (www) New solutions Subjective evaluation Conclusions and future plans

3 Introduction of in-home network

4 Problem description Video data transmission Video data decoding Network condition good bad Perceived video quality bad good Perceived video quality bad good Resource consumption low high

5 Objective: networked terminal Resource-constrained terminal : CPU Resource-constrained network : bandwidth Wireless network has fluctuations Source Terminal Wireless network

6 Solution Scalable video technique –Choose size of base layer such, that we can almost guarantee the transmission –The enhancement layer is transmitted if there is available bandwidth –The number of layers to be decoded can be chosen for every frame Controller –Choose how much video data (e.g. layers) should be processed. –Optimizes perceived quality when looking at available input data AND available CPU power

7 Past: Conclusions & Future plans The usage of scalable video enables trade-offs between user perceived quality and network and terminal resources A controller can be used to optimized perceived quality with respect to the available CPU power and amount of input data We developed the controller that doesn’t depend on the scalability technique The correctness of controller behavior depends on rightness of parameters Take into account other terminal resources Organize a feedback from the terminal to the source Create MPEG2 to scalable video transcoder

8 Contents Introduction (www) New solutions –System view –Transcoder –Controller –Network sender-receiver –Summary Subjective evaluation Conclusions and future plans

9 System: Present view Source Terminal Wireless network Transcoder Network Sender-Receiver - Terminal - ?

10 Contents Introduction (www) New solutions –System view –Transcoder –Controller –Network sender-receiver –Summary Subjective evaluation Conclusions and future plans

11 Transcoder: General Info Separates video stream on most important information and least important information (refinement) Input: MPEG2 video Output: Scalable MPEG2 video Parameters: number of output layers, sizes of the layers VLD Inverse Quantization Q -1 stream Quantization Q VLC - EL stream BL stream Quantization Q’ VLC

12 Transcoder: New enhancement layers From I to B frames: empty macroblocks can be skipped variable length coding tables of B frames are better suited to encode residual values Advantages: lower importance of base layer size less syntax overhead Both approaches are compliant with new MPEG System proposal

13 Contents Introduction (www) New solutions –System view –Transcoder –Controller –Network sender-receiver –Summary Subjective evaluation Conclusions and future plans

14 Controller: General view Controller chooses how much video data (e.g. layers) should be processed. Takes into account: – amount of available resources (CPU) – amount of video data available (e.g. how many layers have we received) Objective: maximize perceived quality –MAX number of layers to be processed –MIN deadline misses –MIN quality changes Terminal Scalable Video Input Decoder Controller Post-processing Controller

15 Controller: Markov decision process State: progress w.r.t. deadline number of layers decoded maximal number of layers for the next frame Revenue: Reward: number of layers Penalty: deadline misses Penalty: quality change Penalty: quality change, caused be the network

16 Controller: Challenges Processing times -depends on content (stochastic) -depends on layer size Probabilities change for every possible layer size => Unique strategy for every layer size Maximal number of layers for the next frame -network-dependent parameter (stochastic) We need appropriate network behavior model  Unique strategy for every network condition Number of layers in total  Unique strategy for every number of layers

17 Contents Introduction (www) New solutions –System view –Transcoder –Controller –Network sender-receiver –Summary Subjective evaluation Conclusions and future plans

18 Network sender-receiver (NSR) Streams layers over the network Takes care about layer prioritization Sends feedback about receiving conditions Streaming conditions + Receiving conditions = Network conditions μ, BER / PER

19 NSR: Channel Model Using μ, BER / PER we can build a simple channel model [example: Gilbert-Elliott channel (GEC)] We run a simulations for different network conditions and layer configurations For every pair μ, BER / PER we can estimate what is an optimal layer configuration (lookup table) Layer configuration is a run-time input for the transcoder

20 NSR: Controller input Processing times -depends on content (stochastic) -depends on layer size Probabilities change for every possible layer sizelayer size => Unique strategy for every layer size Maximal number of layers for the next frame -network-dependent parameter (stochastic)number of layers We need appropriate network behavior modellayer size  Unique strategy for every network conditionsμ, BER / PER Number of layers in total  Unique strategy for every number of layersnumber of layers BUT! Layer sizes and number of layers have one-to-one relation with μ, BER / PER

21 Contents Introduction (www) New solutions –System view –Transcoder –Controller –Network sender-receiver –Summary Subjective evaluation Conclusions and future plans

22 System: Global view Transcoder Network Sender-Receiver - Terminal - μ, BER / PER number of layers layers sizes strategy Calculated offline Alternative

23 Contents Introduction (www) New solutions Subjective evaluation Conclusions and future plans

24 User tests How does proportion between sizes of BL and EL influence perceived quality? What is better: a large EL with high losses or small EL with low losses? RESULTS: BL size is very important With decrease of overall bit-rate the importance of BL size increases With increase of EL size married to a lower frequency is perceived slightly worse

25 Contents Introduction (www) New solutions Subjective evaluation Conclusions and future plans

26 Conclusions Made a transcoder that produces less bit per EL for the same quality Made a network simulation that allows a better choice of layer configuration Enhanced a terminal controller with realistic network behavior model User tests were performed for perceived quality evaluation of a scalable video

27 Future plans Take into account other terminal resources Enhance the feedback mechanism from the terminal to the source with terminal capabilities information Allow source-terminal resource negotiations Perform subjective test for dynamic behavior of scalable video scheme Implement transcoder on CE platform

28 ?

29 Transcoder: Comparison of the approaches Difference in PSNR between one-layer reference and two-layer scalable coding (the overall bitrate is 5 MBps) I-frame approach B-frame approach

30 NSR: Channel Model Using μ, BER / PER we can build a simple channel model [example: Gilbert-Elliott channel (GEC)] We model the channel as a two-state discrete time Markov chain (DTMC) with states G (good) and B (bad) and four probabilities P, Q, E G, and E B

31 NSR: Channel Model Simulation

32 NSR: Channel Model Outcome For every pair μ, BER / PER we can estimate what is an optimal layer configuration (lookup table) Layer configuration is a run-time input for the transcoder Example: maximal BL bitrate as a function of network conditions