Low-complexity merge candidate decision for fast HEVC encoding Multimedia and Expo Workshops (ICMEW), 2013 IEEE International Conference on Muchen LI,

Slides:



Advertisements
Similar presentations
Packet Video Error Concealment With Auto Regressive Model Yongbing Zhang, Xinguang Xiang, Debin Zhao, Siwe Ma, Student Member, IEEE, and Wen Gao, Fellow,
Advertisements

Wen-Hsiao Peng Chun-Chi Chen
Introduction to H.264 / AVC Video Coding Standard Multimedia Systems Sharif University of Technology November 2008.
Tae-Shick Wang; Kang-Sun Choi; Hyung-Seok Jang; Morales, A.W.; Sung-Jea Ko; IEEE Transactions on Consumer Electronics, Vol. 56, No. 2, May 2010 ENHANCED.
Time Optimization of HEVC Encoder over X86 Processors using SIMD
INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS, ICT '09. TAREK OUNI WALID AYEDI MOHAMED ABID NATIONAL ENGINEERING SCHOOL OF SFAX New Low Complexity.
A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors Chenggang Yan, Yongdong Zhang, Jizheng Xu, Feng Dai,
1 Adaptive slice-level parallelism for H.264/AVC encoding using pre macroblock mode selection Bongsoo Jung, Byeungwoo Jeon Journal of Visual Communication.
Yung-Lin Huang, Yi-Nung Liu, and Shao-Yi Chien Media IC and System Lab Graduate Institute of Networking and Multimedia National Taiwan University Signal.
{ Fast Disparity Estimation Using Spatio- temporal Correlation of Disparity Field for Multiview Video Coding Wei Zhu, Xiang Tian, Fan Zhou and Yaowu Chen.
An Improved 3DRS Algorithm for Video De-interlacing Songnan Li, Jianguo Du, Debin Zhao, Qian Huang, Wen Gao in IEEE Proc. Picture Coding Symposium (PCS),
Li Liu, Robert Cohen, Huifang Sun, Anthony Vetro, Xinhua Zhuang BMSB
2009/04/07 Yun-Yang Ma.  Overview  What is CUDA ◦ Architecture ◦ Programming Model ◦ Memory Model  H.264 Motion Estimation on CUDA ◦ Method ◦ Experimental.
Ai-mei Huang And Truong Nguyen IEEE, WORLD OF WIRELESS, MOBILE AND MULTIMEDIA NETWORKS. (WOWMOM), 2008 IEEE, WORLD OF WIRELESS, MOBILE AND MULTIMEDIA NETWORKS.
Wei Zhu, Xiang Tian, Fan Zhou and Yaowu Chen IEEE TCE, 2010.
Shaobo Zhang, Xiaoyun Zhang, Zhiyong Gao
Outline Introduction Introduction Fast Inter Prediction Mode Decision for H.264 – –Pre-encoding An Efficient Inter Mode Decision Approach for H.264 Video.
Efficient multi-frame motion estimation algorithms for MPEG-4 AVC/JVTH.264 Mei-Juan Chen, Yi-Yen Chiang, Hung- Ju Li and Ming-Chieh Chi ISCAS 2004.
Low-complexity mode decision for MVC Liquan Shen, Zhi Liu, Ping An, Ran Ma and Zhaoyang Zhang CSVT
1 Single Reference Frame Multiple Current Macroblocks Scheme for Multiple Reference IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY Tung-Chien.
Fast Mode Decision And Motion Estimation For JVT/H.264 Pen Yin, Hye – Yeon Cheong Tourapis, Alexis Michael Tourapis and Jill Boyce IEEE ICIP 2003 Sep.
Overview of Multi-view Video Coding Yo-Sung Ho; Kwan-Jung Oh; Systems, Signals and Image Processing, 2007 and 6th EURASIP Conference focused on Speech.
Error Concealment For Fine Granularity Scalable Video Transmission Hua Cai; Guobin Shen; Feng Wu; Shipeng Li; Bing Zeng; Multimedia and Expo, Proceedings.
Multi-Frame Reference in H.264/AVC 卓傳育. Outline Introduction to Multi-Frame Reference in H.264/AVC Multi-Frame Reference Problem Two papers propose to.
2015/6/271 Intra-Prediction in H.264(JM82) Student : 林鴻志 Advisor : 杭學鳴 教授.
1 An Efficient Mode Decision Algorithm for H.264/AVC Encoding Optimization IEEE TRANSACTION ON MULTIMEDIA Hanli Wang, Student Member, IEEE, Sam Kwong,
Feature-Based Intra-/InterCoding Mode Selection for H.264/AVC C. Kim and C.-C. Jay Kuo CSVT, April 2007.
Motion Estimation Using Low- Band-Shift Method for Wavelet- Based Moving Picture Hyun-Wook Park, Senior Member, IEEE, and Hyung-Sun Kim IEEE Transactions.
Block Partitioning Structure in the HEVC Standard
BY AMRUTA KULKARNI STUDENT ID : UNDER SUPERVISION OF DR. K.R. RAO Complexity Reduction Algorithm for Intra Mode Selection in H.264/AVC Video.
Complexity Model Based Load- balancing Algorithm For Parallel Tools Of HEVC Yong-Jo Ahn, Tae-Jin Hwang, Dong-Gyu Sim, and Woo-Jin Han 2013 IEEE International.
A Low-Power VLSI Architecture for Full-Search Block-Matching Motion Estimation Viet L. Do and Kenneth Y. Yun IEEE Transactions on Circuits and Systems.
HEVC Commentary and a call for local temporal distortion metrics Mark Buxton - Intel Corporation.
An Introduction to H.264/AVC and 3D Video Coding.
Video Compression Concepts Nimrod Peleg Update: Dec
1. 1. Problem Statement 2. Overview of H.264/AVC Scalable Extension I. Temporal Scalability II. Spatial Scalability III. Complexity Reduction 3. Previous.
Liquan Shen Zhi Liu Xinpeng Zhang Wenqiang Zhao Zhaoyang Zhang An Effective CU Size Decision Method for HEVC Encoders IEEE TRANSACTIONS ON MULTIMEDIA,
Kai-Chao Yang Hierarchical Prediction Structures in H.264/AVC.
1 Efficient Reference Frame Selector for H.264 Tien-Ying Kuo, Hsin-Ju Lu IEEE CSVT 2008.
By Abhishek Hassan Thungaraj Supervisor- Dr. K. R. Rao.
Adaptive Multi-path Prediction for Error Resilient H.264 Coding Xiaosong Zhou, C.-C. Jay Kuo University of Southern California Multimedia Signal Processing.
2 3 Be introduced in H.264 FRExt profile, but most H.264 profiles do not support it. Do not need motion estimation operation.
Rate-GOP Based Rate Control for HEVC SHANSHE WANG, SIWEI MA, SHIQI WANG, DEBIN ZHAO, AND WEN GAO IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING,
Guillaume Laroche, Joel Jung, Beatrice Pesquet-Popescu CSVT
Advances in digital image compression techniques Guojun Lu, Computer Communications, Vol. 16, No. 4, Apr, 1993, pp
Fast Mode Decision Algorithm for Residual Quadtree Coding in HEVC Visual Communications and Image Processing (VCIP), 2011 IEEE.
Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University.
An efficient Video Coding using Phase-matched Error from Phase Correlation Information Manoranjan Paul 1 and Golam Sorwar IEEE.
High-efficiency video coding: tools and complexity Oct
IEEE Transactions on Consumer Electronics, Vol. 58, No. 2, May 2012 Kyungmin Lim, Seongwan Kim, Jaeho Lee, Daehyun Pak and Sangyoun Lee, Member, IEEE 報告者:劉冠宇.
Transcoding from H.264/AVC to HEVC
Block-based coding Multimedia Systems and Standards S2 IF Telkom University.
Motion Estimation Multimedia Systems and Standards S2 IF Telkom University.
Time Optimization of HEVC Encoder over X86 Processors using SIMD Kushal Shah Advisor: Dr. K. R. Rao Spring 2013 Multimedia.
Highly Parallel Mode Decision Method for HEVC Jun Zhang, Feng Dai, Yike Ma, and Yongdong Zhang Picture Coding Symposium (PCS),
Mode Decision and Fast Motion Estimation in H.264 K.-C. Yang Qionghai Dai, Dongdong Zhu and Rong Ding,”FAST MODE DECISION FOR INTER PREDICTION IN H.264,”
1/39 Motion Adaptive Search for Fast Motion Estimation 授課老師:王立洋老師 製作學生: M 蔡鐘葳.
Outline  Introduction  Observations and analysis  Proposed algorithm  Experimental results 2.
Principles of Video Compression Dr. S. M. N. Arosha Senanayake, Senior Member/IEEE Associate Professor in Artificial Intelligence Room No: M2.06
Fine-granular Motion Matching for Inter-view Motion Skip Mode in Multi-view Video Coding Haitao Yanh, Yilin Chang, Junyan Huo CSVT.
Fast disparity motion estimation in MVC based on range prediction Xiao Zhong Xu, Yun He ICIP 2008.
E ARLY TERMINATION FOR TZ SEARCH IN HEVC MOTION ESTIMATION PRESENTED BY: Rajath Shivananda ( ) 1 EE 5359 Multimedia Processing Individual Project.
Complexity varying intra prediction in H.264 Supervisors: Dr. Ofer Hadar, Mr. Evgeny Kaminsky Students: Amit David, Yoav Galon.
Introduction to H.264 / AVC Video Coding Standard Multimedia Systems Sharif University of Technology November 2008.
Study and Optimization of the Deblocking Filter in H
Viewport-based 360 Video Streaming:
Viewport-based 360 Video Streaming:
Optimizing Baseline Profile in H
Bongsoo Jung, Byeungwoo Jeon
Sampling Distributions
Presentation transcript:

Low-complexity merge candidate decision for fast HEVC encoding Multimedia and Expo Workshops (ICMEW), 2013 IEEE International Conference on Muchen LI, Keiichi Chono, Satoshi Goto 1

outline  Introduction  Low-complexity merge candidate decision  A. GMV Based Merge Candidate Decision  B. Position-Priority Based Merge Candidate Decision  Simulation Results 2

Introduction #1  Although the Merge mode brings significant coding efficiency improvements, the complexity of its Merge candidate decision associated with Rate-Distortion cost computation is proportional to the number of Merge candidates.  The investigation shows that redundant and unnecessary RD cost computation for particular Merge candidates between Ground-truth MVs (GMVs) obtained by motion estimation (ME) and Merge candidates. 3

Introduction #2  For each PU, the Merge mode utilizes up to 5 MVP candidates and selects the best one based on computationally expensive Rate- Distortion (R-D) cost check for each Merge candidate.  Sun of absolute transformed difference (SATD)  8-tap filter 4

Introduction #3  Merge mode allows at most 5 Merge MV candidates from the previously inter-coded blocks located in the positions described.  5 spatial  2 temporal 5

Introduction #4 6

Introduction #5  As well as Merge mode, AMVP mode also introduces MVP competition technology and predicts the MV of current PU as one of the MVPs.  Ground-truth MV 7

Introduction #6 8

Introduction #7  In the study, it is found that the Merge candidates are typically distributed in the SR and the Merge candidate decision is based on the R-D cost that also uses the SATD measurement.  Checking the SATD for all the Merge candidates is redundant and excessive in some cases. 9

Low-complexity merge candidate decision #A1 GMV Based Merge Candidate Decision  The ME in the AMVP mode check and the merge candidate decision employ the same SATD measurement and there is a correlation between them.  Basically, the GMV has the minimum SATD in the SR and it can be taken as a reference for the Merge candidate decision. 10

Low-complexity merge candidate decision #A2 GMV Based Merge Candidate Decision 11

Low-complexity merge candidate decision #A3 GMV Based Merge Candidate Decision  In Case (2), the GMV is identical to the BMMV, including the prediction direction, reference picture index and MV components. Case (2) can also be called as equal case.  The GMV represents the true MV of the current PU better than or equal to the BMMV (up to 88.38% for LP and 72.91% for RA). 12

Low-complexity merge candidate decision #A4 GMV Based Merge Candidate Decision 13

Low-complexity merge candidate decision #B1 Position-Priority Based Merge Candidate Decision 14

Low-complexity merge candidate decision #B2 Position-Priority Based Merge Candidate Decision  A1, B1, and T are always the dominant positions for all the cases. When the CU size becomes larger, the total proportion of A1, B1 and T becomes smaller and the order of them is varying a little for different partitions.  A1, B1 and T are available  A1, B1 and T are not available 15

Low-complexity merge candidate decision #B3 Position-Priority Based Merge Candidate Decision 16

Simulation Results #1 17

Simulation Results #2 18

Simulation Results #3 19

Simulation Results #4 20