Introduction to Video Transcoding Of MCLAB Seminar Series By Felix.

Slides:



Advertisements
Similar presentations
Low-Complexity Transform and Quantization in H.264/AVC
Advertisements

T.Sharon-A.Frank 1 Multimedia Compression Basics.
MPEG-1: A Standard for Digital Storage of Audio and Video Nimrod Peleg Update: Dec
MPEG4 Natural Video Coding Functionalities: –Coding of arbitrary shaped objects –Efficient compression of video and images over wide range of bit rates.
Basics of MPEG Picture sizes: up to 4095 x 4095 Most algorithms are for the CCIR 601 format for video frames Y-Cb-Cr color space NTSC: 525 lines per frame.
Technion - IIT Dept. of Electrical Engineering Signal and Image Processing lab Transrating and Transcoding of Coded Video Signals David Malah Ran Bar-Sella.
H.264/AVC Baseline Profile Decoder Complexity Analysis Michael Horowitz, Anthony Joch, Faouzi Kossentini, and Antti Hallapuro IEEE TRANSACTIONS ON CIRCUITS.
Efficient multi-frame motion estimation algorithms for MPEG-4 AVC/JVTH.264 Mei-Juan Chen, Yi-Yen Chiang, Hung- Ju Li and Ming-Chieh Chi ISCAS 2004.
Department of Computer Engineering University of California at Santa Cruz Video Compression Hai Tao.
Efficient MPEG Compressed Video Analysis Using Macroblock Type Information Soo-Chang Pei, Yu-Zuong Chou IEEE TRANSACTIONS ON MULTIMEDIA, DECEMBER,1999.
IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 7, NO. 5, OCTOBER 2005
H.264 / MPEG-4 Part 10 Nimrod Peleg March 2003.
Lecture06 Video Compression. Spatial Vs. Temporal Redundancy Image compression techniques exploit spatial redundancy, the phenomenon that picture contents.
Scalable Wavelet Video Coding Using Aliasing- Reduced Hierarchical Motion Compensation Xuguang Yang, Member, IEEE, and Kannan Ramchandran, Member, IEEE.
A New Content-Based Hybrid Video Transcoding Method YongQing Liang YapPeng Tan Presented by Robert Hung.
Motion Vector Refinement for High-Performance Transcoding Jeongnam Youn, Ming-Ting Sun, Fellow,IEEE, Chia-Wen Lin IEEE TRANSACTIONS ON MULTIMEDIA, MARCH.
Fundamentals of Multimedia Chapter 10 Basic Video Compression Techniques Ze-Nian Li & Mark S. Drew 건국대학교 인터넷미디어공학부 임 창 훈.
Fundamentals of Multimedia Chapter 11 MPEG Video Coding I MPEG-1 and 2
Statistical Multiplexer of VBR video streams By Ofer Hadar Statistical Multiplexer of VBR video streams By Ofer Hadar.
1 Image and Video Compression: An Overview Jayanta Mukhopadhyay Department of Computer Science & Engineering Indian Institute of Technology, Kharagpur,
An Introduction to H.264/AVC and 3D Video Coding.
Video Compression Concepts Nimrod Peleg Update: Dec
January 26, Nick Feamster Development of a Transcoding Algorithm from MPEG to H.263.
CSE679: MPEG r MPEG-1 r MPEG-2. MPEG r MPEG: Motion Pictures Experts Group r Standard for encoding videos/movies/motion pictures r Evolving set of standards.
Image and Video Compression
Video Streaming via Transcoding Jianping Fan Department of Computer Science University of North Carolina at Charlotte Charlotte, NC 28223
Kai-Chao Yang Hierarchical Prediction Structures in H.264/AVC.
Electrical Engineering National Central University Video-Audio Processing Laboratory Data Error in (Networked) Video M.K.Tsai 04 / 08 / 2003.
ECE472/572 - Lecture 12 Image Compression – Lossy Compression Techniques 11/10/11.
MPEG MPEG-VideoThis deals with the compression of video signals to about 1.5 Mbits/s; MPEG-AudioThis deals with the compression of digital audio signals.
Page 19/15/2015 CSE 40373/60373: Multimedia Systems 11.1 MPEG 1 and 2  MPEG: Moving Pictures Experts Group for the development of digital video  It is.
Video Coding. Introduction Video Coding The objective of video coding is to compress moving images. The MPEG (Moving Picture Experts Group) and H.26X.
Multimedia Data Video Compression The MPEG-1 Standard
MPEG-1 and MPEG-2 Digital Video Coding Standards Author: Thomas Sikora Presenter: Chaojun Liang.
MPEG: (Moving Pictures Expert Group) A Video Compression Standard for Multimedia Applications Seo Yeong Geon Dept. of Computer Science in GNU.
Picture typestMyn1 Picture types There are three types of coded pictures. I (intra) pictures are fields or frames coded as a stand-alone still image. These.
MPEG Motion Picture Expert Group Moving Picture Encoded Group Prateek raj gautam(725/09)
Adaptive Multi-path Prediction for Error Resilient H.264 Coding Xiaosong Zhou, C.-C. Jay Kuo University of Southern California Multimedia Signal Processing.
June, 1999 An Introduction to MPEG School of Computer Science, University of Central Florida, VLSI and M-5 Research Group Tao.
Image Compression Supervised By: Mr.Nael Alian Student: Anwaar Ahmed Abu-AlQomboz ID: IT College “Multimedia”
8. 1 MPEG MPEG is Moving Picture Experts Group On 1992 MPEG-1 was the standard, but was replaced only a year after by MPEG-2. Nowadays, MPEG-2 is gradually.
Compression video overview 演講者:林崇元. Outline Introduction Fundamentals of video compression Picture type Signal quality measure Video encoder and decoder.
Guillaume Laroche, Joel Jung, Beatrice Pesquet-Popescu CSVT
Video Watermarking Real-time Labeling of MPEG-2 Compressed Video G. C. Langelaar, R. L. Lagendijk, and J. Biemond ITS, ICTG, Delft University of Technology.
MPEG-1Standard By Alejandro Mendoza. Introduction The major goal of video compression is to represent a video source with as few bits as possible while.
Overview of Fine Granularity Scalability in MPEG-4 Video Standard Weiping Li Presented by : Brian Eriksson.
Page 11/28/2016 CSE 40373/60373: Multimedia Systems Quantization  F(u, v) represents a DCT coefficient, Q(u, v) is a “quantization matrix” entry, and.
Block-based coding Multimedia Systems and Standards S2 IF Telkom University.
Video Compression and Standards
MPEG CODING PROCESS. Contents  What is MPEG Encoding?  Why MPEG Encoding?  Types of frames in MPEG 1  Layer of MPEG1 Video  MPEG 1 Intra frame Encoding.
Motion Estimation Multimedia Systems and Standards S2 IF Telkom University.
Hierarchical Systolic Array Design for Full-Search Block Matching Motion Estimation Noam Gur Arie,August 2005.
Introduction to MPEG Video Coding Dr. S. M. N. Arosha Senanayake, Senior Member/IEEE Associate Professor in Artificial Intelligence Room No: M2.06
6/9/20161 Video Compression Techniques Image, Video and Audio Compression standards have been specified and released by two main groups since 1985: International.
Multi-Frame Motion Estimation and Mode Decision in H.264 Codec Shauli Rozen Amit Yedidia Supervised by Dr. Shlomo Greenberg Communication Systems Engineering.
CMPT365 Multimedia Systems 1 Media Compression - Video Spring 2015 CMPT 365 Multimedia Systems.
MPEG Video Coding I: MPEG-1 1. Overview  MPEG: Moving Pictures Experts Group, established in 1988 for the development of digital video.  It is appropriately.
Computational Controlled Mode Selection for H.264/AVC June Computational Controlled Mode Selection for H.264/AVC Ariel Kit & Amir Nusboim Supervised.
H. 261 Video Compression Techniques 1. H.261  H.261: An earlier digital video compression standard, its principle of MC-based compression is retained.
JPEG Compression What is JPEG? Motivation
Overview of the Scalable Video Coding
"Digital Media Primer" Yue-Ling Wong, Copyright (c)2013 by Pearson Education, Inc. All rights reserved.
Video Compression - MPEG
Research Topic Error Concealment Techniques in H.264/AVC for Wireless Video Transmission Vineeth Shetty Kolkeri EE Graduate,UTA.
Prof. Jayanta Mukhopadhyay
CIS679: MPEG MPEG.
ENEE 631 Project Video Codec and Shot Segmentation
Standards Presentation ECE 8873 – Data Compression and Modeling
MPEG4 Natural Video Coding
Scalable light field coding using weighted binary images
Presentation transcript:

Introduction to Video Transcoding Of MCLAB Seminar Series By Felix

Content  Introduction  MPEG Coding Basics  Transcoding Algorithms  Summary

Introduction

 Heterogeneous Networks in VoD Different Network Bandwidths  Heterogeneous Client Configurations Different Screen Resolutions, CPU speed, etc. Different Decoders (eg. MPEG 1, 2, H.263, Quicktime… etc.)

Introduction  Solutions Multiple Copies Simple and Fast Waste Storage Re-encoding Only one high-quality video is stored Complex motion estimation is required

Introduction Cont’ Use video formats with bit-rate scalability (e.g. MPEG 4) Transcoding Convert a compressed video into another compressed video with lower bit rate or in other formats.

Introduction  Transcoding Only one high quality compressed video is stored No/Much less computations on motion estimation Can produce comparable video quality with direct encoding Partial Decode Transcode Partial Encode Input MovieOutput Movie Drop away data selectively

MPEG Coding Basics  A MPEG stream consists of 3 types of frames I (Intra-coded) P (Predictive-coded) B (Bidirectional-predictive coded)

MPEG Coding Basics  I Frames The original picture represented can be reconstructed without reference to other frames  P Frames The original picture has to be reconstructed with reference to the past constructed I or P frames  B Frames The original picture has to be reconstructed with reference to the past and future constructed I or P frames

MPEG Coding Basics  Macroblocks 16 = Y Cr Cb Frame Macroblock

MPEG Coding Basics  Coding of Macroblocks 5 types of coding mode Intra-coded Forward Predictive-coded Backward Predictive-coded Bidirectional Predictive-coded Skipped

MPEG Coding Basics Types of macroblocks in I, P and B frames Intra- coded Forward Predictive-coded Backward Predictive- coded Bidirectional Predictive- coded Skipped I X P XXX B XXXXX

MPEG Coding Basics Predictive-coding Motion Vector Reference frameCurrent frame - = Actual MBRef. MBPrediction Residue

MPEG Coding Basics Encoding of a 8x8 block DCTQuantizationRun Length Coding Huffman Coding

Transcoding Algorithms  Requantization Some DCT coefficients become zero after coarser quantization Open-loop Requantization Q 1 -1 Q2Q2 Input StreamOutput Stream

Transcoding Algorithms Drifting effect of open-loop requantization Requantization error accumulates along the frames Eg. Original: += After Requantization: Prediction ResidueReference MBActual MB + =

Transcoding Algorithms PSNR drops along the frames

Transcoding Algorithms Spatial-domain drift-free Requantization Extracted from: “A Frequency-Domain video Transcoder for Dynamic Bit-Rate Reduction of MPEG-2 Bit Streams”

Transcoding Algorithms  Frequency-domain drift-free Requantization Accumulated error Extracted from: “A Frequency-Domain video Transcoder for Dynamic Bit-Rate Reduction of MPEG-2 Bit Streams”

Transcoding Algorithms  MC-DCT (Motion Compensation in DCT) A1A1 A2A2 A3A3 A0A0 A ref Current Block h w 8-h 8-w In the reference frame (DCT) In the current frame (DCT) Motion Vector

Transcoding Algorithms  Limitations of requantization Limited bit rate reduction The clients may have lower screen resolution than the original video, thus the video bit rate can be further reduced by reducing the video resolution

Transcoding Algorithms  Spatial downscaling Compressed movie is downscaled spatially in a multiple of 2 in both horizontal and vertical directions Four macroblocks are combined and downscaled to the size of one macroblock Much more complicated than requantization

Transcoding Algorithms General Block Diagram of Spatial Downscaling Buffer Frames Reconstruction DownscalingReconstruction of Motion Vectors Reconstruction of Prediction Residual Reconstruction of macroblocks Original frame downscaled frame

Transcoding Algorithms  Problems to be solved in spatial downscaling Macroblock coding mode decision Motion vector reconstruction Downscaling

Transcoding Algorithms  Macroblock Coding Mode Decision Intra Coded Backward Predictive Coded Bidirectional Predictive Coded Forward Predictive Coded + ?

Transcoding Algorithms Cont’ Very few researches worked specifically on this problem Considerations Target bit rate  Intra-coding mode requires more bits Speed  Bidirectional predictive coding is the most computational expensive  Intra coding is the least computational expensive Quality  Intra coding introduces no drift

Transcoding Algorithms  Motion Vector Reconstruction

Transcoding Algorithms  Align To Average One common method is align-to-average(AAW) AAW gives poor results when the four motion vectors are not well- aligned

Transcoding Algorithms  Adaptive Motion Vector Resampling (AMVR) A i is the weighting associated with motion vector V i Extracted from: “Adaptive Motion-Vector Resampling for Compressed Video Downscaling” By Bo Shen, Ishwar K. Sethi, and Bhaskaran Vasudev

Transcoding Algorithms Cont’ The resulting motion vector should skew closer to the motion vector that yielded poor prediction (larger A i ), this is so called align-to-worst (AWW) A i is calculated as the number of nonzero AC coefficients (DCT coefficients at positions other then (0,0))

Transcoding Algorithms  Predictive Motion Estimation (PME) Similar to full-search motion estimation, however, it just compares the Mean Absolute Difference (MAD) obtained from 4 candidate motion vectors (V i /2). If none of the MAD obtained is zero, then a new candidate motion vector is computed with the equation proposed by AMVR where A i =1/MAD i Extracted from: “Predictive Motion Estimation for Reduced-Resolution Video from High- resolution Compressed Video” By Justy W.C. Wong, Oscar C. Au, Peter H. W. Wong and A. Tourapis

Transcoding Algorithms Cont’ Then choose the candidate vector with the minimum MAD value as the new motion vector PME produces higher quality than AMVR but requires much more computations

Transcoding Algorithms  Downscaling Given a picture in DCT domain, how to downscale the spatial resolution of it? Downscale in pixel domain Original DCT Picture IDCT Original Pixel Picture Averaging Every 4 Neighboring pixels Downscaled Pixel Picture DCT Downscaled DCT Picture

Transcoding Algorithms Downscaling in DCT domain A1A1 A3A3 A4A4 A2A2 X ST STST T X AsAs 00 0 Extracted from: “A fast approximate algorithm for scaling down digital images in the DCT domain” by B. Natarajan and V. Bhaskaran

Transcoding Algorithms  Temporal Downscaling In typical movies, the difference between consecutive pictures is usually small, so some frames can be safely skipped without any significant quality degradation The decoders have to repeat the previous non- skipped picture to maintain the same playback speed

Transcoding Algorithms  B frames can be skipped without affect other frames  Skipping P or I frames is much more complicated, as this affects the subsequent P and B frames

Transcoding Algorithms  Finding the new best-matched MB ? FtFt F t-1 (Skipped)F t-2

Transcoding Algorithms  Motion Vector Reconstruction for temporal downscaling =? MV t ’ = MV t + MV t-1

Transcoding Algorithms Cont’ MV t-1 can computed by adopting the AMVR equation with A i being the overlapping area of MB t-1 on MB i After finding the MB t-2, we can reconstruct the prediction residue of MB t

Transcoding Algorithms  Which method is the best? No absolute answer because Image complexity and motion activity varies along the video streams Depends on target bit rate  Content-based hybrid transcoding Use different transcoding algorithms in different parts of a video stream according to the content

Summary  Video transcoding is a good solution to provide an adaptive VoD service in a heterogeneous environment because of its Low storage requirement Low computational complexity Comparable quality with direct encoding  Requantization, spatial and temporal downscaling are the most common transcoding algorithms  Content-based Hybrid Transcoding combines different algorithms to improve the overall transcoding performance

Thank You