Presentation is loading. Please wait.

Presentation is loading. Please wait.

Progressive Side Information Refinement with Non-Local Means Denoising in Distributed Video Coding 使用於分散式視訊編碼之非區域平均去雜訊循 序旁資訊改善技術 Wang, Pin-Hsiang 王品翔 Advisor:

Published byCory Holmes Modified over 9 years ago

Similar presentations

Presentation on theme: "Progressive Side Information Refinement with Non-Local Means Denoising in Distributed Video Coding 使用於分散式視訊編碼之非區域平均去雜訊循 序旁資訊改善技術 Wang, Pin-Hsiang 王品翔 Advisor:"— Presentation transcript:

1 Progressive Side Information Refinement with Non-Local Means Denoising in Distributed Video Coding 使用於分散式視訊編碼之非區域平均去雜訊循 序旁資訊改善技術 Wang, Pin-Hsiang 王品翔 Advisor: Prof. Wu, Ja-Ling 吳家麟 教授 2011/10/13 CMLab, CSIE, NTU

2  Introduction and Motivation  DVC Architecture Overview  Proposed Side Information Refinement Framework  Experimental Result  Conclusions and Future Work Outline 2 CMLab, CSIE, NTU

3 Emerging application CMLab, CSIE, NTU 3 mobile cameras phone Wireless sensor network Video surveillance mobile video conference  Requiring low complexity and power-efficient encoder…

4 4 CMLab, CSIE, NTU Emerging application  Conventional video coding (e.g. H.264/AVC, MPEG-2) - I nherent high complexity encoder, low complexity decoder  Requiring low complexity and power-efficient encoder…  Distributed video coding (DVC) - New video coding paradigm shifts complexity from encoder to decoder

5 Application of DVC 5 DVC to H.264 Transcoder Cloud Computational Resource DVC encoder (Low Complexity) H.264 decoder (Low Complexity) DVC encoded bitstream H.264 encoded bitstream CMLab, CSIE, NTU  Make the Clients slimmer & thinner

6 Distributed Video Coding Joint Encoder Joint Decoder Statistical dependency Encoder X Joint Decoder Statistical dependency is not exploited Encoder Y Conventional video coding paradigm Slepian-Wolf theorem CMLab, CSIE, NTU  Slepian-Wolf Theorem (1973, Lossless coding)  Wyner-Ziv Theorem (1976, Lossy coding) 6

7 Distributed Video Coding 7 Source Encoder Source Encoder Source Encoder Source Encoder Quantizer Source Encoder Source Encoder Statistical dependency is not exploited Quantizer Source Encoder Source Encoder Correlation is exploited at the decoder side Joint Decoder Encoder X Encoder Y Parity bits Channel Encoder Channel Decoder side information (SI) Side Information Estimation Virtual channel CMLab, CSIE, NTU DVC is also called Wyner-Ziv video coding (WZVC) Corrupted version of X  Wyner-Ziv Theorem (1976, Lossy coding) Quality

8 Motivation 8 CMLab, CSIE, NTU Past reference frame Future reference frame Source X Encoder-side Decoder-side F( t-1 ) F( t+1 ) F( t ) Side Information Estimation F( t )

9 Motivation 9 CMLab, CSIE, NTU Past reference frame Future reference frame Source X Encoder-side Decoder-side F( t-1 ) F( t+1 ) F( t ) Frame interpolation (Decoder-side ME) F( t )

10 Motivation 10 CMLab, CSIE, NTU Past reference frame Future reference frame Source X Encoder-side Decoder-side F( t-1 ) F( t+1 )F( t ) Side information F( t )

11 Motivation 11 CMLab, CSIE, NTU Past reference frame Future reference frame Source X Encoder-side Decoder-side F( t-1 ) F( t+1 )F( t ) Side information Limitation F( t ) Most reported WZ codecs have a poor RD performance for high motion and large GOP size sequences

12  Non-Local Means Side Information Refinement framework (NLM-SIR) for DVC is proposed NLM-SIR framework for DVC 12 CMLab, CSIE, NTU  Improve the SI quality to better rate-distortion (RD) performance of WZVC  Overcoming some of the limitations about current SI estimation methods in WZVC

13  Introduction and Motivation  DVC Architecture Overview  Proposed Side Information Refinement Framework  Experimental Result  Conclusions and Future Work Outline 13 CMLab, CSIE, NTU

14  Reference codec :  DISCOVER codec (Distributed coding for video services)  X. Artigas et al., “The DISCOVER codec: architecture, techniques and evaluation”, PCS, 2007  Feedback channel based transform domain WZ codec DVC Architecture Overview 14 CMLab, CSIE, NTU

15 WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder DISCOVER Codec Architecture Soft Input Key Frame Key Frame WZ Frame GOP size 2 WZ Frame WZ Frame WZ Frame GOP size 4 Key Frame Key Frame Ref. X. Artigas et al., PCS, 2007 15

16 Quantization 16  DCT coefficients bands DCT coefficient band b1 : { S 1 1, S 2 1, S 3 1, …S N 1 } DCT coefficient band b2 : { S 1 2, S 2 2, S 3 2, …S N 2 } DCT coefficient band b16 : { S 1 16, S 2 16, S 3 16, …S N 16 } … DC band AC bands Block1 S11S11 S12S12 S16S16 S17S17 S13S13 S15S15 S18S18 S 1 13 S14S14 S19S19 S 1 12 S 1 14 S 1 10 S 1 11 S 1 15 S 1 16 Block2 S21S21 S22S22 S26S26 S27S27 S23S23 S25S25 S28S28 S 2 13 S24S24 S29S29 S 2 12 S 2 14 S 2 10 S 2 11 S 2 15 S 2 16 Block3 S31S31 S32S32 S36S36 S37S37 S33S33 S35S35 S38S38 S 3 13 S34S34 S39S39 S 3 12 S 3 14 S 3 10 S 3 11 S 3 15 S 3 16 …

17 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Ref. X. Artigas et al., PCS, 2007 17

18 Bit plane Extraction 18 0010000001 00000 11110 Bit planes of DC band: Bit plane 1: Bit plane 2: Bit plane 3: Bit plane 4: Bit plane 5: Independently Channel Encode (LDPCA) 46 7 06 3 1 7 7 30 1 5  For each DCT coefficient band… MSB LSB Zig-zag order

19 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Ref. X. Artigas et al., PCS, 2007 19

20 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Forward motion estimation Ref. X. Artigas et al., PCS, 2007 20

21 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Bidirectional motion estimation & compensation Ref. X. Artigas et al., PCS, 2007 21

22 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Ref. X. Artigas et al., PCS, 2007 22

23 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Ref. X. Artigas et al., PCS, 2007 Laplacian distribution 23

24 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Conditional bit probabilities Ref. X. Artigas et al., PCS, 2007 Iterative decoding (band by band, bitplane by bitplane) 24

25 Reconstruction 25 CMLab, CSIE, NTU Quantization Interval  Boundary reconstruction method : Case1 Case2 Case3

26 DISCOVER Codec Architecture WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Soft Input Poor RD performance for high motion and large GOP size sequences Room for improvement Ref. X. Artigas et al., PCS, 2007 26

27  Introduction and Motivation  DVC Architecture Overview  Proposed Side Information Refinement Framework  Experimental Result  Conclusions and Future Work Outline 27 CMLab, CSIE, NTU

28 NLM-SIR framework 28 Original X WZ frame (at the encoder) Side information Y WZ (at the decoder) Correlation noise N between Original X WZ frame and side information  Reduce noise to achieve better SI quality  Denoising problem

29 NLM-SIR framework 29 Iterative decoding (band by band)  New information about original WZ frame is not exploited  Progressive available during decoding  Not available at the time the initial SI was estimated

30 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture 30

31 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Initial SI (Y WZ ) is always used to decoding the DC band DC band decoding 31

32 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture AC bands decoding 32

33 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Other decoding iterations NLM-SIR Partially decoded WZ frame Refined Side Information 33

34 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Other decoding iterations Decoded coefficients Copy from Initial SI coefficients 34

35 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Other decoding iterations 35

36 Fine SI blocks : Noisy SI blocks : Candidate Block Selection (1) Noise Computation : (2) Block Selection for Refinement: Noise indicator  Selection of the SI blocks which are worthwhile of refining  Initial guess by the side information creation process has basically failed 36

37 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Other decoding iterations 37

38 Non-Local Means  Images possess repeating elements and patches 38

39 Non-Local Means Refinement CMLab, CSIE, NTU 39 Partially decoded frame P WZ  NLM algorithm :  Similarity measurement

40 Non-Local Means Refinement 40 Smoothing parameter h : Partially decoded frame P WZ  Weight assignment :

41 Non-Local Means Refinement 41 Partially decoded frame P WZ Assigned the same value as the maximum of the other weights observed in the searching window  Weight assignment :

42 Non-Local Means Refinement 42 Past decoded frameFuture decoded framePartially decoded frame  Searching for more similar patches…

43 Non-Local Means Refinement 43  Take into account of the temporal similar patches

44 Parameter Setting of NLM 44

45 Parameter Setting of NLM CMLab, CSIE, NTU 45 Motion compensated residual frame Correlation noise

46 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Other decoding iterations Update Noise Distribution Model : Y ’ (u,v) Y(u,v) X(u,v) Probability Coefficient Value Refined SI coefficient 46

47 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Other decoding iterations Failed refinement detection (q+1) ‧ W k q‧Wkq‧Wk Quantization bin refined SI unrefined SI 47

48 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture Progressive refinement # of decoded bands PSNR, dB SI quality of 13 th frame in Foreman 48

49 WZ EncoderWZ Decoder Soft Input Y ’ WZ Y DCT X DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes NLM Refinement Candidate Block Selection P WZ Proposed Codec Architecture NLM-SIR Bitrate savings Quality gains 49

50  Introduction and Motivation  DVC Architecture Overview  Proposed Side Information Refinement Framework  Experimental Result  Conclusions and Future Work Outline 50 CMLab, CSIE, NTU

51  Test sequences :  QCIF, 15Hz, all frames  GOP Size 2, 4 and 8  Only luminance component is used Test materials CMLab, CSIE, NTU 51 SoccerForemanCoastguardHall Monitor Motion: High Low

52 PSNR Temporal Evolution Avg : 1.50 dB Max : 3.12 dB Avg : 0.88 dB Max : 1.91 dB Avg : 0.42 dB Max : 2.05 dB Avg : 0.13 dB Max : 0.67 dB Achieving better decoded quality, especially for high motion content zones Scenario : GOP = 8, Q 8 52

53 Bitrate Temporal Evolution Avg : 5.58 kbits Max : 13.90 kbits Avg : 4.78 kbits Max : 9.36 kbits Avg : 1.23 kbits Max : 7.73 kbits Avg : 0.32 kbits Max : 1.15 kbits Scenario : GOP = 8, Q 8 53

54 Overall RD Performance (GOP=8) 2.5 dB 2.0 dB 0.6 dB 0.3 dB 54

55 Overall RD Performance (GOP=4) 55

56 Overall RD Performance (GOP=2) 56

57 Decoding Time Complexity 57 Total decoding time (Sec.) Q 8, GOP = 8, whole sequence (150 frames) There tests were performed on an Intel Core2 Quad Processor at 2.40 GHz with 4.0 GB of RAM (Windows 7 operating system) Usage of better SI results in fewer rate requests and thus fewer LDPCA decoder runs

58 Decoding Time Complexity 58 Total decoding time (Sec.) Q 4, GOP = 8, whole sequence (150 frames) There tests were performed on an Intel Core2 Quad Processor at 2.40 GHz with 4.0 GB of RAM (Windows 7 operating system)

59  Highly parallelized decoder  DISPAC codec (Distributed video coding with parallelized design for cloud computing) NLM-SIR for DISPAC Codec 59 CMLab, CSIE, NTU  State-of-the-art RD performance - Effective integrate numerous advanced tools

60 Overall RD Performance (GOP=8) 60

61 Decoding Time Complexity 61 Total decoding time (Sec.) Q 8, GOP = 8, whole sequence (150 frames) 4core + GPU CMLab, CSIE, NTU There tests were performed on an Intel Core2 Quad Processor at 2.40 GHz with 4.0 GB of RAM (Windows 7 operating system)  The processing of NLM-SIR can be highly parallelized (CUDA)

62  Introduction and Motivation  DVC Architecture Overview  Proposed Side Information Refinement Framework  Experimental Result  Conclusions and Future Work Outline 62 CMLab, CSIE, NTU

63  A NLM-based side information refinement (NLM-SIR) framework for WZVC is proposed Conclusion 63 CMLab, CSIE, NTU  Universally applicable in most DCT domain WZVC schemes  Provide significant RD gain over existing WZVC framework, notably for the conditions where usually WZVC performs worse  Introduce negligible overhead on the decoding time, and the processing module can be highly parallelized

64 Future work 64 CMLab, CSIE, NTU  Spatial adaptive parameter setting of NLM-SIR during the decoding  A more suitable and powerful transform-domain denoising algorithm could be considered to substitute for NLM

65 Thank You CMLab, CSIE, NTU 65

66 DISPAC codec with NLM-SIR WZ Encoder X DCT Y DCT X’FX’F X’PX’P XKXK X WZ Y WZ Uniform Quantizer DCT LDPCA Encoder Buffer CRC Gen LDPCA Decoder CRC Check Multi-SI Reconstruction IDCT Correlation Noise Modeling Correlation Noise Modeling H.264/AVC Intra Encoder H.264/AVC Intra Decoder Frame Buffer Side Information Creation DCT CRC-8 Feedback Channel WZ Bitstream Slepian-Wolf Encoder Slepian-Wolf Decoder WZ Frames Key Frames Decoded WZ Frames Decoded Key Frames Bitplanes WZ Decoder Block Mode Selection Soft Input Deblocking Filter Deblocking Filter Motion Learning SI Refinement Non-Local Means SI Refinement P WZ Y ’ WZ Y ’’ WZ 66

Download ppt "Progressive Side Information Refinement with Non-Local Means Denoising in Distributed Video Coding 使用於分散式視訊編碼之非區域平均去雜訊循 序旁資訊改善技術 Wang, Pin-Hsiang 王品翔 Advisor:"

Similar presentations

WYNER-ZIV VIDEO CODING WITH CLASSIED CORRELATION NOISE ESTIMATION AND KEY FRAME CODING MODE SELECTION Present by fakewen.

WYNER-ZIV VIDEO CODING WITH CLASSIED CORRELATION NOISE ESTIMATION AND KEY FRAME CODING MODE SELECTION Present by fakewen.
Introduction to H.264 / AVC Video Coding Standard Multimedia Systems Sharif University of Technology November 2008.

Introduction to H.264 / AVC Video Coding Standard Multimedia Systems Sharif University of Technology November 2008.
-1/20- MPEG 4, H.264 Compression Standards Presented by Dukhyun Chang

-1/20- MPEG 4, H.264 Compression Standards Presented by Dukhyun Chang
H.264/AVC Baseline Profile Decoder Complexity Analysis Michael Horowitz, Anthony Joch, Faouzi Kossentini, and Antti Hallapuro IEEE TRANSACTIONS ON CIRCUITS.

H.264/AVC Baseline Profile Decoder Complexity Analysis Michael Horowitz, Anthony Joch, Faouzi Kossentini, and Antti Hallapuro IEEE TRANSACTIONS ON CIRCUITS.
Limin Liu, Member, IEEE Zhen Li, Member, IEEE Edward J. Delp, Fellow, IEEE CSVT 2009.

Limin Liu, Member, IEEE Zhen Li, Member, IEEE Edward J. Delp, Fellow, IEEE CSVT 2009.
SCHOOL OF COMPUTING SCIENCE SIMON FRASER UNIVERSITY CMPT 820 : Error Mitigation Schaar and Chou, Multimedia over IP and Wireless Networks: Compression,

SCHOOL OF COMPUTING SCIENCE SIMON FRASER UNIVERSITY CMPT 820 : Error Mitigation Schaar and Chou, Multimedia over IP and Wireless Networks: Compression,
Evaluation of Data-Parallel Splitting Approaches for H.264 Decoding

Evaluation of Data-Parallel Splitting Approaches for H.264 Decoding
Reinventing Compression: The New Paradigm of Distributed Video Coding Bernd Girod Information Systems Laboratory Stanford University.

Reinventing Compression: The New Paradigm of Distributed Video Coding Bernd Girod Information Systems Laboratory Stanford University.
Rate-Distortion Optimized Layered Coding with Unequal Error Protection for Robust Internet Video Michael Gallant, Member, IEEE, and Faouzi Kossentini,

Rate-Distortion Optimized Layered Coding with Unequal Error Protection for Robust Internet Video Michael Gallant, Member, IEEE, and Faouzi Kossentini,
Overview of Fine Granularity Scalability in MPEG-4 Video Standard Weiping Li, Fellow, IEEE.

Overview of Fine Granularity Scalability in MPEG-4 Video Standard Weiping Li, Fellow, IEEE.
Distributed Video Coding Bernd Girod, Anne Margot Aagon and Shantanu Rane, Proceedings of IEEE, Jan, 2005 Presented by Peter.

Distributed Video Coding Bernd Girod, Anne Margot Aagon and Shantanu Rane, Proceedings of IEEE, Jan, 2005 Presented by Peter.
Wyner-Ziv Coding of Motion Video

Wyner-Ziv Coding of Motion Video
Scalable Wavelet Video Coding Using Aliasing- Reduced Hierarchical Motion Compensation Xuguang Yang, Member, IEEE, and Kannan Ramchandran, Member, IEEE.

Scalable Wavelet Video Coding Using Aliasing- Reduced Hierarchical Motion Compensation Xuguang Yang, Member, IEEE, and Kannan Ramchandran, Member, IEEE.
Encoder and Decoder Optimization for Source-Channel Prediction in Error Resilient Video Transmission Hua Yang and Kenneth Rose Signal Compression Lab ECE.

Encoder and Decoder Optimization for Source-Channel Prediction in Error Resilient Video Transmission Hua Yang and Kenneth Rose Signal Compression Lab ECE.
Introduction to Video Transcoding Of MCLAB Seminar Series By Felix.

Introduction to Video Transcoding Of MCLAB Seminar Series By Felix.
Wyner-Ziv Residual Coding of Video Anne Aaron, David Varodayan and Bernd Girod Information Systems Laboratory Stanford University.

Wyner-Ziv Residual Coding of Video Anne Aaron, David Varodayan and Bernd Girod Information Systems Laboratory Stanford University.
Source-Channel Prediction in Error Resilient Video Coding Hua Yang and Kenneth Rose Signal Compression Laboratory ECE Department University of California,

Source-Channel Prediction in Error Resilient Video Coding Hua Yang and Kenneth Rose Signal Compression Laboratory ECE Department University of California,
1 Department of Electrical Engineering Stanford University Anne Aaron, Shantanu Rane and Bernd Girod Wyner-Ziv Video Coding with Hash-Based Motion Compensation.

1 Department of Electrical Engineering Stanford University Anne Aaron, Shantanu Rane and Bernd Girod Wyner-Ziv Video Coding with Hash-Based Motion Compensation.
` 1 Department of Electrical Engineering, Stanford University Anne Aaron, Prashant Ramanathan and Bernd Girod Wyner-Ziv Coding of Light Fields for Random.

` 1 Department of Electrical Engineering, Stanford University Anne Aaron, Prashant Ramanathan and Bernd Girod Wyner-Ziv Coding of Light Fields for Random.
H.264/AVC for Wireless Applications Thomas Stockhammer, and Thomas Wiegand Institute for Communications Engineering, Munich University of Technology, Germany.

H.264/AVC for Wireless Applications Thomas Stockhammer, and Thomas Wiegand Institute for Communications Engineering, Munich University of Technology, Germany.

Similar presentations

Ads by Google