1. Gary DemosLossless Residual System, 24Feb2006 1 Lossless Layered Residual System Gary Demos HPA 24Feb2006 Palm Springs, CA

2. Gary DemosLossless Residual System, 24Feb2006 2 Features Arbitrary Precision Direct Support of Integers of Arbitrary Precision (8bits up to 16 bits tested) Floating via Direct Lossless Layered Support of OpenExr 16-bit Half-Float Wide Dynamic Range Half-Float Integrated With Floating-Point Layered Codec (as presented Oct 2004 SMPTE Pasadena)

3. Gary DemosLossless Residual System, 24Feb2006 3 Use of Bins Uses Bins Like the OpenExr 16-bit Half-Float “Piz” Compressor Bin List Is Sorted, and Contains All Pixel Values From Original Image Bins Can Contain Integers or Floating-Point of Arbitrary Precision Floating Point Values Can Have Any Arbitrary Dynamic Range Negative Values Are Fully Supported Currently Optimized For Integers from 8 to 16 bits, and 16-bit Half-Float Bins Are Referenced Solely By Integer Index (“Bin Number”) Unused Codes In Wide Range Representations (e.g. 16-bit Half-Float) Automatically Eliminated From Bin List

4. Gary DemosLossless Residual System, 24Feb2006 4 Lossy Codec Floating Value Bin List Nearest Bin Desired (Lossless) Bin Integer Bin Delta

5. Gary DemosLossless Residual System, 24Feb2006 5 Floating Lossy Value On A Cusp (nearly equidistant) Floating Point Original Values If on a Cusp, Flag This Pixel’s Primary Indicate Whether to Go Up or Down or Code The Final Bin Directly Only a Small Proportion of Pixels Will Be on a Cusp Solely a Function of Lossy Floating-Point Precision (e.g. 32-bit Floating) Necessary Because of Processor and Compiler Inconsistencies (e.g. P4 vs G5)

6. Gary DemosLossless Residual System, 24Feb2006 6 Noise-Reduced-Driven-Intermediate How To Find A Useful Intermediate Bin On the Way To Lossless? A Proportion Of the Distance And / Or Driven By A Noise-Reduced Original Image Constrain To Range Between Lossy Nearest Bin and Lossless Bin

7. Gary DemosLossless Residual System, 24Feb2006 7 Lossy Codec Floating Value Bin List Nearest Bin Desired (Lossless) Bin Two Bin Deltas Noise-Reduced Original Intermediate Bin

8. Gary DemosLossless Residual System, 24Feb2006 8 Noise-ReducedOriginalLossy Codec Bin-Delta Intermediate(s) Bin-Delta Lossless (bit exact) Floating Point Integer or Floating Point

9. Gary DemosLossless Residual System, 24Feb2006 9 Bin List Subset(s) Reduce Intermediate Bin Deltas By Shifting or Scaling And / Or Create a Subset of the Bin List From The Original More Than One Subset Can Support More Than One Intermediate Subsets Can Be Matched To Noise Floor Or Can Take Ever-Deeper “Bites” Out of the Noise Floor Values Can Be Added To Subset (If Not Present In Original) For Useful Step(s)

10. Gary DemosLossless Residual System, 24Feb2006 10 Floating Point Bin List Subset For Intermediate(s):

11. Gary DemosLossless Residual System, 24Feb2006 11 Integer Bin List Subset For Intermediate(s):

12. Gary DemosLossless Residual System, 24Feb2006 12 Results Stem MMR4 4096x1714 12-bit RGB packed within 16-bit Tiff16 (Film) Patuxent River Air Ops 1920x1080 @30fps 10bit Viper Filmstream to 16-bit Half-Float Garden Music 1280x720 @59.94fps 10-bit Viper Filmstream to 8-bit DPX (8bit in 10bit) Sphere 4096 x 2160 16-bit RGB as Tiff16 (noiseless CGI)

13. Gary DemosLossless Residual System, 24Feb2006 13 Stem MMR4:

14. Gary DemosLossless Residual System, 24Feb2006 14 PaxRiver performance of OpenExr “piz” and gzip of “piz”:

15. Gary DemosLossless Residual System, 24Feb2006 15 PaxRiver 1920 x 1080 10-bit Filmstream color adjusted using conversion to linear with rgb scale factors into OpenExr 16-bit half-float:

16. Gary DemosLossless Residual System, 24Feb2006 16 Garden Music (8-bit) Comparison with gzip:

17. Gary DemosLossless Residual System, 24Feb2006 17 Garden Music (8-bit):

18. Gary DemosLossless Residual System, 24Feb2006 18 Sphere Test Dataset (16-bit):

19. Gary DemosLossless Residual System, 24Feb2006 19 Sphere Test Dataset (8-bit):

20. Gary DemosLossless Residual System, 24Feb2006 20 Realtime Software Decoder (Quad G5):

21. Gary DemosLossless Residual System, 24Feb2006 21 Conclusions: Lossless bin-delta-style residual can be integraded with floating-point wavelet-style codec Efficiency is good, rivalling or exceeding other lossless codecs Supports arbitrarily wide dynamic range (including negative numbers) Noise-reduction integrated with codec, including integration with lossless bin-delta system Noise-reduced-driven intermediate layer forms a highly useful (perhaps optimal) step on the way to the lossless original Intermediates can be as finely layered as desired

22. Gary DemosLossless Residual System, 24Feb2006 22 Contact SMPTE or see me if you don’t have a copy of my October 2004 Pasadena SMPTE codec paper and would like one Questions?