1. MPEG-4 AVC robust video watermarking based on QIM and perceptual masking principles Marwen HASNAOUI Maher BELHAJ Mihai MITREA Françoise PRETEUX ARTEMIS Department Institut Télécom Télécom SudParis Evry - France

2. Outline  Compressed domain watermarking  A robust compressed-domain watermarking  Conclusion and further work  m-ST-QIM insertion (new perceptual shaping, energy selection criterion)  Detection  Experimental result A contradiction in terms? Between myth and reality! Between myth and reality!

3. Selection Buy Right Send content Distribution Internet VOD server BOB Justice Context Storage MPEG-4 AVCWatermarking Challenge: Real time, robust watermarking for MPEG-4 AVC Video visual redundancy exploited in order to hide watermark Video visual redundancy eliminated Context: VoD distribution

4. State-of-the-art panorama D. Zou, and J.A. Bloom H.264/AVC STREAM REPLACEMENT TECHNIQUE FOR VIDEO WATERMARKING 2009.  Embedding at the Decoder side A. Golikeri, and R.M. Mersereau Robust digital video watermarking scheme for H.264 advanced videocoding standard”, Journal of Electronic imaging 16, 2007.  QIM Mark generation M. Noorkami, P. Nasiopoulos, and Z. J. Wang Compressed ‑ domain video watermarking for H.264, IEEE Intl. Conf. on Image Processing, Vol. 2, September 2005.  Perceptual shaping adapted to syntax features ComWat algorithm (May 2010) Less complexity Best robustness Best transparency Large data payload Multi-symbole ComWat algorithm

5. m-ComWat algorithm: distinctive factors  m-array Quantization Index Modulation method [Chen and Worwell]  Energy selection criteria based on information theory concepts  First perceptual masking mechanism in MPEG-4 AVC Between myth and reality  Mark inserted in AC quantized coefficient at the decoder side

6. Watermarked block z Selected Host AC block x Key kMessage m Output Input Perceptual shaping Embedding & Block reconstruction Mark generation Block x Block selection YES NO m-ST-QIM Insertion Between myth and reality

7. Toward an MPEG-4 AVC perceptual mask Between myth and reality DC156 24712 381113 9101415 DCT IDCT DC156 24712 381113 9101415 DCT int 4x4 sub- macroblock IDCT int Perceptual mask 4x4 contrast sensitivity table 0.70.581.202.39 0.581.121.492.30 1.201.493.074.35 2.392.304.357.25

8. Perceptual shaping Between myth and reality Input: x = original t AVC = perceptual mask output: = original

9. Watermarked block z Selected Host AC block x Key kMessage m Output Input Perceptual shaping Embedding & Block reconstruction Mark generation Block x Energy selection YES NO mST-QIM Insertion Between myth and reality

10. Embedding & block reconstruction The inserted bit m = 0 Between myth and reality

11. Embedding & block reconstruction Between myth and reality The inserted bit m = (M-2)/M

12. Watermarked block z Selected Host AC block x Key kMessage m Output Input Perceptual shaping Embedding & Block reconstruction Mark generation Block x Energy selection YES NO mST-QIM Insertion Between myth and reality

13. Block selection: energy-based criterion  Additional constraints for transparent MPEG-4 AVC watermarking in: S. Duta, M. Mitrea, F. Preteux, M. Belhaj, “The MPEG-4 AVC domain watermarking transparency”, Proc. SPIE Vol. 6982, April 2008 Between myth and reality Unmarked block energy Marked block energy The mean of energy of unmarked selected blocks The standard deviation of energy of unmarked selected blocks

14. Mark detection Detection variable Key Quantization step Watermarked block Without attack Between myth and reality Decision Y(m =d) Decision Y(m =d+1)

15. Mark detection After an attack Detection variable Key Quantization step Attacked block Without attack Between myth and reality Decision Y(m =d) Decision Y(m =d+1)

16. MEDIEVALS video corpus: https://www.medialive.com/Medievals  2 h of video in HD and SD  Different compression rate: 1Mo, 5 Mo, 10 Mo  MPEG-4 AVC baseline profile, only level 2, 3 and 4  The watermarking quantization step is chosen according to Golikiri:

17. Experimental results: transparency embbeding Subjective QualityObjective Quality PSNR60.5 Marked video Original video AAD0.47 PMSE0.0003 IF999.73 SC0.99 NCC0.99 DVQ0.06 Similarity measures Correlation measures Psycho visual measures α =0.84, Δ=160, m=5

18. Experimental results: robustness TranscodingStirmarkNoise addition embbedingdetection Attack: Noise matrix

19. embbedingdetection Attack: Noise matrix With energy selection Without energy selection Performance demonstration: Transcoding Attack -2012 -2 0 1 2 Number of «-2» detected under condition «-2» was inserted to total number of inserted bits Number of «-2» detected under condition «1» was inserted to total number of inserted bits -2012 -20,90,02 0,010,05 0,060,870,050,01 000,060,890,040,01 1 0,020,040,90,03 20,020,010,110,040,92 -2012 -20,2 0,2 0 1 2

20. embbedingdetection Attack: Noise matrix With energy selection Without energy selection Performance demonstration: Stirmark Attack -2012 -2 0 1 2 -2012 -20,770,110,020,010,09 0,120,690,150,030,01 00,030,140,730,080,02 10,010,040,060,810,08 20,070,020,040,110,76 -2012 -20,2 0,2 0 1 2

21. embbedingdetection Attack: Noise matrix With energy selection Without energy selection Performance demonstration: Noise adding Attack -2012 -2 0 1 2 -2012 -210000 01000 000100 100010 200001 -2012 -210000 01000 000100 100010 200001

22. Conclusion  New masking model adapted to MPEG ‑ 4 AVC features  An extension of the first MPEG ‑ 4 AVC robust watermarking method against transcoding (about 6.5% of errors) and geometric attacks (about 11.57 % of errors)  Quantization watermarking on compressed domain  Information theory modeling attack

23. Perspectives  Ameliorate the masking model  Technical solution: watermarking system  Estimate the capacity