MPEG-4 AVC robust video watermarking based on QIM and perceptual masking principles Marwen HASNAOUI Maher BELHAJ Mihai MITREA Françoise PRETEUX ARTEMIS Department Institut Télécom Télécom SudParis Evry - France

Outline  Compressed domain watermarking  A robust compressed-domain watermarking  Conclusion and further work  m-ST-QIM insertion (new perceptual shaping, energy selection criterion)  Detection  Experimental result A contradiction in terms? Between myth and reality! Between myth and reality!

Selection Buy Right Send content Distribution Internet VOD server BOB Justice Context Storage MPEG-4 AVCWatermarking Challenge: Real time, robust watermarking for MPEG-4 AVC Video visual redundancy exploited in order to hide watermark Video visual redundancy eliminated Context: VoD distribution

State-of-the-art panorama D. Zou, and J.A. Bloom H.264/AVC STREAM REPLACEMENT TECHNIQUE FOR VIDEO WATERMARKING  Embedding at the Decoder side A. Golikeri, and R.M. Mersereau Robust digital video watermarking scheme for H.264 advanced videocoding standard”, Journal of Electronic imaging 16,  QIM Mark generation M. Noorkami, P. Nasiopoulos, and Z. J. Wang Compressed ‑ domain video watermarking for H.264, IEEE Intl. Conf. on Image Processing, Vol. 2, September  Perceptual shaping adapted to syntax features ComWat algorithm (May 2010) Less complexity Best robustness Best transparency Large data payload Multi-symbole ComWat algorithm

m-ComWat algorithm: distinctive factors  m-array Quantization Index Modulation method [Chen and Worwell]  Energy selection criteria based on information theory concepts  First perceptual masking mechanism in MPEG-4 AVC Between myth and reality  Mark inserted in AC quantized coefficient at the decoder side

Watermarked block z Selected Host AC block x Key kMessage m Output Input Perceptual shaping Embedding & Block reconstruction Mark generation Block x Block selection YES NO m-ST-QIM Insertion Between myth and reality

Toward an MPEG-4 AVC perceptual mask Between myth and reality DC DCT IDCT DC DCT int 4x4 sub- macroblock IDCT int Perceptual mask 4x4 contrast sensitivity table

Perceptual shaping Between myth and reality Input: x = original t AVC = perceptual mask output: = original

Watermarked block z Selected Host AC block x Key kMessage m Output Input Perceptual shaping Embedding & Block reconstruction Mark generation Block x Energy selection YES NO mST-QIM Insertion Between myth and reality

Embedding & block reconstruction The inserted bit m = 0 Between myth and reality

Embedding & block reconstruction Between myth and reality The inserted bit m = (M-2)/M

Watermarked block z Selected Host AC block x Key kMessage m Output Input Perceptual shaping Embedding & Block reconstruction Mark generation Block x Energy selection YES NO mST-QIM Insertion Between myth and reality

Block selection: energy-based criterion  Additional constraints for transparent MPEG-4 AVC watermarking in: S. Duta, M. Mitrea, F. Preteux, M. Belhaj, “The MPEG-4 AVC domain watermarking transparency”, Proc. SPIE Vol. 6982, April 2008 Between myth and reality Unmarked block energy Marked block energy The mean of energy of unmarked selected blocks The standard deviation of energy of unmarked selected blocks

Mark detection Detection variable Key Quantization step Watermarked block Without attack Between myth and reality Decision Y(m =d) Decision Y(m =d+1)

Mark detection After an attack Detection variable Key Quantization step Attacked block Without attack Between myth and reality Decision Y(m =d) Decision Y(m =d+1)

MEDIEVALS video corpus:  2 h of video in HD and SD  Different compression rate: 1Mo, 5 Mo, 10 Mo  MPEG-4 AVC baseline profile, only level 2, 3 and 4  The watermarking quantization step is chosen according to Golikiri:

Experimental results: transparency embbeding Subjective QualityObjective Quality PSNR60.5 Marked video Original video AAD0.47 PMSE IF SC0.99 NCC0.99 DVQ0.06 Similarity measures Correlation measures Psycho visual measures α =0.84, Δ=160, m=5

Experimental results: robustness TranscodingStirmarkNoise addition embbedingdetection Attack: Noise matrix

embbedingdetection Attack: Noise matrix With energy selection Without energy selection Performance demonstration: Transcoding Attack Number of «-2» detected under condition «-2» was inserted to total number of inserted bits Number of «-2» detected under condition «1» was inserted to total number of inserted bits ,90,02 0,010,05 0,060,870,050,01 000,060,890,040,01 1 0,020,040,90,03 20,020,010,110,040, ,2 0,

embbedingdetection Attack: Noise matrix With energy selection Without energy selection Performance demonstration: Stirmark Attack ,770,110,020,010,09 0,120,690,150,030,01 00,030,140,730,080,02 10,010,040,060,810,08 20,070,020,040,110, ,2 0,

embbedingdetection Attack: Noise matrix With energy selection Without energy selection Performance demonstration: Noise adding Attack

Conclusion  New masking model adapted to MPEG ‑ 4 AVC features  An extension of the first MPEG ‑ 4 AVC robust watermarking method against transcoding (about 6.5% of errors) and geometric attacks (about % of errors)  Quantization watermarking on compressed domain  Information theory modeling attack

Perspectives  Ameliorate the masking model  Technical solution: watermarking system  Estimate the capacity