Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Embedding in Compressed UAV Video via Digital Watermarking Domenick Cinalli Bijan Mobasseri Colin O’Connor

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Acknowledgments This work was supported in part by a grant from the US Air Force Office of Scientific Research. Predator video footage was provided by Mr. Scott Adams of the Air Force Research Lab, Rome, NY.

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Objectives Define Watermarking Why Watermark? How to Watermark –MPEG Introduction Metadata Embedding System –Synchronization Metadata Viewer Application –Demo

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 What is Watermarking? Ability to insert a signal into a separate carrier signal without adversely affecting the carrier signal’s perceptual transparency.

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Watermarked Image Example Langelaar, C., Setyawan, I., and Lagendijk, R., “Watermarking Digital Image and Video Data,” IEEE Signal Processing Magazine, vol. 17, no. 5, pp , Sept

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Why Watermark? ProtectionInformative Copyright ProtectionIndexing FingerprintingMedical Record Storage Copy Generation ControlData Hiding Broadcast Monitoring Data Authentication

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Variable length coderunlevel 10 (NOTE 2)End of Block 1 s (NOTE 3)01 11 s (NOTE 4) s s s s s s s s s s s s s s91 MPEG Introduction Table B-14 MPEG Bitstream SliceMacroblock Block

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Data hiding in label- carrying VLCs Compressed-Domain Scheme Frame data is encoded into MPEG bitstream using Variable-Length Codes. Subset of VLCs, Label-Carrying VLCs, have least significant bit modified to carry watermark.

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Label-Carrying VLCs To classify as a LC-VLC pair, both VLCs must: 1.Share a run-length 2.Differ in level by one 3.Have exactly the same bit-length

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 LC-VLC Example VLCRun-LengthLevel Insert Label ’11’ 1

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Embedding System EmbedExtractDisplay W W -1 Video Metadata v m s v m

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Descriptive Information –Date / Time –Direction –Location Video Metadata SuperStream Why Embed? –Bookkeeping –Efficiency of storage –Ease of display

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Video – Metadata Synchronization Requirements –Metadata sampling starts simultaneously with recording of video –Metadata is sampled at a constant rate Result –Video and metadata are concurrently displayed and maintain synchronization. 5s 10s 15s 20s 25s 1 st Record2 nd Record3 rd Record4 th Record5 th Record6 th Record

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Viewer Application Concurrently display metadata & video Graphical User Interface (GUI) Abstract technical detail Easy-To-Use

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Viewer Demo Predator UAV video (MPEG) & metadata provided by US Air Force Java-based –Swing API for GUI –Java Media Framework (JMF) for video Watermarking module coded in C

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Summary Implemented LC-VLC Watermarking to insert metadata into Predator UAV MPEG video Created an application that abstracts watermarking tasks and extracts embedded data for simultaneous display with video

Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Future Work Going beyond proof of concept… –Integrating operational factors –secure embedding –frame content metadata using MPEG-4 –lossless embedding –controlled access to video based on viewer clearance