1. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Embedding in Compressed UAV Video via Digital Watermarking Domenick Cinalli Bijan Mobasseri Colin O’Connor

2. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Acknowledgments This work was supported in part by a grant from the US Air Force Office of Scientific Research. Predator video footage was provided by Mr. Scott Adams of the Air Force Research Lab, Rome, NY.

3. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Objectives Define Watermarking Why Watermark? How to Watermark –MPEG Introduction Metadata Embedding System –Synchronization Metadata Viewer Application –Demo

4. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 What is Watermarking? Ability to insert a signal into a separate carrier signal without adversely affecting the carrier signal’s perceptual transparency.

5. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Watermarked Image Example Langelaar, C., Setyawan, I., and Lagendijk, R., “Watermarking Digital Image and Video Data,” IEEE Signal Processing Magazine, vol. 17, no. 5, pp. 20-46, Sept. 2000.

6. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Why Watermark? ProtectionInformative Copyright ProtectionIndexing FingerprintingMedical Record Storage Copy Generation ControlData Hiding Broadcast Monitoring Data Authentication

7. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Variable length coderunlevel 10 (NOTE 2)End of Block 1 s (NOTE 3)01 11 s (NOTE 4)01 011 s11 0100 s02 0101 s21 0010 1 s03 0011 1 s31 0011 0 s41 0001 10 s12 0001 11 s51 0001 01 s61 0001 00 s71 0000 110 s04 0000 100 s22 0000 111 s81 0000 101 s91 MPEG Introduction Table B-14 MPEG Bitstream SliceMacroblock Block

8. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Data hiding in label- carrying VLCs Compressed-Domain Scheme Frame data is encoded into MPEG bitstream using Variable-Length Codes. Subset of VLCs, Label-Carrying VLCs, have least significant bit modified to carry watermark.

9. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Label-Carrying VLCs To classify as a LC-VLC pair, both VLCs must: 1.Share a run-length 2.Differ in level by one 3.Have exactly the same bit-length

10. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 LC-VLC Example VLCRun-LengthLevel 000000011101012 000000001100013 000000011101000000001100 Insert Label ’11’ 1

11. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Embedding System EmbedExtractDisplay W W -1 Video Metadata v m s v m

12. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Descriptive Information –Date / Time –Direction –Location http://www.airforce-technology.com/projects/predator/predator3.html Video Metadata SuperStream Why Embed? –Bookkeeping –Efficiency of storage –Ease of display

13. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Video – Metadata Synchronization Requirements –Metadata sampling starts simultaneously with recording of video –Metadata is sampled at a constant rate Result –Video and metadata are concurrently displayed and maintain synchronization. 5s 10s 15s 20s 25s 1 st Record2 nd Record3 rd Record4 th Record5 th Record6 th Record

14. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Viewer Application Concurrently display metadata & video Graphical User Interface (GUI) Abstract technical detail Easy-To-Use

15. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Metadata Viewer Demo Predator UAV video (MPEG) & metadata provided by US Air Force Java-based –Swing API for GUI –Java Media Framework (JMF) for video Watermarking module coded in C

16. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Summary Implemented LC-VLC Watermarking to insert metadata into Predator UAV MPEG video Created an application that abstracts watermarking tasks and extracts embedded data for simultaneous display with video

17. Domenick Cinalli ECE Department Villanova University Intelligent Ship Symposium V Monday, May 12, 2003 Future Work Going beyond proof of concept… –Integrating operational factors –secure embedding –frame content metadata using MPEG-4 –lossless embedding –controlled access to video based on viewer clearance