Curtis Kelsey University of Missouri A FINGERPRINTING SYSTEM MOBILE MODEL FOR VIDEO COPY PROTECTION
MOTIVATION Create Application/Database ecosystems free of copyright infringement Reduce computational cost incurred on the provider.
PROPOSED TECHNIQUE Use a modified pairwise boosting on visual Viola-Jones features to learn top-M discriminative filters on a mobile platform for querying.
CHARACTERISTIC ANALYSIS Benefits As accurate as the time spent training Allows for poor false positive rate Weaknesses All classifiers must have a high detection rate
OPENCV HARRTRAINING (IMPLEMENTATION ANALYSIS) Training the classifier requires: Negative samples for training/testing Positive samples for training/testing Training Time ~90 minutes w/ and images [5] Classifier Accuracy > 5000 false detections per 1.3 billion [5] Naotoshi Seo extensively tests OpenCV’s training [6] As training time increases, accuracy increases in a logarithmic form
FEASIBILITY Can we use cascading classifiers on a mobile device? No Why? Video Data is unknown until submission. Classifier training cannot be done in real- time What now Use another fingerprinting technique for the mobile platform
MODIFIED PROPOSED TECHNIQUE Use a modified block-based luminance signature generated by a client for submission to a server for copy detection.
METRICS In a system attempting to filter copyrighted intellectual property, the false negative rate can be discarded, giving the benefit of the doubt to the user uploading video into your environment. X
FIRST THINGS FIRST Eliminate Preprocessing What was done? Video size constrained Frame rate constrained Encoding bit rate constrained
TRANSITION INTENSITY
CONVERT RGB TO YUV Y` is a measure of overall luminance Can be used instead of components
SCENE FRAMES Meng et al. describes multiple solutions. I use a basic luminance differencing in the temporal domain. Threshold needs to be trained
GENERATE FINGERPRINT Use the scene frames to generate block luminance signatures of each frame Base on ordinal ranking Weak to affine transformations
SUBMITTING THE FINGERPRINT POST fingerprint to php script via internet Use Direct Hashing Algorithm (DHA) previously presented. Hash fingerprints Insert into a standard hash table if query returns no match Query up to hamming distance of 2
RESULTS Frames process in approx seconds each Core i7 4GB DDR3 Video Size 1676 x 985 Data Rate 159kbps
RESULTS Like hardware 1280 x ,513 kbps 29 fps
REFERENCES [1] Lian, H. C., Li, X. Q., & Song, B. (2011). A fingerprinting system for video copy detection. Fuzzy Systems and Knowledge Discovery (FSKD), 2011 Eighth International Conference on (Vol. 4, pp. 2146–2149). IEEE. Retrieved from [2] Viola, P. (2001). Rapid object detection using a boosted cascade of simple features., CVPR Proceedings of the. Retrieved from [3] Zhang, Z., Cao, C., & Zhang, R. (2010). Video copy detection based on speeded up robust features and locality sensitive hashing. Automation and Logistics (, Retrieved from [4] Meng, J., Juan, Y., & Chang, S.-fu. (1995). Scene Change Detection in a MPEG Compressed Video Sequence 2. Previous Approaches 3. MPEG Compression Standard. Symposium A Quarterly Journal In Modern Foreign Literatures, 2419 (February), Retrieved from [5] Adolf, Florian. How-to build a cascade of boosted classifiers based on Haar-like features. Retrieved from
REFERENCES CONT.… [6] Seo, Naotoshi. Tutorial: OpenCV haartraining (Rapid Object Detection With A Cascade of Boosted Classifiers Based on Haar-like Features). Retrieved from [7] Mohan, R. (1998). Video sequence matching. Acoustics, Speech and Signal Processing, 1998., Retrieved from
QUESTIONS