1. Shot boundary detection based on frame histograms analysis Vakulenko M.D. 1, Kovalenko D.A. 2, Tolkunov S.V. 2, Master Students Gr. 1 -8BM10, 2 -8VM13 Tomsk Polytechnic University 1 Shot boundary detection based on frame histograms analysis Scientific advisor: Dr. Sergey V. Axyonov

2. Motivation, Targets and Tasks Shot boundary detection based on frame histograms analysis 2 Motivation  Presence of huge unstructured and unindexed video archives in the world  Video scenes search problem  Need for automated video content analysis Target Automated scenes splitting by the shot boundary detection based on histograms difference analysis Tasks  Create and implement an algorithm that is capable of detection base cuts in the movies based on hard threshold.  Create and implement an algorithm that is capable of detection base cuts in the movies based on adaptive threshold.  Estimate the effectiveness of the best developed algorithm for some different movies (quality, sizes).

3. Application Shot boundary detection based on frame histograms analysis 3

4. Different Cuts Shot boundary detection based on frame histograms analysis 4

5. Overview of the Model Shot boundary detection based on frame histograms analysis 5

6. Mathematical Model Video segmentation6 Elements of analyzed vector: - correlation function,, - vectors obtained from histograms of red, green and blue component of the i-th frame According to obtained vector C adaptive threshold can be calculated in following form: - threshold value- weighting factorn – number of neighbor of analyzed element - mathematical expectation- variance

7. Algorithm Shot boundary detection based on frame histograms analysis 7 Get frames with some step from video file Calculate histogram difference between neighboring frames Store it in the array Calculate adaptive threshold Peaks which we received are places of cuts cvCreateFileCapture cvQueryFrame cvCalcHist cvCompareHist cvAdaptiveThreshold While(!EOF) { }

8. Examples Shot boundary detection based on frame histograms analysis 8

9. Results Shot boundary detection based on frame histograms analysis 9 Developed needed mathematical model for movie shot boundary detection. Created a C++ program that implements the model based on the OpenCV library. The software was tested to detect shot boundary for the different media types (different movie quality, different cut types). The system can detect about 90% described cuts in the movies.