Batch VIP — A backend system of video processing VIEW Technologies The Chinese University of Hong Kong

Outline Ideas of BatchVIP Design Goals Concepts Rules Structure Processing modules

Design goals Integrate and update different kinds of video processing function efficiently Coordinate processes High stability Real-time monitor the progressing status Record events in log

Module A Module is a component which implements a certain video processing task. Module is independent of Batch VIP by using a standalone executable file with a XML specification Advantages: Easy to integrate new modules or update existing modules without modifying the Batch VIP Guarantee the reliability. Standard interface

Sample of XML Specification <Info NAME="SpeechRecognition" SRC="speechrecognition.exe" DESCRIPTION="Speech Recognition" MULTIPLEINSTANCE="0" USEENGINE="1" /> ADRemove Speech Script

If one module needs the results of other modules, it can not run until all those modules finish. Each file only can be processed by one module at any time Only the module which has the multiple-instance feature can process several files at the same time Each module must apply for the thread quota before creating process and must release it after finishing. Rules of the task arrangement:

Reliability Module mechanism Multi-Thread Management Critical Section Management Monitor Process status CPU utilization Socket communication

Communication Socket based Duplex TCP/IP Message Control message Progress message Error message

Batch Control Center Structure: Video Log Scene Detection Ad Detection Module Module Manager Task Manager Process Manager Xml interface Publish ……

Working flow Create Process Destroy Socket Terminate Monitor Process status Exception No Yes Create Socket Server Process Client Termination message Update task status Update task progress tasks Task Queue Add to Task Queue Check preprocess return quota Select Task: Have not be processed All preprocesses have finished Video file is not under process Apply quota succeed fail Task Manager

Processing Layer VOCD Face Detection Speech Recognition Story Segmentation Publish Scene Change VOCR Ad Detection

Scene Detection Histogram-based difference time D(X,Y) Eliminate duplicated results

VOCD Sampling & Color space conversion Multi-frame comparison Coarse-to-fine localization Text area enhancement Local thresholding Text area recovery High-pass filter Edge detection

Speech Recognition Audio Extraction ViaVoice

Story Segmentation

Publish

Thank you for you attention!