XML and Data Integration Edward Yau (2002/03/27)

Fundamental Digital Video Library Functions  Functions –Extraction and Discovery –Searching and Indexing –Query and Presentation

Modalities  Video Information Processing  Modality concept –Video Channel Scene break, Face, Logo –Audio Channel Speech -> Text (Summary, Topic) –Event Channel Mouse click, movement

Functions x Modalities Functions Modalities Face Logo Speech Text Name Feature Vector Extraction Discovery String Match Exact Match Distance Match Searching Indexing Text Graphic Text Query Presentation Knowledge

iView System  Container system for modalities modules  Easy integration of additional modalities  Minimal effort if replacing different module of same modality

XML as Data Glue  Each modality has it own data format  Some of them already in XML –NewsXML, MathXML, …  Design policy to integrate them together

Data Integration  Data model reconciliation –Common data model Time/Frame Over specify reduce flexibility  Schema Reconciliation –Different representation format –Semantically the same  Instance Reconciliation –Contradictory information

中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … Face Recognizer Speech Recognizer Logo Recognizer

中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … Text Index Engine Face Index Engine Logo Index Engine iView XMLRepository

中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … Text Presentation Face Presentaion Logo Presentation iView Browser (Timing)

Time Tag Problem  Common data modal and data reconciliation  Tag –  Attribute of Tag – –“ Attribute of Tag to Tag” translation policy