IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek Vojtěch Sázel Project coordinator: Ing. Ladislav Kunc

IBM - CVUT Student Research Projects 2 Video anotation for IBM TalkingHead TalkingHead description The TalkingHead framework is system for visual interaction with computer users via animated 3D head and sound Animated head is capable of moves and mimics voice synthesizer is included in the framework TalkingHead uses XML scenarios, that describe head movements and contain spoken text

IBM - CVUT Student Research Projects 3 Video anotation for IBM TalkingHead Our goals Choose short videosequences from English TV programs – news Create a transcript from videos Add some marks into the transcript, according to the movements of the TV reporter's head Rewrite the transcript to XML file in format of TalkingHead

IBM - CVUT Student Research Projects 4 Video anotation for IBM TalkingHead Our goals – cont. Compare movement of the animated head with movement of the real head of TV reporter Form a small group of english speaking people Run “usability test“ Answers for questions on correspondence TalkingHead's movement with real head movement Aswers for questions on movement realism Answers for question: „Is it possible to use TalkingHead to read the news?“

IBM - CVUT Student Research Projects 5 Comparsion between the TalkingHead and reporter's head

IBM - CVUT Student Research Projects 6 Video anotation for IBM TalkingHead Conclusion Results of this project will be used in the development of automatic 3D TalkingHead movements What's acomplished TV videos have been chosen Anotations have been made for them To do usability test

IBM - CVUT Student Research Projects 7 Video anotation for IBM TalkingHead Any questions?...