Generation of Multimedia TV News Contents for WWW Hsin Chia Fu, Yeong Yuh Xu, and Cheng Lung Tseng Department of computer science, National Chiao-Tung University, Hsinchu, Taiwan, R.O.C. The fierce competition among TV news programs make the news contents become more and more fruitful. However, people may not be patient enough to wait for the arrival of favored news events while a long series of uninterested TV news are on the air. Therefore, news on- demand becomes an attracting service. Since, some TV news programs are broadcasted around the clock, manually indexing news video into Web contents can be a boring and tedious work. Therefore, automatically indexing news stories becomes an emergent issue for multimedia information processing. Increasing computing power and gradually maturing multimedia technologies provide a powerful working environment for automatically segmenting news video into semantically meaningful units such as stories and summaries, and then into hierarchical contents. A snapshot of the TV news browsing results is shown in Figure 3. A user can select a particular or a favor channel and dates at the pull down menu. Then, click the browse button to start the browsing processes. The lower-left panel will show the news titles of the selected TV program. Key-frames of each news story are shown at the lower-right panel at the same time. (S)he can select an interested news story by clicking on the news title, or on a key-frame, to activate the playing of the corresponding video clip and the displaying of the key-frames of the selected news story. In addition, keyword query is also available in the user-interface window. The proposed hierarchical news content processing system consists three modules: (1) TV news acquisition, (2) news content analysis, and (3) user interface for news query and search. Figure 1 shows the architecture and data flow of the proposed TV news indexing system The acquisition module records TV news programs in proper video format, and fetches related news documents from Internet web Content analysis module receives and segments the recorded news video into news story units, and then extracts keywords and news titles from each story User interface module provides a friendly searching and browsing environment for retrieving interested news. Figure 2 depicts the processing flow of the TV news indexing generator A TV news program is captured and encoded into stream video A shot detector is used to segment the streaming video into shots for key-frame generation. Within a shot, speaker identification techniques are applied to detect anchor frames Each closed caption on the anchor frames is then extracted and recognized by video OCR techniques By matching the characters from closed caption with news document retrieved from Internet, the proposed system can construct links between TV news stories and Internet news stories The prototype of the TV news WWW was completed in July Since then, the system has been up running continuously. Up to the date when this report is written (March 27, 2006), the system records and analyzes CTS evening News program daily, except a few short shutdown due to power failure. Recently, we have setup a new WWW site, for PDA browsing. An automated hierarchical TV-news web system needs to have at least the following features. Segmenting a TV news program into story based units Generating keywords and titles for each news stories Interactively displaying hierarchical TV news contents Providing users for searching related news stories. BACKGROUND GOALS OF THE SYSTEM SYSTEM DESIGNSYSTEM DEMONSTRATION CONCLUSIONS Figure 1. The overview of the proposed TV news system Figure 2. The flow of TV news indexing generation Figure 3. A sample of the TV news web-page. ABSTRACT In this paper, we present a system we have developed for automatic TV News video indexing that successfully combines results from the fields of speaker verification, acoustic analysis, very large vocabulary video OCR, content based sampling of video, information retrieval, dialogue systems, and ASF media delivery over IP. The prototype of TV news content processing Web was completed in July Since then, the system has been up running continuously. Up to the date when this message is written (March 27, 2006), the system records and analyzes the prime time evening news program in Taiwan every day of these years, except a few power failure shutdown. The TV news web is at