Preparing for the 2008 Beijing Olympics : The LingTour and KNOWLISTICS projects. MAO Yuhang, DING Xiao-Qing, NI Yang, LIN Shiuan-Sung, Laurence LIKFORMAN, Gérard CHOLLET Presented here by Gérard CHOLLET ENST/CNRS-LTCI

Outline Rationale of the proposition Objectives  The Beijing 2008 Olympics Approaches  Intelligent Camera  Bilingual Voice Communicator Need and relevance  A PDA for tourists and travelling businessmen Conclusions and Perspectives

Rationale for the IP-KNOWLISTICS Logistics for knowledge Language independent knowledge representation and management Multimedia (text, speech, image, video) Multimodal access (text, speech, visual I/O) Distributed multimedia server accessible from mobile terminals (phone, PDA, PC,…) Primarily targetted to tourist applications initially 2008 Beijing Olympics as a field trial

Technical developments Language independent knowledge representation (using conceptual graphs and an Intermediate Representation Language like ‘Universal Networking Language’) Summarisation and reformulation of texts Generation in 12 target languages Speech synthesis and recognition VoiceXML-based interactive dialog agent ‘Intelligent camera’ with Chinese character recognition Cross-language ‘Multimodal communicator’ on a PDA Cross-language lexical access

Chinese character recognition

Intelligent camera from Tsinghua Univ. capture reco traduction

Cross-language Multimodal Communicator Use of a visual display (for ex. on a PDA) to intermediate the dialogue between 2 persons speaking different languages. Recognition of short utterances, display of a word graph, selection of keywords, visualisation (and synthesis) of the translation of key words and group of words. Specialised lexicon for dialog acts in typical touristic situations (in a restaurant, at the hotel, in the street, in public transport, about the Olympic games,…) UMTS access to an Information server with maps, photographs, video sequences,…

Digital Olympic Multi-Language Information Network Service System Project