2014/2/221 MASTAR Project, Universal Communication Research Institute Chiori Hori Ph.D. Spoken Language Communication Laboratory National Institute of Information and Communications Technology (NICT) Geneva, 25 November 2011 Telecommunications Relay Services in Speech-to-Speech translation system in accordance with Recommendations F.745 and H.625 ITU-T Workshop onTelecommunications relay services for persons with disabilities (Geneva, 25 November 2011)

2014/2/222 MASTAR Project, Universal Communication Research Institute Telecommunications Relay Services in Speech-to-Speech translation in accordance with ITU-T Recommendations F.745 and H.625 Speech-to-Speech Translation Communicating between more languages can be actualized using S2ST technology by connecting distributed S2ST servers, (i.e., ASR, MT, TTS) all over the world. Speech-to-Speech Translation (S2ST) technologies are an effective means to break through language barriers between people who do not speak the same language. English I go to school AutomaticSpeechRecognition(ASR) Machine Translation (MT) SpeechSynthesis(TTS) w a t a sh i w a g a xtu k o o n i….. I go to school Japanese Convert from phoneme to word Convert from Japanese text to English text Convert from text to waveform Japanese speech and text corpora Japanese speech and text corpora Japanese- to-English parallel corpora English speech corpora Large amount of training data for machine learning Network-based S2ST systems Network Communication between users who speak different languages Speaker of Language B Digitalizatio n of speech signals MC client ASR server Conversion from speech signal to text in Language A MC server Speaker of Language A Digitalizatio n of speech signals MC client MT server Conversion from text in A to text in B MC server TTS server Conversion from text in B to speech signal MC server ASR server Conversion from speech signal to text in Language B MC server MT server Conversion from text in B to text in A MC server TTS server Conversion from text in A to speech signal MC server

2014/2/223 MASTAR Project, Universal Communication Research Institute Japanese speakers device Chinese speakers device Network-based Speech Translation System in accordance with ITU-T Recommendations F.745 and H.625 Network-based S2ST application via multilateral translation on smartphone/tablet/PC/TV English speakers device Water to drink will be provided in front of the city hall from On-site communication Papa, maman, comment vas-tu? Remote Communication

2014/2/224 MASTAR Project, Universal Communication Research Institute Modality Conversion Markup Language (MCML) XML schema, ITU-T name space ( MCML includes information for communication between multiple persons who use different modalities. Ex. speech, text, image, video data input by users or output by MCML servers such as ASR, MT, TTS, Sign Recognition systems. Network-based Speech Translation System in accordance with ITU-T Recommendations F.745 and H.625

2014/2/225 MASTAR Project, Universal Communication Research Institute

2014/2/226 MASTAR Project, Universal Communication Research Institute U-STAR Consortium The Universal Speech Translation Advanced Research (U-STAR) Consortium has been established as an international research collaboration entity with the goal of developing a world wide network-based speech-to-speech translation system. The consortium objective is to create a basic infrastructure for spoken language communication to overcome the language barriers that exist around the world. Currently, there are participant members from 14 countries (15 institutes). Plan for Field experiment Period: One year from April of 2012 including during the 2012 London Olympics Application: Multiparty conversation via a network-based S2ST system on iPhones and Android phones (Free) MCML servers: ASR,MT, TTS servers will be provided by U-STAR members Potential languages: Chinese, Dzongkha, English, Filipino, Hindi, Indonesian Japanese, Korean, Mongolian, Malay Nepali, Sinhala, Thai, Urdu, Vietnamese and some European languages

2014/2/227 MASTAR Project, Universal Communication Research Institute The U-STAR members InstituteCountryLanguage DITTBhutanDzongkha UPDPhilippinesFilipino CDACIndiaHindi BPPTIndonesiaIndonesian NICTJapanJapanese ETRIKoreaKorean MUSTMongoliaMongolian NUMMongoliaMongolian I2RI2RSingaporeMalay LTKNepalNepali UCSCSri LankaSinhala NECTECThailandThai KICS-UETPakistanUrdu IOITVietnamVietnamese CASIAChinaChinese

2014/2/228 MASTAR Project, Universal Communication Research Institute Potential European Language French, German, Italian, Portuguese, Spanish, Turkish, British English