1. Research Activity in Kosice Ing. Matus PLEVA prof. Dr.h.c. Ing. Anton Cizmar, CSc. Email: Matus.Pleva@tuke.sk or Anton.Cizmar@tuke.skMatus.Pleva@tuke.skAnton.Cizmar@tuke.sk Technical University of Kosice (Slovak republic)ofKosice Slovak republic INTERNATIONAL WORKSHOP ON Verbal and Nonverbal Communication Behaviours March 29-31 2007 - Vietri sul Mare (Italy)

2. 2 Technical university of Košice 1. Faculty of Mechanical Engineering 2. Faculty of Mining 3. Faculty of Metallurgy Faculty of Electrical Engineering and Informatics 4. Faculty of Electrical Engineering and Informatics 5. Faculty of Civil Engineering 6. Faculty of Economics 7. Faculty of Manufacturing technologies (in Presov) 8. Faculty of Arts 9. Faculty of Aeronautics http://www.tuke.sk/index-e.html

3. 3 1. Department of Computers and Informatics 2. Department of Cybernetics and Artificial Intelligence Department of Electronic and Communications 3. Department of Electronic and Communications 4. Department of Electroenergetics 5. Department of Electrical Drives and Mechatronics 6. Department of Technologies in Electronics 7. Department of Mathematics 8. Department of Physics 9. Department of Electric Power Engineering 10. Department of Theoretical Electrotechnics and Electrical Measurement 11. Laboratory of Industrial Engineering Faculty of Electrical Engineering and Informatics http://www.fei.tuke.sk/en/fakulta/aktuality.shtml

4. 4 Education Degree of BSc, MSc. and PhD. Courses in Electronics, Telecommunications, Measurement Research groups Research groups Multimedia Communications Multimedia Communications Digital Signal Processing and Satellite Communications Digital Image Processing and Videocommunications Optoelectronic Communications Electronic Circuits & Measurement Department of Electronics and Communications Prof. Ing. Dusan Levicky, PhD. – Head of Department http://kemt.fei.tuke.sk/

5. 5 Multimedia Communications Research Group Prof. Anton Cizmar, PhD. Assoc. Prof. Jozef Juhar, PhD. Assoc. Prof. Lubomir Dobos, PhD. Ing. Slavomir Lihan, PhD. Ing. Stano Ondas, postgraduate student Ing. Miso Mirilovic, postgraduate student Ing. Miro Katrak, postgraduate student Ing. Peter Patlevic, postgraduate student Ing. Jozef Ratica, postgraduate student Ing. Matus Pleva, researcher (paid from R&D project) Ing. Jan Papaj, researcher (paid from R&D project) Full time employees - Digital Transmission Systems - Speech and Audio Systems - Mobile Communications

6. 6 Past research projects 1.Copernicus ISMAN : Integrated Services MAN, 1994-1997 2.Copernicus MOCOMTEL : Mobile Computing Telematic Services, 1998-2000. 3.COST 249 : Continuous Speech Recognition over the Telephone, 1994-2000. 4.COST 278 : Spoken Language Interaction in Telecomunications, 2001-2005. 5.COST 275 : Biometric Based People Recognition over the Internet, 2001-2005. 6.COST 273 : Towards Mobile Broadband Multimedia Networks, 2001-2005. 7.IRKR : Smart Speech Interfaces, 2003-2006. 8.Slovak Telecom : Progressive Data Technologies and Services, 1998-99, 2000-02. 9.Skoda Auto Mlada Boleslav : Voice Driven Services in Skoda Auto MB, 2004-2005. 10.VSE : PLC Systems and Services, 2002. etc.

7. 7 New research projects 1. MOBILTEL : Mobile Multimodal Systems and Services, 2005-2007 2. COST 2100 : Pervasive Mobile & Ambient Wireless Communications, 2007-2011. 3. COST 2102 : Cross-Modal Analysis of Verbal and Non-verbal Communication, 2007-2011 4. VSE : PLC Systems and Services II, 2007 5. ATVOS : Advanced Speech Technologies for Voice Operated Telecommunication Systems and Services in Slovak, APVV, ??? 6. VOTS : Voice Operated Telecommunication Systems and Services, AV MŠ, ???

8. 8 Smart Speech Communication Interface National Program R&D Buildig Information Society No. 2003 SP 20 028 01 03 doc. Ing. Jozef Juhár, CSc a kol. Email: Jozef.Juhar@tuke.sk Technical University of Košice, Slovak Academy of Science, Slovak Technical University of Bratislava, Technical University of Žilina

9. 9 IRKR – Slovak Smart Speech Interface Research and development of a spoken language dialogue system for information retrieval using voice interaction between human and computer Attributes of the solution: human-computer interaction (dialogue) in Slovak an access to distributed information in the Internet multi-user interaction through telephone (PSTN, GSM, VoIP) modular architecture open for future extensions two demonstration applications (Weather forecast for Slovakia, Timetable of Slovak Railways) see http://irkr.tuke.sk/ http://irkr.tuke.sk/

10. 10 IRKR – Slovak Smart Speech Interface Information resources Voice Portal IRKR – Slovak Smart Speech Interface +421 55 6022297 – fixed line or +421 918 717491 – Orange cellular or +421 911 660038 – T-Mobile cellular or nickname: irkr_pub - Skype networkirkr_pub 333 (with H323 Gateway -> 147.232.47.92) http://irkr.tuke.sk/ Interaction monitoring website: http://147.232.47.73:2297/index.php

11. 11 IRKR – Slovak Smart Speech Interface ASR (automatic speech recognition) server TTS server (text-to-speech) HUB – GalaxyHub open architecture http://irkr.tuke.sk/

12. MOBILTEL Mobile Multimodal Telecommunications Systems and Services National Program R&D APVT-20-029004 prof. Dr.h.c. Ing. Anton Cizmar, CSc. Email: Anton.Cizmar@tuke.sk Technical University of Kosice

13. 13 Research and development in the area of mobile multimodal telecommunication systems Attributes of the solution: human-computer interaction (dialogue) in Slovak with support of another mainly graphical modalities except voice also keyboard or stylus pen feedback interaction through PDA speaker, MIC, and GUI modular architecture open for future extensions two demonstration applications (Weather forecast for Slovakia, Timetable of Slovak Railways) see http://mobiltel.tuke.sk/http://mobiltel.tuke.sk/ MobilTel

14. 14 MobilTel ASR (automatic speech recognition) server TTS (text-to-speech) server TTM (Text To Multimodality) server WWW (World Wide Web) server files PHP JavaScript speech html GUI In fact: multimodal extension to previous project – building GUI for PDA users

15. 15 examples

16. 16 Practical example of MobilTel communicator usage We can try: offline version without voice (only GUI)offline version without voice (only GUI) But connected with HUB and actual information server Because voice module was written in VC++ 3.0 embedded and it could be run only on Pocket PC 2002!! Now we are trying to write a new module in C++.NET framerok 2005, and we hope it will be run-able on new PDA operating systems also. Also now we realize that the GUI.NET framework output is different on Win Mobile 5.0 and Pocket PC 2003! 

17. 17 Conclusion Thank you for your attention! Questions? http://kemt.fei.tuke.sk/ http://irkr.tuke.sk/ http://mobiltel.tuke.sk/