1. DS-UCAT: A New Multimodal Dialogue System For An Academic Application Ramón López-Cózar 1, Zoraida Callejas 1, Germán Montoro 2 1 Dept. of Languages and Computer Systems, University of Granada, Spain 2 Dept. of Computer Science and Engineering, University Autónoma of Madrid, Spain

2. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 2 DS-UCAT (Dialogue System for Ubiquitous Collaborative Adaptive Training) Assistance for professors and students in some of their activities in an academic center (e.g. a University’s Faculty) Interaction via sound, speech, graphics and text, mobile devices Based on XHTML+Voice (X+V) “Ubiquitous” system interaction with the environment to enhance its performance User localization within the environment is taken into account to decide: – Dynamic generation of X+V documents – Interaction modalities to be used Features of the DS-UCAT system

3. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 3 Library Red inalámbrica X+V document server Wireless connections Classrooms Professor offices Static documents Dynamic documents PHP MySQL Databases User Profiles Language Correspondences Available Books Borrowed Books Professor Materials Database query Environment information Wireless connections DS-UCAT architecture

4. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 4 Interaction with the system Initial X+V document

5. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 5 Interaction with the system

6. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 6 Interaction with the system User login

7. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 7 Interaction with the system Welcome message “Hello Ramon. Welcome to the DS-UCAT system” User localization

8. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 8 Interaction with the system Book query “I need information about books written by Gibbon in 2000”

9. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 9 Interaction with the system “This book is available” Query results

10. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 10 Future work Development of work environments for classrooms and professor offices – New ASR grammars – New X+V documents considering user type Professors: upload didactic material Students: download didactic materials – Interaction with devices in environments Professors: – Office: turn on/off lights using speech/mouse – Classroom: turn on/off beam projector, lights

11. DS-UCAT: A New Multimodal Dialogue System For An Academic Application 11 Future work User localization within the educational centre – Use of RFID (Radio Frequency ID cards) – Selection of best-suited acoustic models for ASR (if possible) – Selection of dialogue management strategies Mixed-initiative appropriate in a noisy environment? – Suggestion of interaction modalities Spoken interaction appropriate in library?

12. DS-UCAT: A New Multimodal Dialogue System For An Academic Application Ramón López-Cózar 1, Zoraida Callejas 1, Germán Montoro 2 1 Dept. of Languages and Computer Systems, University of Granada, Spain 2 Dept. of Computer Science and Engineering, University Autónoma of Madrid, Spain