1. TAUCHI – Tampere Unit for Computer-Human Interaction Tampere Unit for Human-Computer Interaction University of Tampere Markku Turunen MUMIN workshop, Helsinki, 15-16.11.2002

2. TAUCHI – Tampere Unit for Computer-Human Interaction Outline Topics Research themes, context and methods Applications Future challenges and topics for discussion

3. TAUCHI – Tampere Unit for Computer-Human Interaction Research themes Interaction techniques for speech applications adaptive multilingual speech inputs and output error handling strategies interaction (dialogue) management strategies fusion and fission of multimodal information information representation in distributed applications context-awareness, privacy and trust

4. TAUCHI – Tampere Unit for Computer-Human Interaction Research context Pervasive and mobile settings multiple simultaneous multiparty dialogues human-to-computer, human-to-human implicit modalities: sensor information, position etc. speaker recognition and verification telephony applications, mobile settings special user groups (e.g. visually impaired users)

5. TAUCHI – Tampere Unit for Computer-Human Interaction Research approach Constructive HCI research architectures for adaptive applications prototype applications support for iterative development support for evaluation: Wizard of Oz, usability evaluation support for data (corpus) collection

6. TAUCHI – Tampere Unit for Computer-Human Interaction Architecture research speech application development framework a framework for adaptive speech applications designed especially for multilingual and distributed applications overall focus on system level adaptivity current focus on ubiquitous and multimodal applications Java and XML, freely available used in several projects and applications

7. TAUCHI – Tampere Unit for Computer-Human Interaction Jaspis-based speech applications speech-based timetable services multilingual e-mail applications mobile speech applications ubiquitous computing applications Application prototypes traditional, unimodal applications innovative, multimodal applications

8. TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Busman (Bussimies) / Interact Speech-enabled timetable services speech interface for (bus) timetables “natural” spoken queries “mass-market” application two independent versions: –Busman (Bussimies): Tampere version –USIX-Interact: Helsinki version, collaboration with other universities (e.g. UIAH)

9. TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Mailman (Postimies) / AthosMail Multilingual speech-based e-mail systems Basic e-mail features for telephone users (IMAP/POP3) Finnish and English & English / Swedish ASR + DTMF inputs Main focus on intelligible and pleasant speech outputs in collaboration with visually impaired users AthosMail: EU-funded IST project (DUMAS)

10. TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Mobile applications Mobile speech applications integration of services support for group communication (awareness, shared knowledge) visually impaired users (short message services etc.) office environments mobile usage

11. TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Doorman (Ovimies) Speech-based ubicomp systems identifies the target of the visitor’s visit or the identity of the staff member opens the door and guide the visitors in our premises conveys personal and organizational messages to staff members

12. TAUCHI – Tampere Unit for Computer-Human Interaction Applications: Doorman (Ovimies) Technology speech synthesis, speech recognition, speaker recognition, anthropomorphic guidance, physical switches, sensors EMFi-technology: wall and ceiling mounted loudspeakers and floor- sensors telephone and PDA interfaces for mobile users

13. TAUCHI – Tampere Unit for Computer-Human Interaction Current vs. new application areas Traditional speech applicationsFuture speech applications single usermultiple users desktop and telephony office and home environments, mobile settings Single deterministic dialogue open-ended, dynamically constructed concurrent dialogues active useractive computer centralized dialogue managementdistributed interaction management

14. TAUCHI – Tampere Unit for Computer-Human Interaction Current vs. new application areas Traditional speech applicationsFuture speech applications mostly unimodalmostly multimodal alternative / exclusive (sequential) modalities concurrent / synergistic (parallel) modalities speech, text, graphicsspeech, sensors, … monolingualmultilingual ”natural” interaction methods based on human-human interaction ”innovative” interaction methods based on human-computer interaction

15. TAUCHI – Tampere Unit for Computer-Human Interaction Discussion topics English vs. Nordic languages Freely available and open-source components Demonstrations vs. working applications

16. TAUCHI – Tampere Unit for Computer-Human Interaction http://www.cs.uta.fi/hci/spi/ spi@cs.uta.fi mturunen@cs.uta.fi Tampere Unit for Computer Human Interaction Department of Computer and Information Sciences