1. Activity presentation Jean.Caelen@imag.fr www-clips.imag.fr Director: Jean Caelen (DR CNRS) Vice-Director : Catherine Berrut (Prof. UJF)

2. Institutions UMR 5524

3. Research Topics Man-Machine Interaction(s) Collaborative interactions with machines Speech, Image, Language Processing E-Learning Perceptive Rooms and Augmented Reality Multimedia Document Indexing Man Machine Interaction Engineering Speech Recognition and Natural Language Dialogue Collaborative and Multimodal Interfaces Information Retrieval Machine Translation Language Processing

4. Structure Direction Research ARCADE GEOD GETA IIHM MRIM Laboratoty council Direction council Technical staff Maintenance Projects Administration Secretariat People Management Financial Subsistance Communication Valorisation MultiCom People : 72 (staff + PhD students) UJF, CNRS, INPG, UPMF, US

5. Research Teams ARCADE (J.P. Peyrin, prof. UJF) e-Learning (Ateliers de Réalisation et de Conception d’Applications Destinées à l’Education) GEOD (J.F. Serignat, MCF INPG) Speech Group (Groupe d’Etude sur l’Oral et le Dialogue) GETA (C. Boitet, prof. UJF) Machine Translation Group (Groupe d’Etude sur la Traduction Automatique) IIHM (J. Coutaz, prof. UJF) Man Machine Interaction Engineering (Ingénierie de l’Interaction Homme-Machine) MRIM (M.F. Bruandet, prof. UJF) Multimedia Information Retrieval (Modélisation et Recherche d’Informations Multimédia)

6. People 1/1/2002 Regular Staff73 (a) Profs + Researchers29 (b) Engineers + Admin.11 (c) PhD + Post-docs26 (d) Under contracts 7 (e) Masters and others24 (g) Invited10 Total 107

7. Technological transfert MultiCom : Usability platform for the design and the evaluation of interactive systems Start-up creations 1998 : NOVADIS, ergonomics, cognitive engineering 1999 : ARLYS (MENRT, CARMI, Microsoft, Axe et Cible), e- learning, education software development 2000 : DMAILER, e-mail indexing and processing

8. MultiCom Technological Platform : To study human factors in situated tasks To design and evaluate innovative and interactive services (or systems) by, Real usage experimentation Simulation (Woz for instance) Partnership Linguists, Sociologists, Ergonomists

9. Relationship and contracts MultiCom 6 industrial : (Schneider, France-Télécom, Leti-CEA, STM), 2 european : SIRLAN IST 5th PCRD, ADAMOS, Finlandia 2 regional : SHIVA RRA 99 et Thématique 2000 Research 6 industrial : (Thalès, France-Télécom, EDF, Alcatel) in RNRT, RNTL, CTI CNET, DGA 2 international : C-STAR, UNL (17 countries) 5 european : NESPOLE, TACIT, TIPS, ARIADNE, GLOSS, CAMELEON, FAME 3 research networks : CNRS (french networks) 2 regional 5 local (C-STAR, RICOM, RESIDE-HIS, EPIC, e-Xpérience)

11. Multi-team projects C-STAR/NESPOLE! : Face to face speech translation (GEOD, GETA) RICOM : Multimodal interaction for Multimedia information retrieval (GEOD, IIHM, MRIM) Smart Rooms : disable people monitoring, home services… (GEOD, IIHM) FORMID : e-learning, virtual teaching (ARCADE, IIHM)

12. C-STAR : Consortium for Speech Translation Advanced Research (Japan, Corea, USA, Germany, Italy, France) NESPOLE! (IST project) : NEgotiating through SPOken Language in E-commerce

13. Projet C-STAR Speech translation Applications to : tourism, hot line, e-commerce

14. 2 ways possible source Speech recognition Translation Speech synthesis target speaking listening texte IF IF coding Generation

15. Interchange Format Meaning representation Based on –Speech acts What to want or to do –Concepts What to say –Arguments Discourse predicates give-information +availability+room room-type=(single ; double)

16. The 22th july 1999 at Grenoble

17. RICOM : Information Retrieval: Interactive, Collaborative and Multimodale HALPIN : Man-Machine Dialogue CoVitesse : Information Representation

18. I found 1206 documents on the topic artificial intelligence. Do you want refine your research ? What have you on... e, artificial intelligence ? HALPIN Man-Machine Dialogue : speech recognition + dialogue management + information retrieval + speech synthesis

19. History of dialogue Input Outputs Documents Speech Buttons Speech Recognition

20. Collaborative surfing Trace of navigation Collected documents Session control Document annotation

21. RESIDE-HIS : Smart Home for disable people COMEDI : Informal Communication

22. RESIDE-HIS

23. Telemonitoring Réseau Téléphonique Public Modem H Home bus Physiological and biological sensors Microphones Monitoring on : Events Alarms Statistics

24. Plan HIS

25. CoMedi : Informal communication Feed-back, privacy control Awareness, Focus Acces control Feed-back control

26. Example of filters Poster Curtain EigenSpace

27. EigenSpace filter: Main Component Analysis Image baseEigen Space Image captured Image to send Eigen vectorArgMin(distance)

28. FORMID : FORmation Interactive à Distance Magic Board : Collaborative Space and augmented reality

29. FORMID : Toolkit for teaching by example I learn what I do. FORMID GeneSimu Oasis

30. Magic Board

31. Platform for design and evaluation of interactive systems Platform for design and evaluation of interactive systems

32. Development ObservationsTask analysis Design Software design Lifecyle

33. Objectives To anticipate the usage and to predict the usability To design and to evaluate interactive systems along the lifecycle Participatory design method And simulation techniques (as Moz) for the experimentation and the test using

34. A good starting point : enrich the first idea Taking into account all the criteria about (a) sociological, (b) ergonomical, (c) economical, (d) technological points of view Idea Functions Specifications Scenario Observation Diagnostic Validation Mockup Evaluation

35. Sociology… Practice analysis Usage meaning By questionnaire By interviews By recording practices Applying sociological criteria  Recommendations for the design

36. Ergonomics... Simulation, Woz, Scenarios… Test human perceptive Test human behavior (after capture) under definite and limited scenarios Task and activity analysis  Recommendations for the design

37. The first cycle ends… Functionalities definition Design constraints Criteria Evaluation definition Specifications  Then development can start along a second iterative cycle

38. The hardware platform User Devices for observation Wizard 1 Wizard 2 Control video Multimedia recording Interactive devices

39. Conclusion… CLIPS-IMAG is… A research lab on interactive systems Open on the technological transfert Focused on user centered design methods