1 This NoE is proposed to the EC in the 6th framework program Acceptance is expected before end of June,

2 Who ? 19 CORE PARTNERS UCL Université Catholique de Louvain-la-Neuve, Belgium(Pr. B. Macq, Pr. J. Vanderdonckt) AUTH Aristotle Univ. of Thessaloniki, Greece (Pr. I.Pitas) EPFL Ecole Polytechnique Fédérale de Lausanne, Switzerland (M.Kunt) EURECOM Institut Eurécom, France (Pr. J-L.Dugelay) FPMs Faculté Polytechnique de Mons, Belgium (Pr. Th. Dutoit) I3S Laboratory, University of Nice-Sophia Antipolis and CNRS (Pr. M.Barlaud) ICI National Institute for R. and D. in Informatics-ICI Bucharest, Romania (Pr. C.Pribeanu) IMPERIAL Imperial College London (Pr. R. Kitney) INRIA Institut National de Recherche en Informatique et en Automatique, France (Pr. Christine Guillemot) ISTI Consiglio Nazionale delle Ricerche-ISTI, Italy (Dr. F. Paterno) ITI-CERTH Centre for Research and Technology Hellas, Greece (Pr. M.Strintzis) LIU University of Linkoping, Sweden (Pr. H. Knutsson) LPI-UVA Universidad de Valladolid-LPI-UVA, Spain (Pr. C. Alberola) NISLAB University of Southern Denmark-NISLAB, Denmark (Pr. N.O. Bernsen) UCD University College Dublin, Ireland ( Pr. G.Silvestre) ULPGC University of Las Palmas Gran Canaria,Spain (Pr. J.Ruiz-Alzola) UNIGE University of Geneva-CVML, Switzerland (Pr. Th. Pun) UPC Universitat Politècnica de Catalunya, Spain (Pr. F. Marques) ZGDV Zentrum für Graphische Datenverarbeitung, Germany (Dr. M. Schnaider)

3 Who ? (2) 12 ASSOCIATED PARTNERS BUMM, Bogazici (Bosphorus) University, Turkey CNRS-LIMSI, Laboratoire d'Informatique et des Sciences de l'Ingénieur, France DMI, Digital Media Institute, Tampere University of Technology, Finland ESP-DAKAR, Ecole Supérieure Polytechnique de Dakar, Sénégal FHG-IGD, Fraunhofer Institute für Graphische Datenverarbeitung, Germany HERAKLION, University Of Crete (UOC), Greece INPG-LISLIS, Institut national Polytechnique de Grenoble, France MULTITEL, Multitel, ASBL, Belgium MVGL-KOC, Koc University, Turkey SPIIRAS, St Petersburg Institute for Informatics and Automation, Russia UNIMD, University of Magdeburg, Germany UPM, Universitat Politecnica de Madrid, Spain

4 Who ? (3) 13 INDUSTRIAL PARTNERS Alterface, Belgium Commedica, UK Computerland, Belgium EADS European Aeronautics Defense and Space-Airbus, France Fastcom Technology SA, Switzerland France Telecom, S.A., France Immedia SA, Belgium Eli Lilly Pharmaceuticals, USA PSA-Peugeot-Citroën, France Siemens AG, Germany Systema S.A., Greece Telemis SA, Belgium VoxPilot Ltd, Ireland

5 What ? The long-term objective of SIMILAR is to merge European research in the human- machine interface field into a single European taskforce. The immediate objectives are: to integrate the traditionally separated research communities in visual interaction, interactive speech, interactive haptics, learning, and human-computer interaction (HCI) across Europe; to integrate national and regional research communities in a larger community; to promote standards, solutions and dissemination of knowledge and to eventually lead to the establishment of a single ‘European virtual research centre in multimodal interaction’ with strong industrial support.

6 How ? SIMILARnet ( accessible at ) is a multimodal, multimedia web virtual private network and web portal; it is based on the i-portal tool from our partner Computerland (Belgium). A joint program of research activities with 6 SIGs (Special Interest Groups) : SIG on Information theory SIG on Context-Aware Adaptation SIG on Multimodality Analysis and Synthesis SIG on Medical applications SIG on Disabled applications SIG on edutainment and learning assistance Integrating activities such as PhD exchanges, summer schools and troubadours. Disseminating activities such as seminars, conferences, books, open house days and a software contest.

7 Example of multimodal interaction (courtesy of Alterface) xxx

8 Example of multimodal co-registration Mutual information between video and audio features

9 (Brain-computer interface and video) Another example of multimodal co-registration

10 Thank you For your attention