Augmented assembly using a multimodal interface Muscle Showcase Sanni Siltanen, VTT Alex Potamianos, TUC.

Slides:

Advertisements

Similar presentations

Advertisements

PUI 98 Leveraging Human Capabilities in Perceptual Interfaces George G. Robertson Microsoft Research George G. Robertson Microsoft Research.

Input Jeopardy The Keyboard Pointing Devices Pictures and Sounds Scanners and Readers Grab Bag $100100$100100$100100$100100$ $200200$200200$200200$200200$

HCI Research in The Netherlands Prof. dr. Matthias Rauterberg IPO Center for User-System Interaction TU/e Eindhoven University of Technology.

How To Design a User Interface For People With Disabilties

An overview of EMMA— Extensible MultiModal Annotation Michael Johnston AT&T Labs Research 8/9/2006.

The Steerable Projector and Camera Unit in an Instrumented Environment Lübomira Spassova Saarland University, Saarbrücken, Germany.

Irek Defée Signal Processing for Multimodal Web Irek Defée Department of Signal Processing Tampere University of Technology W3C Web Technology Day.

Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Computational Models of Multimodality Adequate.

Chapter 5 Input and Output. What Is Input? What is input? p. 166 Fig. 5-1 Next  Input device is any hardware component used to enter data or instructions.

Supporting Collaboration: Digital Desktops to Intelligent Rooms Mary Lou Maher Design Computing and Cognition Group Faculty of Architecture University.

Real-Time Audio-Visual Automatic Speech Recognition Demonstrator TSI-TUC, Greece (A. Potamianos, E. Sanchez-Soto, M. Perakakis) NTUA, Greece (P. Maragos,

Human factors in Translation Medical Spoken Language Translation for Patients with Limited English ILT CNGL Harold Somers, Sara Morrissey 2 PhD students.

Stanford hci group / cs376 research topics in human-computer interaction Multimodal Interfaces Scott Klemmer 15 November 2005.

ISTD 2003, Audio / Speech Interactive Systems Technical Design Seminar work: Audio / Speech Ville-Mikko Rautio Timo Salminen Vesa Hyvönen.

Invited Talk Telepresence in the Real World Presented by: Weihong Li --- ACM Multimedia 2004 Conference Workshop on Effective Telepresence (ETP’04) Duffie.

Introduction to the Computer

WIEN Structured Visual Markers for Indoor Pathfinder Michael Kalkusch Michael Knapp Thomas Lidy.

CSD 5230 Advanced Applications in Communication Modalities 7/3/2015 AAC 1 Introduction to AAC Orientation to Course Assessment Report Writing.

MUSCLE Multimodal e-team related activity Technical University of Crete Speech Processing and Dialog Systems Group Presenter: Prof. Alex Potamianos Technical.

Support for Palm Pilot Collaboration Including Handwriting Recognition.

“ Walk to here ” : A Voice Driven Animation System SCA 2006 Zhijin Wang and Michiel van de Panne.

Multi-Modal Dialogue in Personal Navigation Systems Arthur Chan.

Web Interface for the Visually Challenged by: Group Nine.

Building the Design Studio of the Future Aaron Adler Jacob Eisenstein Michael Oltmans Lisa Guttentag Randall Davis October 23, 2004.

Introduction to Graphics and Virtual Environments.

HAND GESTURE BASED HUMAN COMPUTER INTERACTION. Hand Gesture Based Applications –Computer Interface A 2D/3D input device (Hand Tracking) Translation of.

Overview of M ATCH: Mobilising Advanced Technologies for Care at Home Prof. Ken Turner University of Stirling 27th May 2008

Data collection and experimentation. Why should we talk about data collection? It is a central part of most, if not all, aspects of current speech technology.

Input Devices.  Identify audio and video input devices  List the function of the respective devices.

11.10 Human Computer Interface www. ICT-Teacher.com.

Introduction to Computer Organization and Architecture.

Future Directions in HCI Chris North cs3724: HCI.

Sketchbased interface on a handheld augmented reality system Rhys Moyne Honours Minor Thesis Supervisor: Dr. Christian Sandor.

PRESENTED BY: Nadia Qamoum Suzanne Blasingame Rachael Reano Hunza Iqbal.

ESR 9: Review of test results and plan for the final testing campaign 1/24 EDUSAFE Summer School, 22 nd June 2015 Yuta Itoh (TU Munich)

Augmented Reality Systems Applied to Poultry Grading and Inspection Simeon Harbert Georgia Tech Research Institute, Food Processing Technology Division.

Module 1, Lesson 1 The Art of Communication. TWO-WAY COMMUNICATION RECEIVERSENDERMESSAGE FEEDBACK.

Intelligent Robot Architecture (1-3)  Background of research  Research objectives  By recognizing and analyzing user’s utterances and actions, an intelligent.

NESPOLE! is a project which aims at providing a system capable of supporting communication in the field of e-commerce and e-service by resorting to automatic.

SkyNET Visualization Team Demo and Architecture Overview.

Choosing interaction devices: hardware components

A MBI L EARN Ambient Intelligent Multimodal Learning Environment for Children 100 day review December 2008 Jennifer Hyndman Supervisors: Dr. Tom Lunney,

 Describe the general organization and architecture of computers.  Identify computers’ major components and study their functions.  Identify the various.

© Michèle Courant, University of Fribourg Projects.

Communication Jargon. jargon jargon: A special language of a particular activity or group.

Conceptual Design Dr. Dania Bilal IS588 Spring 2008.

CONTENT FOCUS FOCUS INTRODUCTION INTRODUCTION COMPONENTS COMPONENTS TYPES OF GESTURES TYPES OF GESTURES ADVANTAGES ADVANTAGES CHALLENGES CHALLENGES REFERENCE.

Presented by : P L N GANESH CH DURGA PRASAD M RAVI TEJA 08551A A A0446.

Electronic visualization laboratory, university of illinois at chicago Towards Lifelike Interfaces That Learn Jason Leigh, Andrew Johnson, Luc Renambot,

CAR - Car Augmented Reality Aufgabensteller:Prof. Gudrun Klinker Ph.D. Betreuer:Dipl.-Inform. Christian Sandor Vortragender:Otmar Hilliges May 13, 2004.

Multi-Modal Dialogue in Personal Navigation Systems Arthur Chan.

Toward Subtle Intimate Interfaces for Mobile Devices Using an EMG Controller Enrico Costanza Media Lab Europe now at MIT Media Lab Samuel A. Inverso Media.

James A. Larson Developing & Delivering Multimodal Applications 1 EMMA Extensible MultiModal Annotation markup language Canonical structure for semantic.

Immersive Virtual Characters for Educating Medical Communication Skills J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine)

University of West Bohemia Faculty of Applied Sciences Department of Cybernetics Enterface 2008 Milos Zelezny –

Outline Introduction Related Work System Overview Methodology Experiment Conclusion and Future Work.

Stanford hci group / cs376 u Jeffrey Heer · 19 May 2009 Speech & Multimodal Interfaces.

Communication. What is communication? Communication is successfully making your wants, needs, feelings and ideas known to other people. There are three.

Humanoid-Human Interaction Presented by KMR ANIK 1.

BeNeFri University Vision assistance for people with serious sight problems Moreno Colombo Marin Tomić Future User Interfaces, BeNeFri University.

NCP meeting Jan 27-28, 2003, Brussels Colette Maloney Interfaces, Knowledge and Content technologies, Applications & Information Market DG INFSO Multimodal.

HUMAN MEDIA INTERACTION CREATIVE TECHNOLOGY FOR PLAY AND

Automated Detection of Human Emotion

Computer Fundamentals

to Enhance the Searching AndBrowsing of Physical Objects

المدخل إلى تكنولوجيا التعليم في ضوء الاتجاهات الحديثة

Multimodal Human-Computer Interaction New Interaction Techniques 22. 1

Automated Detection of Human Emotion

Computer Vision Readings

Presentation transcript:

Augmented assembly using a multimodal interface Muscle Showcase Sanni Siltanen, VTT Alex Potamianos, TUC

Augmented assembly system PC/Laptop Light-weight HMD with camera Visual Markers Display

Multimodal Dialogue Interface Multimodal interface includes: –Visual Control and Visual feedback –Spoken Input and Audio feedback –Gesture Recognition Speech+HMD vs. Keyboard+HMD –More natural and convenient communication Main components –Gesture Recognition –Speech Recognition and Speech Understanding –Multimodal Dialogue Manager –Multimodal Controller

Augmented instructions Speech Control Visual Control