1. Augmented assembly using a multimodal interface Muscle Showcase Sanni Siltanen, VTT Alex Potamianos, TUC

2. Augmented assembly system PC/Laptop Light-weight HMD with camera Visual Markers Display

3. Multimodal Dialogue Interface Multimodal interface includes: –Visual Control and Visual feedback –Spoken Input and Audio feedback –Gesture Recognition Speech+HMD vs. Keyboard+HMD –More natural and convenient communication Main components –Gesture Recognition –Speech Recognition and Speech Understanding –Multimodal Dialogue Manager –Multimodal Controller

4. Augmented instructions Speech Control Visual Control