2. Outline Introduction Related Work System Overview Methodology Experiment Conclusion and Future Work

3. Introduction In this paper, the authors propose an AR interface for assembly design and evaluation. A key novelty of this research is the use of bare hands for human-computer interaction in the AR assembly environment. An experiment using two fingertips to control virtual objects to simulate assembly in a 2D space is conducted.

4. Related Work Zauner et al. [1] - AR-based step-by-step furniture assembly system in a mixed reality environment Halttunen et al. [2] - system augmenting digital virtual prototypes with physical objects to examine the functionality and features of products in an AR environment Fiorentino et al. [3] - space design system which is an AR system addressing the aesthetic design of free-form curves and surfaces [1] J. Zauner, M. Haller, A. Brandl, W. Hartman, “Authoring of a mixed reality assembly instructor for hierarchical structures”, Proceedings Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003, pp. 237-246. [2] V. Halttunen, T. Tuikka, “Augmenting virtual prototyping with physical objects”, Proceedings of the Workshop on Advanced Visual Interfaces, 2000, pp. 305-306. [3] M. Fiorentino, R. Amicis, G. Monno, A. Stork, “Spacedesign: A Mixed Reality Workspace for Aesthetic Industrial Design”, Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, 2002, pp. 86-318.

5. Related Work Zauner et al. [1] - AR-based step-by-step furniture assembly system in a mixed reality environment Halttunen et al. [2] - system augmenting digital virtual prototypes with physical objects to examine the functionality and features of products in an AR environment Fiorentino et al. [3] - space design system which is an AR system addressing the aesthetic design of free-form curves and surfaces [1] J. Zauner, M. Haller, A. Brandl, W. Hartman, “Authoring of a mixed reality assembly instructor for hierarchical structures”, Proceedings Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003, pp. 237-246. [2] V. Halttunen, T. Tuikka, “Augmenting virtual prototyping with physical objects”, Proceedings of the Workshop on Advanced Visual Interfaces, 2000, pp. 305-306. [3] M. Fiorentino, R. Amicis, G. Monno, A. Stork, “Spacedesign: A Mixed Reality Workspace for Aesthetic Industrial Design”, Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, 2002, pp. 86-318. “Users feel uncomfortable to use data gloves, built-in touch- panel, wrist sensor, finger-worn sensor, optical markers, and the cost can be very high”

6. System Overview

7. Methodology – Interaction tool

8. Methodology – Barehand Interaction

9. Methodology

10. Experiment

12. Conclusion and Future Work In this paper, an interface for assembly design and evaluation using AR techniques is proposed. Using a HMD for visualization and a camera for capturing the real scene, users can interactively manipulate both the real and virtual components to perform assembly design and evaluation in an AR environment. A bare-hand interface was developed to improve the human- computer interaction in performing the assembly operations in the AR environment. A hand segmentation method and fingertips detection method are used to segment a user’s hand and acquire the fingertips for human-computer interaction.

13. Conclusion and Future Work However, the current hand segmentation and fingertips tracking algorithms are executed in a 2D space, meaning that there is no depth information in the proposed system. Further research will be necessary to find an effective algorithm to deal with 3D manipulative gestures so that the users can interact with virtual objects more naturally and intuitively. Two important issues will be further investigated, namely, correct occlusion between the real and virtual components, and a more robust marker-less tracking and registration method.

14. Contribution to our work

15. Thank you for your attention! mania@kaist.ac.kr