1. 121/10/06 Using Visual Cues of Contact to Improve Interactive Manipulation of Virtual Objects in Industrial Assembly/Maintenance Simulations Jean Sreng, Anatole Lécuyer, Christine Mégard, Claude Andriot jean.sreng@cea.fr

2. 221/10/06 Outline Introduction Type of information to visualize Related work Visual cues of contact –Contact glyphs –Contact lights Preliminary evaluation Conclusion OUTLINE

3. 321/10/06 Outline Introduction Type of information to visualize Related work Visual cues of contact –Contact glyphs –Contact lights Preliminary evaluation Conclusion OUTLINE

4. 421/10/06 Introduction Context: Virtual prototyping, assembly/maintenance simulations Problem: Complex industrial geometries – Multiple contact – Hard manipulation

5. 521/10/06 Two types of information to visualize For all contacts : –Local minimal distances [Johnson et al., 03] First point Second point –Contacts Contact point and orientation Contact force Imagine two models that have just collided. This collision can be represented at a single point on each surface [...]. If the models move apart, this pair of points tracks the local minimum distance and represents the potential future contacts between entire sections of these two models. [Johnson et al., 03]

6. 621/10/06 Related work –Visual aids [McNeely et al., 06] –Visual glyphs [Redon, 02] –Visual cues [Wanger et al., 92]

7. 721/10/06 Visual cues We have chosen to develop two novel types of visual feedback : – Contact glyphs Proximity Effort Hybrid – Contact lights

8. 821/10/06 Outline Introduction Type of information to visualize Related work Visual cues of contact –Contact glyphs –Contact lights Preliminary evaluation Conclusion OUTLINE

9. 921/10/06 Proximity – Contact - Forces

10. 1021/10/06 Proximity glyphs

11. 1121/10/06 Proximity glyphs Video

12. 1221/10/06 Effort glyphs

13. 1321/10/06 Effort glyphs Video

14. 1421/10/06 Hybrid glyphs

15. 1521/10/06 Hybrid glyphs

16. 1621/10/06 Hybrid glyphs

17. 1721/10/06 Hybrid glyphs Video

18. 1821/10/06 Glyph filtering Reduce the number of displayed glyphs : –Filtering technique based on users motion

19. 1921/10/06 Outline Introduction Type of information to visualize Related work Visual cues of contact –Contact glyphs –Contact lights Preliminary evaluation Conclusion OUTLINE

20. 2021/10/06 Contact lights Lights are disposed at the contact point : –Do not overload the visual feedback –Can be combined with glyphs

21. 2121/10/06 Without visual feedback

22. 2221/10/06 Spherical lights

23. 2321/10/06 Conical lights

24. 2421/10/06 Contact lights Video

25. 2521/10/06 Contact lights and hybrid glyphs Video

26. 2621/10/06 Outline Introduction Type of information to visualize Related work Visual cues of contact –Contact glyphs –Contact lights Preliminary evaluation Conclusion OUTLINE

27. 2721/10/06 Preliminary evaluation Collect data about users preferences Participants were asked to perform an industrial assembly operation –Without visual cues –With each visual cues They had to fill a subjective questionnaire

28. 2821/10/06 Experimental setup SpacePilot Physical Engine (GVM/LMD) Graphical Engine (VTK) P4 2.4GHz / NVidia Quadro 4 30 FPS

29. 2921/10/06 Experimental evaluation 18 participants Procedure : –Learning phase (20 min) –Testing phase (20 min) All the visual glyphs were presented They were asked to complete the assembly They have to test successively all glyphs They were no time limited They could freely test again any glyph –Fill subjective questionnaire (5 min)

30. 3021/10/06 Collected data Rank 5 visual effects according to 4 preference criteria : –5 visual effects : Apparition of a light Apparition of a glyph Color change Size change Deformation –4 criteria : Understanding the blocking situations Perception of distances Perception of contact forces Focus on contact area Preferences among the shapes : disk / sphere / arrow ? Preferences about filtering : with or without ?

31. 3121/10/06 Results χ2 test on ranks and parametric ANOVA test on rank used as value Participants were able to associate effects and visual cues Contact lights : Preferred to focus attention –Some found it useful for distances appreciation [Kjelldahl et al.] –Decrease the visual workload –Can suggest information in occlusion context

32. 3221/10/06 Discussion Glyphs : Preferred for distances and contact forces –Are reported to help precise manipulation –Color gradient is easily understood (distances) –Size change are globally well appreciated Deformation : Preferred for contact forces –Can be naturally perceived (Meet up the pseudo-haptic effect [Lécuyer et al., 00] )

33. 3321/10/06 Conclusion We proposed visual cues to improve manipulation in industrial assembly/maintenance context : –Glyphs Arrows, disks, sphere Proximity, Effort, Hybrid –Filtering –Lights Preliminary evaluation suggested that the visual cues and their associated visual effects seemed useful

34. 3421/10/06 Further work Quantitative evaluation in complex industrial context –Compare visual feedback and haptic or audio feedback Develop contextual visual cues –Adapt to different situations Complementary technique could be investigated : –Camera motions –Automatic and multiple viewpoints –Magnifying effects –Transparency on occlusions

35. 3521/10/06 ? Question Thank you for listening Questions ?