HCI 입문 Graphics Korea University HCI System 2005 년 2 학기 김 창 헌

KUCG 2 Graphics Korea University Contents Graphical Input Devices Graphical Input Devices VR System Anatomy VR System Anatomy VR Applications VR Applications Problems Problems

KUCG 3 Graphics Korea University Contents Graphical Input Devices Graphical Input Devices VR System Anatomy VR System Anatomy VR Applications VR Applications Problems Problems

KUCG 4 Graphics Korea University Graphical Input Devices Logical Input Devices Logical Input Devices 3D Input Devices 3D Input Devices

KUCG 5 Graphics Korea University Logical Input Device Types (1 / 2) Keyboard Keyboard Returns keys with specific meanings Returns keys with specific meanings

KUCG 6 Graphics Korea University Logical Input Device Types (2 / 2) Valuator Valuator Returns a value for something Returns a value for something Locator Locator Returns the location of the screen cursor Returns the location of the screen cursor Display-to-Input ratio Display-to-Input ratio

KUCG 7 Graphics Korea University Graphical Input Devices Logical Input Devices Logical Input Devices 3D Input Devices 3D Input Devices

KUCG 8 Graphics Korea University 3D Input Devices Position trackers Position trackers Gloves Gloves Others Others

KUCG 9 Graphics Korea University Position Trackers (1 / 2) Body parts to be tracked Body parts to be tracked Hand, finger Hand, finger Eye Eye Head Head Whole body Whole body

KUCG 10 Graphics Korea University Position Trackers (2 / 2) Performance specifications Performance specifications Static accuracy Static accuracy Dynamic accuracy Dynamic accuracy Latency Latency Update rate Update rate Signal to noise ratio (SNR) Signal to noise ratio (SNR) Registration Registration

KUCG 11 Graphics Korea University Tracking Methods Mechanical Mechanical Magnetic Magnetic Optical Optical Stereo, multiple cameras Stereo, multiple cameras Time-of-flight, phase Time-of-flight, phase Structured light Structured light Acoustic Acoustic GPS GPS Research issues Research issues Tracking and prediction Tracking and prediction Sensor fusion Sensor fusion

KUCG 12 Graphics Korea University Force Feedback in 3D (1 / 2)

KUCG 13 Graphics Korea University Force Feedback in 3D (2 / 2)

KUCG 14 Graphics Korea University Force Feedback in 2D

KUCG 15 Graphics Korea University Contents Graphical Input Devices Graphical Input Devices VR System Anatomy VR System Anatomy VR Applications VR Applications Problems Problems

KUCG 16 Graphics Korea University Functional Diagram Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB

KUCG 17 Graphics Korea University Modules Sensing Sensing Virtual perception Virtual perception Interaction Interaction Simulation Simulation Rendering Rendering Displaying Displaying Virtual world DB Virtual world DB

KUCG 18 Graphics Korea University Sensing and virtual perception Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB

KUCG 19 Graphics Korea University Sensing and virtual perception Sensing Sensing Physical sensors of the conceptual model Physical sensors of the conceptual model Virtual perception Virtual perception Transition from the physical sensors to the logical sensors Transition from the physical sensors to the logical sensors

KUCG 20 Graphics Korea University Sensing and virtual perception (con ’ t) Image processor Speech recognition Facial/face expression recognition Body gesture recognition Hand gesture recognition Controller Image processor Video camera Signal processor Microphone Video camera Glove SensingVirtual Perception

KUCG 21 Graphics Korea University Interaction Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB

KUCG 22 Graphics Korea University Simulation (1 / 2) Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB

KUCG 23 Graphics Korea University Simulation (2 / 2) Change the virtual world Change the virtual world According to the interaction According to the interaction Kinematic simulation Kinematic simulation Dynamic simulation Dynamic simulation

KUCG 24 Graphics Korea University Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB Rendering (1 / 2)

KUCG 25 Graphics Korea University Rendering (2 / 2) Rendering the simulated results Rendering the simulated results Perceptualization Perceptualization Image rendering Image rendering Sound rendering Sound rendering Haptic rendering Haptic rendering Others Others Flat Gouraud Phong

KUCG 26 Graphics Korea University Displaying (1 / 2) Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB

KUCG 27 Graphics Korea University Displaying (2 / 2) Stereo Image Display Headphone Haptic Display Stereo Image Generation 3D Sound Generation Haptic Signal Generation

KUCG 28 Graphics Korea University Virtual World DB (1 / 2) Displaying VW Authoring Sensing Virtual Perception Interaction Simulation Rendering VW DB

KUCG 29 Graphics Korea University Virtual World DB (2 / 2) Representation of virtual worlds Representation of virtual worlds Scene graph Scene graph Big issue Big issue Expressiveness vs. efficiency Expressiveness vs. efficiency

KUCG 30 Graphics Korea University Contents Graphical Input Devices Graphical Input Devices VR System Anatomy VR System Anatomy VR Applications VR Applications Problems Problems

KUCG 31 Graphics Korea University Some VR Applications Entertainment Entertainment Augmented Reality Augmented Reality Training Training Remote Robotics Remote Robotics Distributed collaboration Distributed collaboration Visualization Visualization

KUCG 32 Graphics Korea University Entertainment Definitely the biggest market Definitely the biggest market The main force for driving down prices on VR hardware The main force for driving down prices on VR hardware ex) Game with other computers / players ex) Game with other computers / players

KUCG 33 Graphics Korea University Augmented Reality (1 / 4) Bridging virtual environment and real world Bridging virtual environment and real world Real Environment Virtual Environment Augmented Reality Augmented Virtuality

KUCG 34 Graphics Korea University Augmented Reality (2 / 4) Display virtual object on real background Display virtual object on real background

KUCG 35 Graphics Korea University Augmented Reality (3 / 4) Ultra sound ApplicationVirtual Surgery Augmented-reality displays will overlay computer-generated graphics onto the real world

KUCG 36 Graphics Korea University Augmented Reality (4 / 4) Agent-augmented Reality Location-aware Interactive Navigation/Guidance system

KUCG 37 Graphics Korea University Training (1 / 2) When the cost of a mistake in real world is very high When the cost of a mistake in real world is very high ex) Aircraft simulators, pilot training systems, surgery simulator ex) Aircraft simulators, pilot training systems, surgery simulator

KUCG 38 Graphics Korea University Training (2 / 2) Flight simulator

KUCG 39 Graphics Korea University Remote Robotics Remote Robotics in Hazardous Environment

KUCG 40 Graphics Korea University Distributed Collaboration (1 / 2) More collaborative More collaborative Than by telephone or video conferencing Than by telephone or video conferencing Virtual Conferencing

KUCG 41 Graphics Korea University Virtual Battles Collaborative Design Distributed Collaboration (2 / 2)

KUCG 42 Graphics Korea University Visualization (1 / 4) VR as a visualization research tool VR as a visualization research tool

KUCG 43 Graphics Korea University Visualization (2 / 4)

KUCG 44 Graphics Korea University Visualization (3 / 4)

KUCG 45 Graphics Korea University Visualization (4 / 4)

KUCG 46 Graphics Korea University Contents Graphical Input Devices Graphical Input Devices VR System Anatomy VR System Anatomy VR Applications VR Applications Problems Problems

KUCG 47 Graphics Korea University Problems Cost Cost What’s it good for? What’s it good for? None of the existing systems can solve common everyday problems None of the existing systems can solve common everyday problems Display resolution Display resolution Update speed Update speed