Select-and-Point: A Novel Interface for Multi-Device Connection and Control based on Simple Hand Gestures Hyunglae Lee Ki-Won Yeom Heeseok Jeong Hyun-Jin Shin JoongHo Lee Ji-Hyung Park Korea Institute of Science and Technology (KIST) P.O.BOX 131, Cheongryang, Seoul , Korea Copyright is held by the author/owner(s). CHI 2008, April 5 – April 10, 2008, Florence, Italy ACM /08/04

Outline Introduction Related Work System Description Implementation in Intelligent Meeting Room First Impression of the Select-and-Point System Future Work

Introductio In today’s ubiquitous computing environment, anyone might have had experiences of wasting time in setting up devices such as connecting his/her PC with the projector, disconnecting a keyboard or a mouse for another connection, or plugging in and out USB mass storage devices several times for data sharing.

Related Work Pick-and-Drop

System Description 1. Select-and-Point The Select-and-Point system enables virtual connection of multiple devices through a network based on simple hand gestures. Users can establish or change connections between devices and perform file sharing with simple hand gestures.

Select-and-Point system supports heterogeneous multi-device connection. USER2 USER1

2. System Configuration The Select-and-Point system is composed of three parts, that is, a presence server, controlling peer and controlled peer

System Configuration composed of a presence server, controlling peer and controlled peer.

3. Bare-hand Gesture Interaction Bare-hand gesture recognition is essential to implement the Select-and-Point system. Here, bare-hand means that no devices are attached to the user and the user uses his/her hands as an input device.

Implementation in Intelligent Meeting Room The Select-and-Point system is implemented in a intelligent meeting room called ‘Intelligent and Responsive Space (IRS) [4].’ The IRS which mainly consists of a touch-sensitive tabletop display and surrounding wall screens is set up for efficient collaborative works such as a team meeting or a seminar presentation.

First Impression of the Select-and-Point System Ten subjects (two experts in using computer or mobile devices, six experienced users and two novice users) “It’s simple and intuitive,” “I like it because there’s no need to move tonear the device,” “it’s like magic,” and “even exciting!”

Future Work PDAs and mobile phones.