Innovative wearable interfaces: an exploratory analysis of paper-based interfaces with camera-glasses device unit Bonhyun Koo Yun Zhou *, Tao Xu †, Bertrand David †, and Rene´ Chalon † * CNRS, Universite´ Lyon, France † CNRS, Ecole Centrale de Lyon, France Personal and Ubiquitous Computing (2014)

Contents 1. Introduction (Goal and Contributions) 2. Related Works 3. Overview of Innovative User Interface - Innovative UI & Scenario - EDI (Environment Dependant Interface) - EII (Environment Independent Interface) 4. Design of MobilePaperAccess - Input Technique - Paper Surface 5. Implementation - Wearable Configuration - Finger & Mask Motion - Augmented Paper & Digital Visual Feedback - Application 6. Evaluation 7. Summary & Future works

1. Goal and Contributions Background - Traditional user interfaces, used on the desktop computer (WIMP), is no longer appropriate for ubiquitous computing Goal -To Introduce available solutions to enable ubiquitous interaction  Nomadism and Mobility (MobilePaperAccess) - To create a true contextualization (based on the user’s location or independent of it)

2. Related Works Wearable Input Techniques : Miniaturization & Interaction Wearable Output Techniques : Challenges (Insufficient lumens & High resolutions) Paper Interaction  To bridge the digital and real world as a light and economical way object Gesture (Minput) Stylus (FACT)Gesture (Sixsense) Pico-Projector Head-won displays (Eyeglass-Based Systems For Wearable Computing) Handheld mobile phones Interaction Palette (IR reflective markers) Quickies (Media Lab.)

3. Overview of Innovative User Interface Relationship between (a) IEI (In-Environment Interface) (b) EDI (Environment Dependent Interface) (c) EII (Environment Independent Interface)

3. Innovative User Interface (Scenarios) Scenarios (in the smart city) 1) Alice wants to discuss w/ Yan. 2) (Bob is out of office) 3) Alice checks Bob’s schedule (sends him a date request) public place Outside Bob’s door (In a library) Alice is looking through books when he suddenly remembers that he needs to Discuss with another new member John. He opens his notebook and finds a predefined paper-based interface

3. Innovative User Interface (EDI and EII) EDI Interface EII Interface specific locations location free

4. Design of MobilePaperAccess Input Techniques

4. Design of MobilePaperAccess Paper Surface Design 29.7cm 21.0cm Paper The average forward grip reach : 74.3cm Color Marker (c), (d) ARToolKit Tag (a), (b)

5. Implementation (Wearable Configuration) It consists of (1) camera-glasses device unit and (2) a laptop for calculation Small screen (PC Viewer) Micro-Optical SV-6 Web-Cam (RGB 640x480) Laptop (2) (1)

5. Implementation (Finger and Mask Motion) Object Tracking (based on the OpenCV - MeanShift&CamShift algorithm) 1) Counting the number of tracking points, 2) If (the number of points >= predefined condition) then Regard this action as a pointing

5. Implementation (Augmented Paper) Augmented Paper Types (a), (b), (c), and (d) Digital Visual Feedback Color marker Augmented Book ARToolkit Tag

6. Evaluation Participants : 12 students Stood Sat &Stood (freely) Participants : 12 students - 7 males, 5 females - Mean age : Average height : 171.8cm

6. Evaluation

7. Summary & Future works

Q & A

[MeanShift & CAMShift]