Lens Gestures: Integrating Compound Gesture Inputs for Shortcut Activation

Current Problem and Opportunity Questions: 1.Can compound gestures be accurately recognized? 2.Can compound gestures acquire shortcut targets accurately and at a faster rate than touch inputs? Opportunity: Lens Gestures uses the camera as a motion sensor, and this can be used as an alternative input source. Implications: – Quicker access to frequently used applications – Inaccurate recall of shortcuts

Compound Gesture Workflow 1. Initial Recognition 2. Perform Gestures 3. End Recognition Images from paper: “LensGesture: Augmenting Mobile Interactions with Back- of-Device Finger Gestures”

Demonstration

Challenges of a Compound Input System 1.Accuracy – Not all combinations are equitably easy to perform compared to their peers 2. Recall – The user will need to recall the specific combination to acquire a particular target

Addressing the Challenges of a Compound Input System 1.Accuracy – Study 1: Measuring Accuracy of Combinations - A group of participants will perform all one and two gesture inputs. The study will observe the accuracy rate of performing each gesture. 2.Recall – Study 2: Measuring Accuracy and Time of Target Acquisition – A group of participants will be asked to perform the gesture to acquire a given application. The study will observe the accuracy rate and time of acquiring the correct application for differing settings (one gesture, two gestures, and two gestures with one fixed single gesture, and touch inputs). – Preset mapping classify by type (social media, music, etc.)