Digital da Vinci Presented by: Navin Harjani Sikander Morad Christopher Sun

Overview Purpose and scope Usage scenario Prototype system Alpha System Beta System Conclusion

Purpose and Scope Current systems: Traditional painting Computer aided drawing Users of one system are typically uncomfortable/unfamiliar with the other

Purpose and Scope Digital da Vinci is an intermediary, combining aspects of both systems Painting program which uses gestural input and large screen projection output Designed for ease of use for all artists: Traditional Computer-based

Usage Scenario Drawing a mural (house scene): Draws a house by tracing shapes Draws freehand a red flower Erases flower due to wrong color Mixes a lighter color of red Redraws flower with new color Notices the ability to copy from the help screen Selects the flower and copies it several times Saves painting

Benefits Computer aided drawing: Selecting, zooming, copying, moving Shapes Eraser Saving and loading In-system help Traditional painting: Un-tethered input Large canvas size Mixing of colors Natural gestures

Paper Storyboard Presented to two types of users An engineer An artist Created for initial feedback: Functionality Gestures Basic GUI layout

Paper Storyboard

Computer Prototype Done in Visual Basic.Net due to its usefulness in creating GUI’s Attempted to incorporate most of the storyboard suggestions Provided limited functionality

Computer Prototype

Prototype Feedback No feedback was given for non- functional features Unclear feedback for functional features in the Digi-Palette Lack of help provided for functions Presence of a mixing area was unclear

Prototype Feedback The X-Y coordinates and the dynamic help were distracting The user was not able to erase/undo an action or clear the Mixing area Buttons were not clearly labeled No feedback or conformation was given for the New and Save features

Prototype Evolution Increased highlighting and labeling of objects in Digi-Palette Digi-Help improvements Additional help pages The option to hide the help pages Increase dynamic content of help pages Added an eraser to Digi-Palette

Prototype Evolution Prompts for saving and exiting and saving over previously saved files Dynamic cursor giving feedback on system status Changed the color and background of the mixing area

Alpha System Done in Visual Basic.Net Incorporated suggestions from the feedback of the prototype Increased functionality

Alpha Feedback The mixing area and the custom colors need to be more obvious Appearance between selected, non- selected and disabled buttons is not noticeable enough The colors on the palette are not saved when switching screens

Alpha Feedback Setting custom colors should be done with a dragging action Eraser should not be used on Digi- Palette Cursor feedback was not adequate Digi-Spectrum was counter-active to our design goal

Beta System - Mouse MOTIVATION TA feedback on alpha system Meet the functional requirements of our initial design which were omitted in the Alpha system. Try to create a unique gesture set which would easily be integrated in the SRE

Beta System - Mouse Implemented entirely in PERL/TK 1. Portability: Works on all platforms. 2. Flexibility: Easier to develop and integrate into the SRE than VB.net.

Beta System - Mouse Evolution of interface Added the omitted functionality Improved method of selection Improved cursor feedback for different modes. Added highlighting and graying out of unused buttons. Used unique mouse events to describe actions which would be translated to our gesture set.

Beta System - Gestures Required the translation of our interface to the Shared reality room. Changed all the event bindings. Changed screen resolution and buttons sizes. Constrain user action for error prevention.

Beta System - Gestures UDP packets sent camera information of where the head and hand of the user was and basic trigonometry was used to extrapolate these to where the user was pointing. MOUSE UP MOUSE DOWN ARM EXTEND ARM RETRACT

Beta System – Video

Future work Increase performance of the body tracker. Utilize information from all cameras. Through usability testing change our interface to reflect differences between mouse and gesture interface. Two handed-gestures.

Conclusion Iterative process allowed for us to meet the following HCI principles: Know thy user: Artist and painters Feedback Natural mapping of gestures MORE TESTING