Vibro-Tactile feedback during Pen Manipulation in Space Fareed Ahmed Project for the course New Interaction Techniques Fall 2003

Overview What is Tactile Feedback Project Overview Apparatus Applications / Conclusion Future Investigation References Questions

Tactile Feedback Tactile Means –Perceptible by touch: TANGIBLE –Relating to the sense of touch Referring to the sense of contact with the object, mediated by the responses of low-threshold mechanoreceptors innervating the skin, within and around the contact region. Mechanoreceptors –Human being and other animals have several types of receptors of mechanical stimuli. Each initiates nerve impulses in sensory neurons when it is physically deformed by an outside force such as: touch, pressure, stretching, sound waves, motion

Project Overview Three Main Parts –Capture Video –Process Image –Produce Tactile Feedback

Apparatus Used WebCam Logitech Tactile Feedback Mouse Tactile Pen

Form Load WebCam: Connect and initialize Picture Control: Display green pixel if RGB value in green range Col.R 190 CaptureImage ImmersionControl PicFrame_Mou seMove() CapEditCopy to copy single frame to clipboard PSet Timer1 Vibro-Tactile feedback StartEffect ClipBoard GetData

Video Capture Capture Videos using Logitech webcam Private Sub Form_Load() Retrieves driver info capGetDriverDescriptionA 0, lpszName, 100, lpszVer, 100 lwndC = capCreateCaptureWindowA(lpszName, WS_CHILD Or WS_VISIBLE, 0, 0, 160, 120, picVideo.hwnd, 0) capSetCallbackOnVideoStream lwndC, AddressOf MyFrameCallback End Sub Public Sub captureImage() capEditCopy lwndC picFrame.Picture = Clipboard.GetData End Sub

Video Processing Capture Video as Frames Process each Frame as Image Detect green colour in Image Highlight One of Nine sectors on Screen

Produce Tactile Feedback Generate Tactile Feedback Using –Tacticons created by Immersion Soft –Tactile impact redirected from Mouse to Pen/Stick

Applications Applications for the disabled people –for example, presenting information or models with a tactile display when the user does not see well Tactile feedback as a part of graphical user interface –for example, to be used to give feedback on specific events Games, virtual reality –the simulated world feels more real when the user can really touch it

Future Investigations Study Subjects behavior with Application Addition of Sound with tactile feedback Creation of a Game with Tactile Feedback Application Integration with mobile Devices [3, 4]

Future Investigations (Cont.) [2]

References [1] Corde Lane and Jerry Smith: Force and Tactile Feedback [2] Cao, X., Balakrishnan, R. VisionWand: Interaction Techniques for Large Displays using a Passive Wand Tracked in 3D. [3] Zack Rosen: Creating a Web Browser For The Blind Using Tactile Feedback [4] Roope Raisamo: Tactile User Interfaces [5] Jeonghun Ku, Richard Mraz: Implementing a Data Glove with Tactile Feedback 20Abstract.pdf

Questions ?