1. Vibro-Tactile feedback during Pen Manipulation in Space Fareed Ahmed Fareed.Ahmed@uta.fi Project for the course New Interaction Techniques Fall 2003

2. Overview What is Tactile Feedback Project Overview Apparatus Applications / Conclusion Future Investigation References Questions

3. Tactile Feedback Tactile Means –Perceptible by touch: TANGIBLE –Relating to the sense of touch Referring to the sense of contact with the object, mediated by the responses of low-threshold mechanoreceptors innervating the skin, within and around the contact region. Mechanoreceptors –Human being and other animals have several types of receptors of mechanical stimuli. Each initiates nerve impulses in sensory neurons when it is physically deformed by an outside force such as: touch, pressure, stretching, sound waves, motion

4. Project Overview Three Main Parts –Capture Video –Process Image –Produce Tactile Feedback

5. Apparatus Used WebCam Logitech Tactile Feedback Mouse Tactile Pen

6. Form Load WebCam: Connect and initialize Picture Control: Display green pixel if RGB value in green range Col.R 190 CaptureImage ImmersionControl PicFrame_Mou seMove() CapEditCopy to copy single frame to clipboard PSet Timer1 Vibro-Tactile feedback StartEffect ClipBoard GetData

7. Video Capture Capture Videos using Logitech webcam Private Sub Form_Load() Retrieves driver info capGetDriverDescriptionA 0, lpszName, 100, lpszVer, 100 lwndC = capCreateCaptureWindowA(lpszName, WS_CHILD Or WS_VISIBLE, 0, 0, 160, 120, picVideo.hwnd, 0) capSetCallbackOnVideoStream lwndC, AddressOf MyFrameCallback End Sub Public Sub captureImage() capEditCopy lwndC picFrame.Picture = Clipboard.GetData End Sub

8. Video Processing Capture Video as Frames Process each Frame as Image Detect green colour in Image Highlight One of Nine sectors on Screen

9. Produce Tactile Feedback Generate Tactile Feedback Using –Tacticons created by Immersion Soft –Tactile impact redirected from Mouse to Pen/Stick

10. Applications Applications for the disabled people –for example, presenting information or models with a tactile display when the user does not see well Tactile feedback as a part of graphical user interface –for example, to be used to give feedback on specific events Games, virtual reality –the simulated world feels more real when the user can really touch it

11. Future Investigations Study Subjects behavior with Application Addition of Sound with tactile feedback Creation of a Game with Tactile Feedback Application Integration with mobile Devices [3, 4]

12. Future Investigations (Cont.) [2]

13. References [1] Corde Lane and Jerry Smith: Force and Tactile Feedback http://www.hitl.washington.edu/scivw/EVE/I.C.ForceTactile.html [2] Cao, X., Balakrishnan, R. VisionWand: Interaction Techniques for Large Displays using a Passive Wand Tracked in 3D. http://www.cs.toronto.edu/~caox/uist2003_visionwand.pdf [3] Zack Rosen: Creating a Web Browser For The Blind Using Tactile Feedback http://www.darktide.nu/nwa/zack/flash/PJAS10.ppt [4] Roope Raisamo: Tactile User Interfaces http://www.cs.uta.fi/kurssit/Interact/interact5-2001.ppt [5] Jeonghun Ku, Richard Mraz: Implementing a Data Glove with Tactile Feedback http://www.swchsc.on.ca/~virtualreality/downloads/IWVR%202003% 20Abstract.pdf

14. Questions ?