Spring 2007 COMP TUI 1 Computer Vision for Tangible User Interfaces

Spring 2007COMP TUI2 Computer Vision Method for extracting information from images and video streams Method for extracting information from images and video streams Includes object identification and tracking Includes object identification and tracking Commonly combined with video projectors in TUI applications to augment physical objects with digital information. Commonly combined with video projectors in TUI applications to augment physical objects with digital information.

Spring 2007COMP TUI3 Computer Vision Strengths: Strengths: Fast way to do mockups and prototypes Fast way to do mockups and prototypes Can track position and orientation of multiple objects Can track position and orientation of multiple objects Weaknesses: Weaknesses: Can be sensitive to lighting and obstructions Can be sensitive to lighting and obstructions Not portable Not portable Often not robust Often not robust Computationally expensive Computationally expensive

Spring 2007COMP TUI4 Java Media Framework A Java library that will interface with most web cams A Java library that will interface with most web cams Makes it easy to capture still frames from a video stream Makes it easy to capture still frames from a video stream Sample code available on the compTUI website Sample code available on the compTUI website

Spring 2007COMP TUI5 ARToolkit Open source library Open source library Tracks the position and orientation of physical markers Tracks the position and orientation of physical markers Real time performance Real time performance Markers use simple black squares Markers use simple black squares Pattern matching allows any marker patterns to be used Pattern matching allows any marker patterns to be used

Spring 2007COMP TUI6 Intel’s Open Source Computer Vision Library (opencv) Real time computer vision library Real time computer vision library Open source Open source Object Identification Object Identification Face Recognition Face Recognition Gesture Recognition Gesture Recognition Motion Tracking Motion Tracking Tracks the position and orientation of physical markers Tracks the position and orientation of physical markers Real time performance Real time performance

Spring 2007COMP TUI7 TopCodes Tangible Object Placement Codes Tangible Object Placement Codes Designed for fast and accurate computer vision Designed for fast and accurate computer vision Each TopCode encodes a 13-bit number Each TopCode encodes a 13-bit number Can track position, size, and angular orientation of multiple objects Can track position, size, and angular orientation of multiple objects Self-calibrating Self-calibrating 100% Java 100% Java Code available on the compTUI website Code available on the compTUI website