ETHAN BROWN / KATE RAFTER

Slides:



Advertisements
Similar presentations
CSE 424 Final Presentation Team Members: Edward Andert Shang Wang Michael Vetrano Thomas Barry Roger Dolan Eric Barber Sponsor: Aviral Shrivastava.
Advertisements

Exploration of bump, parallax, relief and displacement mapping
Víctor Ponce Miguel Reyes Xavier Baró Mario Gorga Sergio Escalera Two-level GMM Clustering of Human Poses for Automatic Human Behavior Analysis Departament.
Joydeep Biswas, Manuela Veloso
A Novel 2D-to-3D Conversion System Using Edge Information IEEE Transactions on Consumer Electronics 2010 Chao-Chung Cheng Chung-Te li Liang-Gee Chen.
CGDD 4003 THE MASSIVE FIELD OF COMPUTER GRAPHICS.
LYU0603 A Generic Real-Time Facial Expression Modelling System Supervisor: Prof. Michael R. Lyu Group Member: Cheung Ka Shun ( ) Wong Chi Kin ( )
3D Mapping Robots Intelligent Robotics School of Computer Science Jeremy Wyatt James Walker.
May 2004Stereo1 Introduction to Computer Vision CS / ECE 181B Tuesday, May 11, 2004  Multiple view geometry and stereo  Handout #6 available (check with.
Sensation and Perception - depth.ppt © 2001 Dr. Laura Snodgrass, Ph.D. Depth Perception Four theoretical approaches –Cue theory unconscious calculation.
Real-Time Face Detection and Tracking Using Multiple Cameras RIT Computer Engineering Senior Design Project John RuppertJustin HnatowJared Holsopple This.
Professor : Yih-Ran Sheu Student’s name : Nguyen Van Binh Student ID: MA02B203 Kinect camera 1 Southern Taiwan University Department of Electrical Engineering.
CAP4730: Computational Structures in Computer Graphics 3D Concepts.
Multi-Sensor Image Fusion (MSIF) Team Members: Phu Kieu, Keenan Knaur Faculty Advisor: Dr. Eun-Young (Elaine) Kang Northrop Grumman Liaison: Richard Gilmore.
Technology and Historical Overview. Introduction to 3d Computer Graphics  3D computer graphics is the science, study, and method of projecting a mathematical.
Project Guide: Mr. B.RAVINDER Assistant Professor (CSE) Batch No.: CSB33 Team Members: D. Sai Goud A0569 Satya Swarup Sahoo A0574 G. Shivadeep.
A Method for Hand Gesture Recognition Jaya Shukla Department of Computer Science Shiv Nadar University Gautam Budh Nagar, India Ashutosh Dwivedi.
Week 5 - Wednesday.  What did we talk about last time?  Project 2  Normal transforms  Euler angles  Quaternions.
 Supervised by Prof. LYU Rung Tsong Michael Student: Chan Wai Yeung ( ) Lai Tai Shing ( )
1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 8 Seeing Depth.
Under construction Caroline Steiner & Michael Beham.
Online Kinect Handwritten Digit Recognition Based on Dynamic Time Warping and Support Vector Machine Journal of Information & Computational Science, 2015.
Kinect & 3D Scanning Mark Breedveld
Vehicle Segmentation and Tracking From a Low-Angle Off-Axis Camera Neeraj K. Kanhere Committee members Dr. Stanley Birchfield Dr. Robert Schalkoff Dr.
Professor : Tsung Fu Chien Student’s name : Nguyen Trong Tuyen Student ID: MA02B208 An application Kinect camera controls Vehicles by Gesture 1 Southern.
Advanced Analytics on Hadoop Spring 2014 WPI, Mohamed Eltabakh 1.
SciFest Overview Neil Gannon. Outline Demonstrations using a Microsoft Kinect sensor – Image Manipulation Real-time Invisibility Background removal (green.
CONTENT 1. Introduction to Kinect 2. Some Libraries for Kinect 3. Implement 4. Conclusion & Future works 1.
Delivering Business Value through IT Face feature detection using Java and OpenCV 1.
Immersive Rendering. General Idea ► Head pose determines eye position  Why not track the eyes? ► Eye position determines perspective point ► Eye properties.
Compatible Hardware and Software SDK’s Software/Hardware Issues.
Final Year Project. Project Title Kalman Tracking For Image Processing Applications.
Perception and VR MONT 104S, Fall 2008 Lecture 8 Seeing Depth
Support-Vector Networks C Cortes and V Vapnik (Tue) Computational Models of Intelligence Joon Shik Kim.
Antigone Engine. Introduction Antigone = “Counter Generation” Library of functions for simplifying 3D application development Written in C for speed (compatible.
Shadows David Luebke University of Virginia. Shadows An important visual cue, traditionally hard to do in real-time rendering Outline: –Notation –Planar.
Robotics Chapter 6 – Machine Vision Dr. Amit Goradia.
VR software and platform Dr. Nan WANG Dr. Ronan BOULIC EPFL Immersive Interaction Group.
67 x 89 = ? 67 x
On Wikipedia you can find the following definition of NUI: “In computing, a natural user interface, or NUI, or Natural Interface is the common parlance.
OpenCV C++ Image Processing
To Design an Interactive Learning System for Child by Integrating Blocks with Kinect Tamkang University Taiwan Presenter :FENG-CHIH HSU 1.
Microsoft Kinect How does a machine infer body position?
Lunabotics Navigation Package Team May14-20 Advisor: Dr. Koray Celik Clients: ISU Lunabotics Club, Vermeer Company.
CS552: Computer Graphics Lecture 35: Rendering. Recap Illumination Model o Light Source and surface o Effect of multiple light source o Colored lights.
Preliminary project assignment Smart house Natural User Interface for Business NUIT4B.
Automatic License Plate Recognition for Electronic Payment system Chiu Wing Cheung d.
Another Example: Circle Detection
Creative Coding & the New Kinect
Southern Taiwan University Department of Electrical Engineering
Danfoss Visual Inspection System
To be supervised by Prof. KH Wong
Body Tracking and Gesture Recognition Aaron Pulver
Ying Zhu Georgia State University
Demo.
Computer Graphics.
A Novel 2D-to-3D Conversion System Using Edge Information
CS4670 / 5670: Computer Vision Kavita Bala Lec 27: Stereo.
MSC projects for for CMSC5720(term1), CMSC5721(term2)
RGBD Camera Integration into CamC Computer Integrated Surgery II Spring, 2015 Han Xiao, under the auspices of Professor Nassir Navab, Bernhard Fuerst and.
Modeling 101 For the moment assume that all geometry consists of points, lines and faces Line: A segment between two endpoints Face: A planar area bounded.
Development of VR Glasses
3D Graphics Rendering PPT By Ricardo Veguilla.
Developing Artificial Intelligence in Robotics
Detecting Room Occupancy with Pi Camera
Vehicle Segmentation and Tracking in the Presence of Occlusions
How do we perceive?.
Kinect for Creative Development with open source frameworks
Multiple View Geometry for Robotics
Depth Perception.
Presentation transcript:

ETHAN BROWN / KATE RAFTER DIGITAL DANCING ETHAN BROWN / KATE RAFTER

What I learned…

SEEING THE WORLD IN THREE DIMENSION Humans are good at understanding depth from a multitude of cues: DEPTH PARALLAX PERSPECTIVE RELATIVE SIZE FAMILIAR SIZE STEREOPSIS OCCLUSION CONVERGENCE MANY MORE…. Computers: not so much.

INFRARED DEPTH MEASUREMENT: A CLEVER CHEAT Infrared laser projects a pattern of infrared dots Depth inferred from multiple cues Kinect uses proprietary technology developed by PrimeSense

HARDWARE Microsoft Occipital KINECT 1 KINECT 2 STRUCTURE SENSOR

SKELETON TRACKING Complicated problem Uses techniques from artificial intelligence, machine learning, and computer vision Requires massive amounts of training data

SOFTWARE TOOLKITS OpenFrameworks (C++) Cinder (C++) Kinect .NET SDK (C#) Point Cloud Library (C++) OpenNI (C++) OpenCV (C++)

Edge.js makes Kinect SDK available THREE.js / Canvas 3D / CubicVR NODE / JAVASCRIPT Edge.js makes Kinect SDK available THREE.js / Canvas 3D / CubicVR Distinct lack of libraries (OpenCV, PCL)

DISPLAYING POINT DATA OpenFrameworks / OpenGL Kinect provides world coordinates; store as vectors (ofVec3f) Convert point cloud vectors to mesh (ofMesh) Some effects “accidental” artifacts of mesh rendering

Plane detection with RANSAC algorithm, courtesy PCL FLOOR REMOVAL Plane detection with RANSAC algorithm, courtesy PCL Hooray math! Point/plane distance Expensive filtering: optimization pays

“EXPLODING” SHADOWS Easy centroid calculation: Subtract centroid from each point and normalize: unit vector away from centroid Scale unit movement vector and add to point to move away from centroid

KATE RAFTER ON TECHNOLOGY AND PERFORMANCE

LEARNING MORE Trigonometry (Kahn Academy) Linear Algebra (Kahn Academy) The C++ Programming Language, 4th Edition Making Things See by Greg Borenstein Books on OpenFrameworks and Cinder from Pact Publishing

ONWARD…. Projector/real-world correspondence Identify real-world features (with depth and/or visual data)

THANK YOU www.popart.com zepln.com/wdne ethan.brown@popart.com @EthanRBrown k.e.rafter@gmail.com www.katerafter.com www.popart.com zepln.com/wdne