Microsoft Kinect Collision Detection

Slides:



Advertisements
Similar presentations
K - News By: Elie Ain Malak Nour Assi Vasken Sarkis Georges Wakim.
Advertisements

Ryan C. Bergsmith Ross Kelly Kevin Warne Sponsor: Steve Peralta Motion Music Controller.
Wrist Recognition and the Center of the Palm Estimation Based on Depth Camera Zhengwei Yao ; Zhigeng Pan ; Shuchang Xu Virtual Reality and Visualization.
MPEG-4 Objective Standardize algorithms for audiovisual coding in multimedia applications allowing for Interactivity High compression Scalability of audio.
Enabling Fine-Grained Permissions for Augmented Reality Applications With Recognizers Suman Jana 1*, David Molnar 2, Alexander Moshchuk 2, Alan Dunn 1*,
Move With Me S.W Graduation Project An Najah National University Engineering Faculty Computer Engineering Department Supervisor : Dr. Raed Al-Qadi Ghada.
CSE 872 Dr. Charles B. Owen Advanced Computer Graphics1 Basic 3D collision detection We want to know if objects have touched Objects are considered to.
Real Time Visual Body Feedback & IR Tracking in HMD Based Virtual Environments Using Microsoft Kinects Speaker: Srivishnu ( Kaushik ) Satyavolu Advisor:
CS223B Assignment 1 Recap. Lots of Solutions! 37 Groups Many different approaches Let’s take a peek at all 37 results on one image from the test set.
Shape Modeling International 2007 – University of Utah, School of Computing Robust Smooth Feature Extraction from Point Clouds Joel Daniels ¹ Linh Ha ¹.
1cs533d-term Notes  list Even if you’re just auditing!
Bounding Volume Hierarchies and Spatial Partitioning Kenneth E. Hoff III COMP-236 lecture Spring 2000.
Software program’s we will use. Dreamweaver. Fireworks. Flash. Photoshop. Illustrator. In Design. Premiere.
CMPUT 617 (Topics in Computing Science): Advanced Image Analysis Nilanjan Ray Fall 2012 Computing Science University of Alberta.
Transformation of an Uncertain Video Search Pipeline to a Sketch-Based Visual Analytics Loop Philip A. Legg 1,2, David H.S. Chung 2, Matthew L. Parry 2,
Visualization Research Center University of Stuttgart On the Finite-Time Scope for Computing Lagrangian Coherent Structures from Lyapunov Exponents TopoInVis.
Kinect Part II Anna Loparev.
Professor : Yih-Ran Sheu Student’s name : Nguyen Van Binh Student ID: MA02B203 Kinect camera 1 Southern Taiwan University Department of Electrical Engineering.
Automated SW testing Lukáš Miňo
Multi-Sensor Image Fusion (MSIF) Team Members: Phu Kieu, Keenan Knaur Faculty Advisor: Dr. Eun-Young (Elaine) Kang Northrop Grumman Liaison: Richard Gilmore.
Effectiveness of different designs of input and out put.
Cameron Elliott Garabed Tashian Jeff Crispo.  In North America, legal blindness is defined as a visual acuity of 20/200  39 million are blind worldwide.
A Method for Hand Gesture Recognition Jaya Shukla Department of Computer Science Shiv Nadar University Gautam Budh Nagar, India Ashutosh Dwivedi.
Reconstructing 3D mesh from video image sequences supervisor : Mgr. Martin Samuelčik by Martin Bujňák specifications Master thesis
 Supervised by Prof. LYU Rung Tsong Michael Student: Chan Wai Yeung ( ) Lai Tai Shing ( )
From Lucent, Inc. This is the Sablime® home page. It has access to all the functionality of the Sablime® Configuration Management System.
Butler Bot Sai Srivatsava Vemu Graduate Student Mechanical and Aerospace Engineering.
卓越發展延續計畫分項三 User-Centric Interactive Media ~ 主 持 人 : 傅立成 共同主持人 : 李琳山,歐陽明,洪一平, 陳祝嵩 水美溫泉會館研討會
Some Libraries for Kinect 1 2. Open NI Open NI supports many API functions, can combine middleware to increase ability for Kinect. * Support: - Detect.
Professor : Tsung Fu Chien Student’s name : Nguyen Trong Tuyen Student ID: MA02B208 An application Kinect camera controls Vehicles by Gesture 1 Southern.
Automatic Storytelling in Comics
Kinect Hank Wei. Top - News 1.5 billion USD.
SciFest Overview Neil Gannon. Outline Demonstrations using a Microsoft Kinect sensor – Image Manipulation Real-time Invisibility Background removal (green.
Andreas Geiger and Philip Lenz Karlsruhe Institute of Technology Raquel Urtasun Toyota Technological Institute at Chicago.
CONTENT 1. Introduction to Kinect 2. Some Libraries for Kinect 3. Implement 4. Conclusion & Future works 1.
Where does the components of an SharePoint application resides? Can you see yours?
Users and the Interface When designing an information system you need to have a clear idea of who the target audience is. If the target audience is an.
Augmented Reality and 3D modelling Done by Stafford Joemat Supervised by Mr James Connan.
Polygon Definition Bounded by a closed circuit of straight-line segment. Term Edge : straight line segment Vertices : points.
Computer Vision Computer Vision based Hole Filling Chad Hantak COMP December 9, 2003.
VR software and platform Dr. Nan WANG Dr. Ronan BOULIC EPFL Immersive Interaction Group.
On Wikipedia you can find the following definition of NUI: “In computing, a natural user interface, or NUI, or Natural Interface is the common parlance.
Speech emotion detection General architecture of a speech emotion detection system: What features?
Rob Relyea | Program Manager, Kinect Team Johan Marien | Program Manager, Kinect Team.
Visibility-Driven View Cell Construction Oliver Mattausch, Jiří Bittner, Michael Wimmer Institute of Computer Graphics and Algorithms Vienna University.
Southern Taiwan University Department of Electrical Engineering
Hand Gestures Based Applications
Danfoss Visual Inspection System
Accessibility in Digital Documentation
VIRTUAL INTELLIGENCE PROJECT NATAL (Kinect & Xbox 360)
Bounding Volume Hierarchies and Spatial Partitioning
ABS Parameter Optimizer
Bounding Volume Hierarchies and Spatial Partitioning
הפקולטה להנדסת חשמל - המעבדה לבקרה ורובוטיקה גילוי תנועה ועקיבה אחר מספר מטרות מתמרנות הטכניון - מכון טכנולוגי לישראל TECHNION.
Fully automated trimap generation for matting with Kinect
C-obstacle Query Computation for Motion Planning
دانشگاه شهیدرجایی تهران
تعهدات مشتری در کنوانسیون بیع بین المللی
Progress Review.
Transferring Rich Feature Hierarchies for Robust Visual Tracking
Points, Lines, and Planes QUICK DRAW FOR POINTS!
Rounded Off Values Upper and Lower Bounds.
Make Your Body the Controller
//Build 다시보기 나 발머 김영욱 부장 Microsoft Korea
Rounding and estimating: Upper and Lower Bounds
REU: Week 7 TRECVID Sean McMillan.
Multi-UAV Detection and Tracking
Problem Image and Volume Segmentation:
INDOOR DENSE DEPTH MAP AT DRONE HOVERING
Point Set Representation for Object Detection and Beyond
Presentation transcript:

Microsoft Kinect Collision Detection Daniel Fischl 0825242 Manuel Hochmayr 0627715

Idea Collision detection of person in a room Applications: People with visual impairment Dark environments 30.11.2018 Fischl/ Hochmayr

Technologies Microsoft Kinect (for XBOX360) Visual Studio 2010 C++ Point Cloud Library 1.7 OpenNI VTK Qt 4.8.4 Eigen library boost 30.11.2018 Fischl/ Hochmayr

Planned approach 3D model Person tracking Alignments of current view with 3D model Object labeling Kinfu Person tracking Collision detection with objects Bounding boxes 30/11/2018 Fischl/ Hochmayr

Actual approach Room segmentation Person tracking Segmenting single point cloud Euclidian cluster extraction Convex hull Labeling Person tracking Live data from Kinect Collision detection with objects Bounding boxes Navigation 11/30/2018 Fischl/ Hochmayr

User Interface 11/30/2018 Fischl/ Hochmayr

Euclidian cluster extraction Octree data structure Nearest neighbour Similiar to flood-fill algroithm Planar objects Convex hull filtering Cluster size Tolerance 30/11/2018 Fischl/ Hochmayr

Labeling Select collidable objects Name objects 30/11/2018 Fischl/ Hochmayr

People tracking OpenNI Upper and lower body Bounding box Navigation Scalable size Intersection Navigation Sounds 30/11/2018 Fischl/ Hochmayr

Navigation 30/11/2018 Fischl/ Hochmayr

Video 30.11.2018 Fischl/ Hochmayr

Results Room segmentation > 5min Detecting person Good results (depending on Kinect) Only one viewpoint -> restriction Detecting person Takes a little bit too long (system dependent) Intersection and navigation Works in dark environments 30/11/2018 Fischl/ Hochmayr

Issues PCL 1.7 compilation Kinfu Stability problems Segmentation Colour based region growing Min – Cut based segmentation Change viewer Manual configuration 30/11/2018 Fischl/ Hochmayr

Improvements Voice output/ control Link different sounds to different objects More robust segmentation Multi -User tracking 30/11/2018 Fischl/ Hochmayr

Thank you for your attention! Questions?