Capturing the 3D motion of ski jumpers Trip to Bonn (13-16 Nov 2005) Atle Nes Faculty of Informatics and e-Learning Trondheim University College.

Slides:

Advertisements

Similar presentations

Final Exam Review 1 1.

Advertisements

Dynamic monitoring of traffic signs on roadways. INTRODUCTION TRAFFIC SIGNS ALONG ROADWAYS Approximately half of traffic accidents in developed countries.

Kiyoshi Irie, Tomoaki Yoshida, and Masahiro Tomono 2011 IEEE International Conference on Robotics and Automation Shanghai International Conference Center.

3D M otion D etermination U sing µ IMU A nd V isual T racking 14 May 2010 Centre for Micro and Nano Systems The Chinese University of Hong Kong Supervised.

EVENTS: INRIA Work Review Nov 18 th, Madrid.

GIS and Image Processing for Environmental Analysis with Outdoor Mobile Robots School of Electrical & Electronic Engineering Queen’s University Belfast.

Fisheye Camera Calibration Arunkumar Byravan & Shai Revzen University of Pennsylvania.

Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.

Computer Vision : CISC 4/689

Three-dimensional Motion Capture, Modelling and Analysis of Ski Jumpers Atle Nes CSGSC 2005 Trondheim, April 28th.

Vision Computing An Introduction. Visual Perception Sight is our most impressive sense. It gives us, without conscious effort, detailed information about.

3D Measurements by PIV  PIV is 2D measurement 2 velocity components: out-of-plane velocity is lost; 2D plane: unable to get velocity in a 3D volume. 

Outdoor Motion Capturing of Ski Jumpers using Multiple Video Cameras Atle Nes Faculty of Informatics and e-Learning Trondheim University.

Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.

IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 11, NOVEMBER 2011 Qian Zhang, King Ngi Ngan Department of Electronic Engineering, the Chinese university.

Convergence of vision and graphics Jitendra Malik University of California at Berkeley Jitendra Malik University of California at Berkeley.

Motion Capture of Ski Jumpers in 3D Trondheim University College Faculty of informatics and e-learning PhD student, Atle Nes Bonn, 24-28th of October 2004.

Capturing the Motion of Ski Jumpers using Multiple Stationary Cameras Atle Nes Faculty of Informatics and e-Learning Trondheim University.

Camera Parameters and Calibration. Camera parameters From last time….

Real-Time Face Detection and Tracking Using Multiple Cameras RIT Computer Engineering Senior Design Project John RuppertJustin HnatowJared Holsopple This.

1 Incremental Detection of Text on Road Signs from Video Wen Wu Joint work with Xilin Chen and Jie Yang.

9. GIS Data Collection.

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

I mage and M edia U nderstanding L aboratory for Performance Evaluation of Vision-based Real-time Motion Capture Naoto Date, Hiromasa Yoshimoto, Daisaku.

Motion Capture CSE 3541 Matt Boggus.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

Jason Li Jeremy Fowers Ground Target Following for Unmanned Aerial Vehicles.

Automatic Camera Calibration

Computer vision: models, learning and inference

2D TO 3D MODELLING KCCOE PROJECT PRESENTATION Student: Ashish Nikam Ashish Singh Samir Gaykar Sanoj Singh Guidence: Prof. Ashwini Jaywant Submitted by.

A Brief Overview of Computer Vision Jinxiang Chai.

Motion Capture Hardware

Localisation & Navigation

Facial animation retargeting framework using radial basis functions Tamás Umenhoffer, Balázs Tóth Introduction Realistic facial animation16 is a challenging.

Active Vision Key points: Acting to obtain information Eye movements Depth from motion parallax Extracting motion information from a spatio-temporal pattern.

3D SLAM for Omni-directional Camera

Exploitation of 3D Video Technologies Takashi Matsuyama Graduate School of Informatics, Kyoto University 12 th International Conference on Informatics.

SS5305 – Motion Capture Initialization 1. Objectives Camera Setup Data Capture using a Single Camera Data Capture using two Cameras Calibration Calibration.

Optical3D ´05, Gerhard Schall Gerhard Schall, Joseph Newman, Fritz Fraundorfer and Dieter Schmalstieg Construction and Maintenance of Augmented Reality.

National Research Council Canada Conseil national de recherches Canada National Research Council Canada Conseil national de recherches Canada Institute.

Metrology 1.Perspective distortion. 2.Depth is lost.

Conceptual and Experimental Vision Introduction R.Bajcsy, S.Sastry and A.Yang Fall 2006.

© 2005 Martin Bujňák, Martin Bujňák Supervisor : RNDr.

Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.

Scene Reconstruction Seminar presented by Anton Jigalin Advanced Topics in Computer Vision ( )

A Prototype System for 3D Dynamic Face Data Collection by Synchronized Cameras Yuxiao Hu Hao Tang.

Visual Odometry David Nister, CVPR 2004

High Resolution Surface Reconstruction from Overlapping Multiple-Views

CS 376b Introduction to Computer Vision 03 / 31 / 2008 Instructor: Michael Eckmann.

Mapping Technology and Topographic Maps Chapter 1, Lesson 3 and 4.

Observing Lip and Vertical Larynx Movements During Smiled Speech (and Laughter) - work in progress - Sascha Fagel 1, Jürgen Trouvain 2, Eva Lasarcyk 2.

Senior Project Poster Day 2006, CIS Dept. University of Pennsylvania One if by land… Yosef Weiner, David Charles Pollack Faculty Advisor: C.J. Taylor,

Lecture 22: Structure from motion CS6670: Computer Vision Noah Snavely.

SS5305 – Popular Marker Setups 1. Objectives Marker Data Measurement Sequence Project Automation Framework (PAF) Popular marker setups PAF Interface 2.

April / 2010 UFOCapture 1 UFOCaptureV2 Time-Shift-Motion-Detect-Video-Recording software for complete records of un-expected events.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

Beard & McLain, “Small Unmanned Aircraft,” Princeton University Press, 2012, Chapter 13: Slide 1 Chapter 13 Vision Based Guidance.

Nov Visualization with 3D CG

Motion Capture CSE 3541 Matt Boggus.

Processing visual information for Computer Vision

Avneesh Sud Vaibhav Vaish under the guidance of Dr. Subhashis Banerjee

Signal and Image Processing Lab

3D Single Image Scene Reconstruction For Video Surveillance Systems

Multiple View Geometry

A Forest of Sensors: Using adaptive tracking to classify and monitor activities in a site Eric Grimson AI Lab, Massachusetts Institute of Technology

Real-time Image Processing System

Multiple View Geometry for Robotics

Panoramic Image Reconstruction: Problem

Wrap-up Computer Vision Spring 2019, Lecture 26

SenseCam By Mike Dixon Nov 10.

Presentation transcript:

Capturing the 3D motion of ski jumpers Trip to Bonn (13-16 Nov 2005) Atle Nes Faculty of Informatics and e-Learning Trondheim University College

Project description -Goal: Design a multiple video camera system that can be used to capture and study the motion of ski jumpers in 3D. -Task: Want to give feedback to the ski jumpers that can help them to improve their jumping skills.

How? Multiple video cameras placed in a ski jumping hill are used to capture image sequences of a ski jump from different angles synchronously.

Image Acquisition (capture video of ski jumper) Video Images Image Processing (detect, identify & track points) 2D Image Coordinates Photogrammetry (2d  3d mapping) 3D Object Coordinates Motion analysis (select & interpret motion data) Vizualization (relate 3d points to ski jump model)

Camera equipment 3x AVT Marlin cameras: IEEE-1394 FireWire DCAM Resolution 640x480 x 30 fps x 8 bit grayscale 3x 9 MB/s = 27 MB/s Changeable lenses

Camera equipment (cont.) Operating long distances: 3x 400 m optical fibre extension for firewire (signals and data) 3x 25 m power cables 600 m synchronization cable PC: 2.4 GHz Intel P4, 4x Firewire buses, 2GB RAM (buffered), 2x WD Raptor rpm in RAID-0 (harddisk)

Camera setup Video data + Control signals Synch pulse

Video processing Points are automatically detected, identified and tracked over time and accross different views.Points are automatically detected, identified and tracked over time and accross different views. Reflective markers are placed on the ski jumpers suit, helmet and skies.

Photogrammetry Matching corresponding feature points from two or more cameras allows us to calculate the exact position of that feature point in 3D.Matching corresponding feature points from two or more cameras allows us to calculate the exact position of that feature point in 3D. Assumes that one knows the position and viewing direction of each camera.Assumes that one knows the position and viewing direction of each camera.

Camera calibration Measure exact coordinates in the hill using differential GPS and land survey robot station. Place visible markers at those spots and estimate a geometry (relationship between 2D and 3D). Reconstruction is then trivial.

Visualization Feature points are connected back onto a 3D model of the ski jumper. Allowed to be moved and controlled in a large static model of the ski jump arena.

Granåsen ski jump arena

Conclusion A lot of challenging topics Remains to be seen how well the ski jumpers will perform based on this kind of feedback.

Are you ready to jump?