Is anyone free to coach an outing tomorrow at 0530am?! Jesus College Graduate Conference Research Talk 2 nd May 2008 Simon Fothergill Third year PhD student,

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

Change-Point Detection Techniques for Piecewise Locally Stationary Time Series Michael Last National Institute of Statistical Sciences Talk for Midyear.
Face Recognition Sumitha Balasuriya.
Giving off the Right Signals! Third Year Ph.D. Student Research Talk 28/04/2008 Simon Fothergill Jesus W1, Head of the River May Bumps.
Neural networks Introduction Fitting neural networks
Isoparametric Elements Element Stiffness Matrices
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Artificial Intelligence 13. Multi-Layer ANNs Course V231 Department of Computing Imperial College © Simon Colton.
Imbalanced data David Kauchak CS 451 – Fall 2013.
Pattern Recognition and Machine Learning: Kernel Methods.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Machine Learning Lecture 8 Data Processing and Representation
Proactive Learning: Cost- Sensitive Active Learning with Multiple Imperfect Oracles Pinar Donmez and Jaime Carbonell Pinar Donmez and Jaime Carbonell Language.
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.
Modeling the Model Athlete Automatic Coaching of Rowing Technique Simon Fothergill, Fourth Year Ph.D. student, Digital Technology Group, Computer Laboratory,
HCI 530 : Seminar (HCI) Damian Schofield. HCI 530: Seminar (HCI) Transforms –Two Dimensional –Three Dimensional The Graphics Pipeline.
Prénom Nom Document Analysis: Linear Discrimination Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
A Study of Approaches for Object Recognition
“Am I doing it better?” Conveying the message to athletes Simon Fothergill, Ph.D. student Digital Technology Group, Computer Laboratory, University of.
MSU CSE 240 Fall 2003 Stockman CV: 3D to 2D mathematics Perspective transformation; camera calibration; stereo computation; and more.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Feature Detection and Emotion Recognition Chris Matthews Advisor: Prof. Cotter.
“Examining the effect of real-time visual feedback on the quality of rowing technique” Simon Fothergill Ph.D. student, Computer Laboratory, University.
Independent Component Analysis (ICA) and Factor Analysis (FA)
Rowing Motion Capture System Simon Fothergill Ph.D. student, Digital Technology Group, Computer Laboratory Jesus College graduate conference May 2009.
Facial Recognition CSE 391 Kris Lord.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
Unit 3a Industrial Control Systems
DOG I : an Annotation System for Images of Dog Breeds Antonis Dimas Pyrros Koletsis Euripides Petrakis Intelligent Systems Laboratory Technical University.
Information theory, fitness and sampling semantics colin johnson / university of kent john woodward / university of stirling.
Face Detection using the Viola-Jones Method
CS 376b Introduction to Computer Vision 04 / 29 / 2008 Instructor: Michael Eckmann.
TRAINING AFFECTS KNEE KINEMATICS AND KINETICS IN CUTTING MANEUVERS IN SPORT CASEY GRAHAM TIFFANY MEIER MICHELE BENANTI.
CS 8751 ML & KDDSupport Vector Machines1 Support Vector Machines (SVMs) Learning mechanism based on linear programming Chooses a separating plane based.
Shape Matching for Model Alignment 3D Scan Matching and Registration, Part I ICCV 2005 Short Course Michael Kazhdan Johns Hopkins University.
Outline 1-D regression Least-squares Regression Non-iterative Least-squares Regression Basis Functions Overfitting Validation 2.
Art 315 Lecture 6 Dr. J. Parker. Variables Variables are one of a few key concepts in programming that must be understood. Many engineering/cs students.
Association between 2 variables
#MOTION ESTIMATION AND OCCLUSION DETECTION #BLURRED VIDEO WITH LAYERS
Object Detection with Discriminatively Trained Part Based Models
ECE 8443 – Pattern Recognition LECTURE 10: HETEROSCEDASTIC LINEAR DISCRIMINANT ANALYSIS AND INDEPENDENT COMPONENT ANALYSIS Objectives: Generalization of.
Maths & Technologies for Games Animation: Practicalities CO3303 Week 3.
School of Engineering and Computer Science Victoria University of Wellington Copyright: Peter Andreae, VUW Image Recognition COMP # 18.
C. Lawrence Zitnick Microsoft Research, Redmond Devi Parikh Virginia Tech Bringing Semantics Into Focus Using Visual.
Data Analysis: Quantitative Statements about Instrument and Method Performance.
1Ellen L. Walker Category Recognition Associating information extracted from images with categories (classes) of objects Requires prior knowledge about.
A NOVEL METHOD FOR COLOR FACE RECOGNITION USING KNN CLASSIFIER
Computer and Robot Vision II Chapter 20 Accuracy Presented by: 傅楸善 & 王林農 指導教授 : 傅楸善 博士.
Limits On Wireless Communication In Fading Environment Using Multiple Antennas Presented By Fabian Rozario ECE Department Paper By G.J. Foschini and M.J.
Learning to Detect Faces A Large-Scale Application of Machine Learning (This material is not in the text: for further information see the paper by P.
Improved Video Categorization from Text Metadata and User Comments ACM SIGIR 2011:Research and development in Information Retrieval - Katja Filippova -
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 12: Advanced Discriminant Analysis Objectives:
CSC321 Lecture 5 Applying backpropagation to shape recognition Geoffrey Hinton.
Machine Learning Lecture 1: Intro + Decision Trees Moshe Koppel Slides adapted from Tom Mitchell and from Dan Roth.
Stats 242.3(02) Statistical Theory and Methodology.
Descriptive Statistics The means for all but the C 3 features exhibit a significant difference between both classes. On the other hand, the variances for.
Data Transformation: Normalization
Statistical Process Control
LECTURE 11: Advanced Discriminant Analysis
The Science of Biomechanics
Supervised Time Series Pattern Discovery through Local Importance
Proposal: Preliminary Results and Discussion
“Bayesian Identity Clustering”
Introduction Artificial Intelligent.
ECE539 final project Instructor: Yu Hen Hu Fall 2005
Fourier Transform of Boundaries
Feature descriptors and matching
What is it? Why do we study it?
Presentation transcript:

Is anyone free to coach an outing tomorrow at 0530am?! Jesus College Graduate Conference Research Talk 2 nd May 2008 Simon Fothergill Third year PhD student, Computer Laboratory Jesus W1, Head of the River May Bumps 2007

Outline Using machines as surrogate coaches of rowing technique No one is free! Recognition of an individual fault of a novice rower Supervised machine learning Summary and Future Directions Questions

Are you asleep yet?

Using machines as surrogate coaches of rowing technique Reference: Computer Laboratory, University of Cambridge, SeSaMe Project (EPSRC) Judgement of Quality from Body Movement Description of what is right and wrong Individual aspects of technique (e.g. separation) Overall technique Good, Ok, Poor, Bad Amateur rower wearing motion capture markers

What about now?

No one is free! –Coaching improves performance and helps avoid injury –Automation can provide substitute coaches when real ones are unavailable –Even coaches are fallible –Not a replacement

Half way there!

Recognition of an individual fault of a novice rower

The system scores the strokes well enough!

Well, this is Cambridge…!

Supervised machine learning

Jurgen Grobler, OBE Olympic rowing coach Scores training set of performances Scores test set of performances Extract handle trajectory Extract features Mathematical model Good / Bad

The end, almost…

Summary and Future Direction Capture the movements of the body Model judgements of quality of individual aspects of technique used to perform a physical task Increased potential of rowing coaching Larger populations of strokes Better algorithms Descriptions as well as individual aspects

Thank you! Acknowledgements –The Rainbow group, Computer Laboratory for the use of the VICON motion capture system –Ian Davies (Computer Laboratory) for willingly rowing! –Jesus College Graduate Community

Questions?

Automated coaching of technique Why? –Improve performance –Avoid injury –Can substitute a coach when not available Train in squads / boats of 8 rowers Coaches are busy people (2 weeks here are there) Expensive (amateur population is large) –Even coaches are fallible! Subjective Get blinded Get tired Only have one pair of eyes –Not a replacement! Imitating humans is hard A coach provides more than a assessment of technique We still use pencil and paper A coach is still needed to teach the machine

Automated coaching of technique What? 1.Provide a commentary on what the athlete is doing 2.Judge the quality of the performance Overall technique Individual Aspects of technique Description of what is right and wrong 3.Choice and Explanation of how to improve what –Needs to happen retrospectively and during the performance, until muscle memory established correct technique. –Correction and Assurance –Precision of quality 2 categories (“Its either right or wrong, now!”) Good or Bad 4 categories (It is a practical scale) Good, Ok, Poor, Bad

Ubiquitous computing Electronic / Electrical / Mechanical devices Miniature Low powered Wireless communications Processing power Sensors Wearable Reference: Computer Laboratory, University of Cambridge, SeSaMe Project (EPSRC)

Hello Signals! The World contains signals. What can you do with them? Measure real world phenomena Model the real world using the signals –Content-based Information Retrieval –Automatic itemised power consumption Human body movement can be sensed to give motion data Applications –Medical –Performing arts –Monitoring and rehabilitation –Body language –Sports technique Rowing –Cyclical –Highly technical –Small movements

Laziness! Modelling sports technique –Traditionally done using biomechanics Take loads of accurate measurements Formulate rules concerning kinematics of movement Work out how fast a boat should be moving –This is not how coaches do it (“That looks right!”) –Why? Variation –Human –Marker placement –Sensor noise Amount of biomechanical data Rules don’t exist or unknown (for some aspects / sensors) (“relaxed”) Rules are fuzzy (“too”, “sufficient”) Rules are different for everyone Rules require formulation –Supervised Machine learning Rough marker placement Automatic learning of the quality of a certain technique from labelled examples. Much easier, if it works!!

Bigger picture The “right” signals –Correct change in sensors’ environment (correct technique) –Suitable sensors whose signals are sufficient to allow a change (correct or otherwise) to be detected Part 1 How to get a model; (Algorithms, 3D motion trajectories, human body motion, phenomena from rowing technique ontology) Part 2 Using the model; An attempt to pose and answer questions about the properties or theory of the inference procedure. Relationship between fidelity of sensors and fidelity of phenomena at different levels of semantic sophistication Can properties be found to easily check whether some phenonema are possible to infer or not, given the dataset. Optimal sensor placement : Entropy map for the body Predication (What is the perfect rowing technique?)

Data set Natural & normal / Exaggerate faults Normal, {list of aspects} Level of fatigue Fresh, Tired (distance, rate) Rate (Min/Max/Mean) / natural The population over which the algorithms are effective must be as wide as possible. Population defined using these variables whose values will affect the final trajectories, but do not describe it. Domain Sport, Cyclical, Rowing, Indoor rowing EnvironmentAn office Equipment Concept II Model D Ergometer with PM3 MarkersErg frame, seat, handle Performer, Distribution of score The handle trajectory for a stroke need not alter in ways only to do with 1 aspect of the technique that happens to be of interest. It is not possible to test all combinations, so a representative population is used by taking each stroke as a random sample of that persons normal technique at that time.

Data processing Linear interpolation Transformation to erg co-ordinate system using PCA Segmentation using sliding window over minima/maxima Fixed Moves +X +Z +Y

Feature extraction Invariants –Speed –Not scale Rowing Ratio of drive time to recovery time Angles between x-axis and principle components of drive and recovery shapes Wobble (lateral variance across z-axis) Cyclical Movement Quality Smoothness (of shape and speed) Abstract Trajectory distance Trajectory length Trajectory height Five 1 st and 2 nd order moments of the shape in the x-y plane (weighted uniformly and with the instantaneous speed)

Learning algorithms Normalised feature vector Perceptron –Gradient descent Error function: Sum of the square of the differences Leave 1 out test Sensitivity analysis Feature 0 Feature N Weight 0 Weight N Linear combination Bias Bias weight Composite representation of motion