1. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE TennisSense Multi-Sensor Data Capture of Tennis Players (or how can technology help produce world-class tennis athletes) Ciarán Ó Conaire Friday 13 th March 2009

2. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Overview Information Management System Visualisation and Feedback Extract Information Tennis Matches Data Mining and Pattern Analysis

3. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Information Layers CONTEXTUAL BIOMECHANICAL PHYSIOLOGICAL

4. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Physiological –Heart-rate, Respiration (Foster-Miller vest) Contextual –Video + Audio –Player Position (Ubisense) Sensors 25mm Biomechanical –Acceleration, Orientation (WIMUs) –Pressure (wearables)

5. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Motivation Feedback to athletes/coaches Real-time feedback during training Longer-term analysis: fitness levels, performance Data for Sports Scientists What factors lead to peak performance? Sports Action Recognition + Characterisation A Test-bed for interesting Science!

6. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Installation area All-weather courts, Albert College Park Tennis Ireland Governing Body for Tennis in Ireland 4 indoor courts 2 clay courts 2 outdoor courts Users Championship Players Club Players Public Members

7. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Installation area All-weather courts, Albert College Park

8. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Contextual Data Gathering Infrastructure ~3.5cm

9. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Video Data

10. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Ubisense Data Aligned Video + Ubisense

11. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Ubisense Data Distance covered2189.96m 1761.49m Average speed 1.23 m/s 0.96 m/s Max Speed 9.03 m/s 5.44 m/s Court-position Overlay Player 1 Area covered Heat-Map Player 2

12. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE 25mm Biomechanical Data: Tyndall Motes Wireless Inertial Measurement Units (WIMUs) Features: 3-axis Accelerometers 3-axis Gyroscopes 3-axis magnetometers ADC: analog-digital converter Microprocessor Serial Wireless Link

13. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Biomechanical Data Tyndall WIMU Wireless Inertial Measurement Unit “Hands up who thinks calibration is FUN!”

14. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Physiological Data Foster-Miller Vest

15. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Physiological Data

16. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE What can we currently do? Contextual Data Ball Tracking Player Tracking

17. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Content Based Search Tool

18. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Some Ongoing Work Developing Knowledge Framework Format to use for data consistency Performance Factors Ball Speed: Camera vs. Speed Gun Full Camera Calibration Accurate 3D ball tracking More Sensors Sweat pH measurement Pressure sensors

19. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Summary Data gathering infrastructure Real users Inter-disciplinary research team Sport Scientists, Engineers, Chemists,... Platform for exciting research and new technology Multi-source data-mining and data fusion New wearable sensors (pressure pads, sweat analysis)

20. UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Thank You oconaire@eeng.dcu.ie http://www.cdvp.dcu.ie/tennisireland/