1. Methodology Part 1 Research Design and Analysis
SSP4000 Research Process
Week 19 (SPA-specific)
Methodology Part 1 Research Design and Analysis

2. Learning Outcomes By the end of this session you will be able to
List the information needed to answer your research question
Identify the output variables involved
Identify the raw action variables needed
Devise a method to answer your research question

3. Weeks 19, 20 and 21 Week Content 19 Methodological approach
Information needs
Study design 20
Measurement issues in performance analysis research
Validity
Objectivity
Reliability 21
Interactive session on planning the research essay

4. Plenary task on methods 5%
Complete the proforma by 6pm on Tuesday 15th March 2016
Detail of
Study design
Sample
Data gathering procedures
Data analysis
Reliability and validity

5. Approaches
Qualitative
Quantitative

6. Information Needs Example – RED CARD STUDY
Scope
English FA Premier League
Matches with a single red card before 60 minutes
Matches where the team reduced to 10 men is drawing or winning by a single goal at the time of the dismissal
Question (Level at time of dismissal)
Does work-rate differ between outnumbered teams who avoid losing and those who lose?
What about the opposition?
Question (Leading by a goal at time of dismissal)
Does work-rate differ between outnumbered teams who hold on to their lead and those who don’t?

7. Questions What do we mean by work-rate? How is it measured?
Are there several variables?
Where will data come from to allow us to make the comparisons we need to

8. Thinking ahead – results format

9. Results format
If we have a well understood research question, it acts as a logical framework for data gathering and analysis
The research question dictates the format of the answer

10. Work-rate variables
Percentage of time spent performing high speed running (> 5.5 m.s-1)
Number of high speed runs per minute
We are mainly interested in period when the team was outnumbered
Would be interesting to compare with period prior to the dismissal
There is more than one way of doing this

11. Quantitative Data Analysis
Data Processing
For our example, the Prozone 3 system captures player movement data
These are quality assured by Prozone staff visually verifying frames
Data for individual matches then need to be brought together to determine results for “the average match” – quantitative analysis
PROZONE
Quantitative Data Analysis

12. Data Sources X, Y locations
pitch dimensions 0,0 is centre circle
Distance covered, velocity and acceleration derivatives
Time of red card in each match
We need an understanding of what Prozone3 provides and what we need to produce through data processing

13. Data gathering and analysis activities
Consider
Manual notation methods
Human operated (tagging) computerised systems
Fully automated systems
Which of these involve the most / least data gathering effort?
Which of these involve the most / least data analysis effort?
Let the students consider these questions in groups – ask them what they think then go to next slide to discuss the answers

14. Data Gathering and Analysis
Data analysis
Manual OR Human operated computer system
Something still needs to be observed and recorded by human operator
Fully automated
Very efficient
Cost £$
Remember – manual verification in Prozone means it is NOT fully automated
Manual
May need to process chronological event lists to obtain totals / percentages
Automated or human operated computer system
Once data are stored in databases / spreadsheets, rapid processing, sorting and analysis is possible

15. Measurement Issues Consider Compare these in terms of
Manual notation methods
Human operated (tagging) computerised systems
Fully automated systems
Compare these in terms of
Validity
Objectivity
Reliability
Again – let the students discuss and then go to next slide for the answer

16. Measurement Issues Manual Notation Computerised (Human operated)
Fully Automated
Validity
Depends on variables !
Depends on variables
Objectivity
Subjective judgement at point of data recording
Subjective judgement at point of data entry
Totally
Reliability
Depends on operator consistency
Depends on operator consistency – could be complicated or simplified by the use of computer
Very reliable - but it could be the same wrong answer recorded by 2 copies of the system !
For Validity – use prozone v human observer recognising work / rest as an example – or use the computerised scoring system in boxing.

17. Feasibility Questions for observational studies
Do you have permission to use footage or record your own footage?
Are such permissions realistic to obtain?
Will footage show what you need to observe?
Can the behaviours you are interested in really be distinguished?
Are there enough matches satisfying criteria for inclusion
Let the students consider these questions in groups – ask them what they think
Consider the last point – how many matches does a player play at Wimbledon per year?
How many matches are both teams in a soccer match level ahead and behind for at least 15 mins each?

18. Questions for experimental studies
Will the participants of the level you are interested be willing to participate?
Will they really interfere with their training programmes, to participate in a research study?
Do they need to travel to lab / testing sites?
How long will testing take – will facilities be available?
Let the students consider these questions in groups – ask them what they think

19. Key thought
Would you participate in a study like the one you have proposed?
If so, why? What are the benefits?
If not, why not?
Think about what the organisational and logistic issues of the study are
Honestly consider if it would really happen

20. Something you can think about
Try this general approach for your own research topic
What are the variables of interest?
How will they be presented?
What data will be collected and how?
Is this feasible