1. Thinking out of the box score Evaluation Methods Ben Silliman, Youth Development Specialist NC 4-H

2. What to look for Quantitative: By the numbers… The box score is what matters Qualitative: Behind the numbers… How and why things are working matters BigTime U recruited the best Freshman class and has been putting up big numbers this season… …but MidMajor U has some clever strategies and plays with a lot of heart

3. How to find it Quantitative Census or enrollment data Tests and Surveys; Performance Records Qualitative Observations, Focus Groups, Interviews Case Studies, Concept Maps Content Analysis, Portfolios Time Out: What are their options?

4. Quantitative Methods: Performance Records Weight Room Static and Dynamic Strength, Flexibility Heart rate, breathing, skin response OK, Hi. Trainer Bob here at MidMajor U and my guys are not outworked by anybody, see. Dr. Strong, who started this fitness program got all the stats on what it takes to run flat-out for 40 minutes. I only wish he had the same figures on passing college classes.

5. Quantitative Methods: Passing the Test Playbook: Offense & Defense (Ours and Theirs) Joe Assistant Coach here. When your weight training is done, take this Playbook and study it like your life depended on it…and it might considering what students throw from the stands!

6. Quantitative Methods: The Box Score Before the Game Team A Center 7’2” Senior Forward 22 PPG Forward 8 RPG Guard 34” vertical leap Guard 90% FT avg. Team B Season Record: 8-2 Hot Shot Hawkins here…our GIANTS on Team A have their conference tune-up against a fiesty Team B…

7. Quantitative Methods: The Box Score Before the Game Team A Center 7’2” Senior Forward 22 PPG Forward 8 RPG Guard 34” vertical leap Guard 90% FT avg. Team B Season Record: 8-2 After the Game Team A C: 6 P, 10 Reb, 5 PF, 24 m F: 23 P, 7 R, 3 PF, 37 m F: 9 P, 2 R, 4 PF, 35 m G: 14 P, 3 R, 2 PF, 36 m G: 5 P, 1 R, 5 PF, 31 m P = Points; R = Rebounds; PF = Personal Fouls; m = Minutes Played Team B 63, Team A 57 What happened?

8. Quantitative Methods: The Box Score Before the Game Team A (RPI =.45) Center 7’2” Senior Forward 22 PPG Forward 8 RPG Guard 34” vertical leap Guard 90% FT avg. Team B (RPI =.59) Season Record: 8-2 After the Game Team A C: 6 P, 10 Reb, 5 PF, 24 m F: 23 P, 7 R, 3 PF, 37 m F: 9 P, 2 R, 4 PF, 35 m G: 14 P, 3 R, 2 PF, 36 m G: 5 P, 1 R, 5 PF, 31 m P = Points; R = Rebounds; PF = Personal Fouls; m = Minutes Played Team B 63, Team A 57 (Team A revenue: $30,000) OK, so I knew all along that Team A was not that good, even if they were BIG.

9. Evaluating on the Run What if we looked at how points were scored, (or not) not just how many points were scored?

10. Evaluating on the Run What if we looked not at how each player performed, but at how they played together? (How ‘bout them ‘Cats!)

11. Qualitative Methods: Observation Strategies Man-on-Man or Zone Matchups and Switch-offs (individual, team) Oh, Baby! You gotta recognize that Defense!

12. Qualitative Methods: Observation Strategies Moving without the ball Pick and Roll Those Senior guards see the opportunity, Baby!

13. Qualitative Methods: Focus the Strategy Focus groups: Assistant coaches Experienced players Spotters  Key improvement needed on offense  Key improvement for defense  Critical change in pace of the game The Coach is sayin’,“What are you thinking our there? Let’s get focused!

14. Later on that same season…

15. Qualitative Methods: Case Study How can we beat #1? Case Study OK, team, these girls may have won 70 games in a row, but here’s what the films of their past games tell us: When they play best…so here’s how we start… When they play worst…so here’s how we continue…

16. Qualitative Methods: Concept Mapping How do we manage the tournament? Concept Mapping OK, team, let’s look at the kinds of defenses we will face: What are the strengths of the 2-1-2 zone? What are the weaknesses of the man-on-man … where can we create a mismatch with this team?

17. Grounding Evaluation Validity: Does it measure what it claims? Reliability: How consistent are measures?

18. Diversifying Evaluation Triangulation: Multiple/Mixed Measures Longitudinal Tracking: Results over time Principles and Performance: Does anything count but the numbers?