1. Finding Factors Using exploratory factor analysis to test a performance measure Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010

2. Outline Background Method Results Next steps

3. Background BC Accountability Framework All public post-secondary institutions Annual process 14 performance measures Webpage: http://www.aved.gov.bc.ca/framework/welcome.htm#std http://www.aved.gov.bc.ca/framework/welcome.htm#std

4. Background Skill development performance measure Average of 7 survey questions Bachelor, Diploma & Certificate students Why these questions? Similar for all credential types?

5. Method Exploratory factor analysis Data reduction technique Underlying factors (latent variables) explain the relationship between variables

6. Results Using survey results for diploma, associate degree and certificate students There is a factor structure Skill development is one of the factors Includes questions from performance measure Explanatory power 46%

7. Results Performance measure

8. Results Using survey results for Apprenticeship students There is a factor structure Skill development is one of the factors Similar to diploma and certificate students Some differences Explanatory power 47%

9. Results Performance measure

10. Results Using survey results for baccalaureate students Fewer questions available Somewhat different question wording and response sets

11. Results Using survey results for baccalaureate students There is a factor structure Skill development is one of the factors Similar to other student groups Some differences Explanatory power 36%

12. Results Performance measure

13. Comparison All groups had a skills factor The same questions grouped with the skills factor Variation in explanatory power Variation in non-skills factors

14. Conclusion Robust skill development factor Different student groups Different questions and response scales Objective rationale for performance measure

15. Next steps Accountability Framework committee is considering the results Any questions?

16. Finding Factors Using exploratory factor analysis to test a performance measure Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010