Finding Factors Using exploratory factor analysis to test a performance measure Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010
Outline Background Method Results Next steps
Background BC Accountability Framework All public post-secondary institutions Annual process 14 performance measures Webpage:
Background Skill development performance measure Average of 7 survey questions Bachelor, Diploma & Certificate students Why these questions? Similar for all credential types?
Method Exploratory factor analysis Data reduction technique Underlying factors (latent variables) explain the relationship between variables
Results Using survey results for diploma, associate degree and certificate students There is a factor structure Skill development is one of the factors Includes questions from performance measure Explanatory power 46%
Results Performance measure
Results Using survey results for Apprenticeship students There is a factor structure Skill development is one of the factors Similar to diploma and certificate students Some differences Explanatory power 47%
Results Performance measure
Results Using survey results for baccalaureate students Fewer questions available Somewhat different question wording and response sets
Results Using survey results for baccalaureate students There is a factor structure Skill development is one of the factors Similar to other student groups Some differences Explanatory power 36%
Results Performance measure
Comparison All groups had a skills factor The same questions grouped with the skills factor Variation in explanatory power Variation in non-skills factors
Conclusion Robust skill development factor Different student groups Different questions and response scales Objective rationale for performance measure
Next steps Accountability Framework committee is considering the results Any questions?
Finding Factors Using exploratory factor analysis to test a performance measure Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010