1. 0

2. 1 1.Key Performance Indicator Results (2005-2008) KPI Survey Statistics Student Distribution by Year in Program KPI Overall Results Student Satisfaction Graduation Rate Graduate Satisfaction Graduate Employment Rate Employer Satisfaction KPI Student Satisfaction Survey Results KPI Graduate Satisfaction Survey Results KPI Employer Satisfaction Survey Results 2.Course Feedback Survey Results (2004-2007) 3.Program Applicant & New Registrant Statistics (2004-2007) 4.Technical Notes ContentsContents Note that when current period data is not available for any of the above data sources, the respective information slides may not be included in the presentation. Contents Sample Program

3. 2 Three sets of surveys: Employer, Graduate & Student. Same set of questions are asked for each survey at all colleges and for all programs (some variations may occur). Surveys are conducted at the same time every year. Evaluations are provided at three levels: overall college, program at the college level, and program at the provincial level (i.e. MTCU). Key Performance Indicator - Survey Overview Sample Program 13 77# of Employers included in KPI 32%35%38% % Represented 18 # of Completed Surveys 575247 # of Employers Employer 58625155# of Graduates included in KPI 64%74%71%75% Represented 69645662# of Completed Surveys 107877983# of Graduates Graduate 191188239178# of Students included in KPI 66%63%81%64% Represented 195199261190# of Completed Surveys 296314321295# of Enrolled* Student 2008200720062005 *# of enrolled comes from the Student Profile Data file as provided by the college

4. 3 Student Distribution by Year in Program Sample Program 100%195100%197100%253100%185Total 32%6237%7217%4322%41Year 3 32%6329%5751%12840%74Year 2 36%7035%6832%8238%70 Year 1 * %# Students% % % 2008 200720062005 *Note a student is determined to be in a specific year of a program based on their response to Question 2 'In which semester/term are you currently enrolled' on the survey.

5. 4 KPIs - Summary Report Sample Program

6. 5 Student Satisfaction by Year Sample Program 68%60%89%96%83%Overall Program 69%57%95% 83%Year 3 58%55%82%97%79%Year 2 75%66%90%97%84%Year 1 * CAPSTONE Question 45 CAPSTONE Question 44 CAPSTONE Question 26 CAPSTONE Question 14 KPIProgram Year CAPSTONE Q14 'OVERALL, your program is giving you knowledge and skills that will be useful in your future career.' CAPSTONE Q26 'The OVERALL quality of the learning experiences in this program.' CAPSTONE Q44 'The OVERALL quality of the facilities/resources in the college.' CAPSTONE Q45 'The OVERALL quality of the services in the college.' *Note a student is determined to be in a specific year of a program based on their response to Question 2 'In which semester/term are you currently enrolled' on the survey.

7. 6 Student Overall Satisfaction Sample Program 62%66%68%65%CAPSTONE Question Q45 52%59%58%66%CAPSTONE Question Q44 85%81%89%78%CAPSTONE Question Q26 93%90%94%85%CAPSTONE Question Q14 73% 74%83%78%KPI Top LargeMTCUProgramCollege CAPSTONE Q14 'OVERALL, your program is giving you knowledge and skills that will be useful in your future career.' CAPSTONE Q26 'The OVERALL quality of the learning experiences in this program.' CAPSTONE Q44 'The OVERALL quality of the facilities/resources in the college.' CAPSTONE Q45 'The OVERALL quality of the services in the college.' Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

8. 7 Learning Experiences (Q3-Q14) Sample Program Q3 Provides skills/abilities specific to career Q4 Includes topics relevant to future success Q5 Teachers help you understand chosen career Q6 Develops writing skills Q7 Develops speaking skills Q8 Develops ability to solve problems using math Q9 Develops ability to work with others Q10 Develops ability to solve problems Q11 Develops computer skills Q12 Opportunities to further education after graduation Q13 Provides experience useful to future outside work Q14 OVERALL, knowledge/skills useful in career

9. 8 Learning Experiences (Q3-Q14) Sample Program Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

10. 9 Learning Experiences - Composite Indicators Sample Program CAREER DEVELOPMENT Q3 Skills and abilities specific to career Q4 Topics relevant to future success Q9 Ability to work with others Q11 Develops computer skills Q12 Opportunities to further education after graduation Q14 OVERALL, knowledge & skills useful in future career PROBLEM SOLVING SKILLS Q8 Ability to solve problems using math Q10 Ability to solve problems COMMUNICATION SKILLS Q6 Develops writing skills Q7 Develops speaking skills

11. 10 Teachers & Courses (Q15-Q26) Sample Program Q15 Teachers’ knowledge of subjects Q16 Teachers’ up-to-date/current in fields Q17 Teachers’ presentation of material Q18 Helpfulness of teacher outside class Q19 Feedback about progress Q20 Quality of classroom learning Q21 Quality of lab/shop learning Q22 Quality of other learning experiences Q23 Field placement/clinical/co-op Q24 Course materials Q25 Lab/shop facilities/equipment Q26 OVERALL quality of learning experiences

12. 11 Teachers & Courses (Q15-Q26) Sample Program Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

13. 12 Facilities Sample Program Q27 Library/resource centre Q28 Open access computer labs/resources Q31 Space for individual/group study Q34 Bookstore Q35 Recreation/athletics Q43 Comfort/cleanliness/accessibility of college facilities Q44 OVERALL quality of facilities/resources

14. 13 Facilities Sample Program 53% 60% 70%59%---98% Q44 OVERALL quality of facilities/resources 50% 59%58%69%58%---99% Q43 Comfort/cleanliness/accessibility of college facilities 51% 61%59%62%53%36%62% Q35 Recreation/athletics 54% 56%62%67%65%100%98% Q34 Bookstore 32% 43%31%44%35%89%96% Q31 Space for individual/group study 44% 55%57%58%46%64% Q28 Open access computer labs/resources 44% 54%37%40%45%85%82% Q27 Library/resource centre Top Large Satisfaction 2008 MTCU Satisfaction 2008 Student Satisfaction 2006 Student Satisfaction 2007 Student Satisfaction 2008 Student Usage 2008 Student Importance 2008 Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

15. 14 Services Sample Program Q29 Peer tutoring services Q30 Special skills services Q32 Counseling/native counseling/advising services Q33 Special needs/disability services Q36 Registration/records services Q37 Health services Q38 Cafeteria/food services Q39 Safety and security services Q40 Financial aid services Q41 Co-op/field placement services Q42 Employment/placement/career services Q45 OVERALL quality of services

16. 15 Services Sample Program Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

17. 16 Graduate Satisfaction Sample Program 85%84%81%76% Q34 Satisfaction with usefulness of college education in achieving your goals after graduation ('very satisfied' + 'satisfied') 90%91%90%80% Q33 Overall satisfaction with the college preparation for the type of work you were doing ('very satisfied' + 'satisfied') 91% 90%84% Q21 Skills developed during college helped you get a job ('extremely helpful' + 'helpful') 85%84%85%68% Q20 Job relates to college program ('yes' + 'yes, partially') Top LargeMTCUProgramCollegeOverall Measures *Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories. 67% 81%79% F) Skills developed in co-op, clinical, field placement experience, and career placement services 74% 81%75% E) Preparation for the job market 80%82%90%86% D) Equipment was up-to-date 87% 95%85% C) Overall quality of instruction 93% 95%90% B) Courses were up-to-date 90% 92%87%Q22. A) Course content Top LargeMTCUProgramCollegeGraduate Satisfaction* with Program Aspects

18. 17 Graduate Satisfaction (Q31/32A-R) Sample Program A) Specific job-related knowledge B) Specific job-related skills C) Oral communication D) Written communications E) Comprehension F) Math skills G) Computer skills H) Critical thinking I) Problem solving J) Research & analysis K) Teamwork L) Organization & planning M) Time management N) Quality of work O) Productivity P) Creative & innovative Q) Adaptable R) Responsible

19. 18 Graduate Satisfaction (Q31/32A-R) Sample Program Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

20. 19 Employer Satisfaction (Q72/73A-R) Sample Program Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

21. 20 Employer Satisfaction (Q72/73A-R) Sample Program A) Specific job-related knowledge B) Specific job-related skills C) Oral communication D) Written communications E) Comprehension F) Math skills G) Computer skills H) Critical thinking I) Problem solving J) Research & analysis K) Teamwork L) Organization & planning M) Time management N) Quality of work O) Productivity P) Creative & innovative Q) Adaptable R) Responsible

22. 21 Employer Satisfaction (Q72/73A-R) Sample Program Satisfaction ratings above are based on the 'Satisfied' + 'Very Satisfied' categories.

23. 22 Course Feedback Survey Results - Trends Sample Program *Note that for 2006 calendar year, the survey was not administered in Winter 2006 due to the strike TEACHERS 1. The professor demonstrates a good knowledge of the subject area. 2. The Professor helps me to understand and apply information. 3. The Professor provides feedback that helps me to improve my performance. 4. The Professor encourages me to actively participate in this course. 5. The Professor communicates clearly. 6. The Professor relates to students in ways which promote mutual respect. 7. The Professor evaluates my performance fairly. 8. The Professor is available for consultation. COURSES 9. The learning requirements for this course are clearly stated so that I know what is expected of me. 10. This course contributes to the program in which I am enrolled. 11. This course is well organized. 12. The learning experiences are related to the learning requirements of this course. 13. The required support materials are useful. 14. The methods used to evaluate my performance are clearly outlined in writing. 15. Tests, assignments, projects, and/or other expectations relate well to the learning requirements of this course. 16. The workload in this course is acceptable. 17. Overall, please rate the quality of this course. LEARNING EXPERIENCES 18. There is adequate access to appropriate equipment in good working order for this course. 19. The physical environment in which this course is conducted supports my learning.

24. 23 Course Feedback Survey Results - Winter 2007 & Fall 2007 Sample Program Percentage Ratings above are based on the ‘Agree' + ‘Strongly Agree' categories. 1. The professor demonstrates a good knowledge of the subject area. 2. The Professor helps me to understand and apply information. 3. The Professor provides feedback that helps me to improve my performance. 4. The Professor encourages me to actively participate in this course. 5. The Professor communicates clearly. 6. The Professor relates to students in ways which promote mutual respect. 7. The Professor evaluates my performance fairly. 8. The Professor is available for consultation. 9. The learning requirements for this course are clearly stated so that I know what is expected of me. 10. This course contributes to the program in which I am enrolled. 11. This course is well organized. 12. The learning experiences are related to the learning requirements of this course. 13. The required support materials are useful. 14. The methods used to evaluate my performance are clearly outlined in writing. 15. Tests, assignments, projects, and/or other expectations relate well to the learning requirements of this course. 16. The workload in this course is acceptable. 17. Overall, please rate the quality of this course. 18. There is adequate access to appropriate equipment in good working order for this course. 19. The physical environment in which this course is conducted supports my learning.

25. 24 Course Feedback Survey Results - Trends Sample Program Percentage Ratings above are based on the ‘Agree' + ‘Strongly Agree' categories.

26. 25 Program Applicant & New Registrant Statistics Sample Program

27. 26 Program Applicant & New Registrant Statistics Sample Program 132136193261 Top Large New Registrants 255300413429MTCU New Registrants 126111149145Program New Registrants 6366131,5511,926Top Large Applicants 1,4481,4452,5592,910MTCU Applicants 6556058511,154Program Applicants Program Applicants & New Registrants 2007200620052004

28. 27 Overall KPI The KPI rates for this program for the current survey period are: Student KPI satisfaction, 83%, Graduate KPI satisfaction, 82%, Graduate KPI employment, 89%, and Employer KPI satisfaction, 95%. The student and graduate KPI satisfaction rates for this program are similar to the college and the previous survey period results. Student Satisfaction Survey In general, student satisfaction ratings for most aspects of this program were similar to or lower than the previous year. The greatest differences occurred for: ‘quality of classroom learning’, 10% lower, and ‘develops your ability to solve problems’, 8% lower. Observations – SAMPLE ANALYSIS Sample Program

29. 28 Student Satisfaction Survey (cont’d) Student satisfaction ratings for this program at this college tended to be lower than the MTCU and the Top Large College. The greatest differences occurred for: ‘feedback about your progress’, 9% lower than the MTCU and 8% lower than the Top Large College, ‘has teachers who help you understand your chosen career’, 9% lower than the MTCU and 11% lower than the Top Large College, and develops your writing skills’, 8% lower than the Top Large College. Analysis of learning experience composite indicators appears to indicate similar results over the past two years. Observations – SAMPLE ANALYSIS Sample Program

30. 29 Student Satisfaction Survey (cont’d) Importance ratings for learning experiences ranged from 80% to 100%. Satisfaction ratings (79% to 90%) were generally similar or lower, with relevant differences ranging from 4% to 16%. The greatest potential for improvement appears to be for: ‘develops your speaking skills’ (100% importance, 79% satisfaction), and ‘develops your ability to work with others’ (98% importance, 80% satisfaction). Importance ratings, for those aspects of teachers and courses applicable to the majority of students, ranged from 82% to 99%. Corresponding satisfaction ratings (66% to 88%) were lower, with relevant differences ranging from 4% to 23%. The greatest potential for improvement appears to be for: ‘field placement, clinical experiences, or co-op work terms’ (90% importance, 66% satisfaction, 29% ‘not applicable’), and ‘feedback about your progress’ (94% importance, 75% satisfaction). Sample Program Observations – SAMPLE ANALYSIS

31. 30 Graduate Satisfaction Survey Overall measures of graduate satisfaction for this program were generally similar to the college but higher than MTCU results. However, the ‘overall satisfaction with the college preparation for the type of work you were doing’ was 13% higher than the college and 9% higher than the MTCU average. Graduate satisfaction with program aspects tended to be similar to the college overall and the MTCU average, with the exception of: ‘preparation for the job market’, 11% higher than the college, and ‘overall quality of instruction’, 7% higher than the MTCU. Graduate satisfaction with the various skills and abilities tended to be similar to the previous year and to the MTCU. Sample Program Observations – SAMPLE ANALYSIS

32. 31 Graduate Satisfaction Survey (cont’d) Importance ratings for the various skills and abilities ranged from 85% to 100%. Satisfaction ratings (78% to 95%) were generally similar or lower, with relevant differences ranging from 6% to 19%. The greatest potential for improvement appears to be for: ‘specific job-related knowledge’ (100% importance, 81% satisfaction), and ‘time management’ (93% importance, 78% satisfaction). Employer Satisfaction Survey Employer satisfaction with the various skills and abilities tended to be similar to the previous year and to the MTCU. Importance ratings for the various skills and abilities ranged from 74% to 99%. Satisfaction ratings (69% to 100%) were generally similar or lower, with relevant differences ranging from 9% to 26%. The greatest potential for improvement appears to be for: ‘oral communication’ (99% importance, 73% satisfaction), ‘math skills’ (95% importance, 75% satisfaction), and ‘critical thinking’ (98% importance, 80% satisfaction). Sample Program Observations – SAMPLE ANALYSIS

33. 32 Results for a specific Program at the college may be shown for each question along with the overall “College”, and one of the following benchmarks: “MTCU” refers to the average result for all programs across the province with the same MTCU code. “Top Large” refers to the result for this program at the Top Large college within the same MTCU code. Provincial-level benchmarks (e.g., MTCU and Top Large benchmarks) will be derived from the current “shared” Provincial data file provided by OCAS upon the college’s request and may differ from previously published results. The 2007/2008 KPI Graduation Rate is based on students who started one-year programs in 2005/2006, two-year programs in 2003/2004, and three-year programs in 2001/2002, and who had graduated by 2006/2007. Graduation Rate data will be derived from the current “shared” Provincial data file provided by OCAS. The most recent cycle of Applicant and New Registrant data is for the 2007 cycle, and is referred to as 2007. This data will be derived from the current “shared” Provincial data file provided by OCAS. Course Feedback results are derived from the survey results for each term as collected and maintained by CCI Research Inc. and are reported on for the calendar year (i.e., from winter term through to fall term) or for the current term (i.e., Winter term 2007 and Fall term 2007). Note that for the 2006 calendar year, the survey was not administered in winter 2006 due to the strike. Sample Program Technical Notes

34. 33 Statistical accuracy of results is important to determine if differences between results are statistically significant. In general, results are more accurate for larger numbers of responses. Thus, college level results are more accurate than program level results, and student survey results are more accurate than graduate survey results; with employer survey results being the least accurate. In cases where the number of responses is less than 60 and/or the return rate is less than 50%, results may be statistically unreliable and therefore statistics and commentary should be interpreted with caution. Unweighted averages are used as follows: The “Average KPI” averages the four KPI rates, student satisfaction, graduate satisfaction, graduate employment and employer satisfaction, into a single number. The “4 Year Average” is a simple average of the overall rates for the past four survey periods. Learning Experiences “Composite Indicators” for ‘career development’, ‘problem solving skills’ and ‘communication skills’ are averages of applicable questions. Gap analysis, which involves looking at the differences between importance and satisfaction ratings, is a method for prioritizing areas for improvement. Sample Program Technical Notes