Meaningful Methods For Outcomes Assessment: A Case Study Mehmet "Dali" Ӧztürk, Ph.D. Dean, Research, Planning & Institutional Effectiveness Christian Anderson Professor, Economics Co-chair, Institutional Review Board Presentation delivered at The College of the Sequoias Dialogue Day General Session Friday, October 26, 2018 Visalia, CA

Meaningful Methods For Outcomes Assessment Outcome Evaluation Quasi-Experimental Pre/Post Test Group Comparison Experimental

Meaningful Methods For Outcomes Assessment Success (%) A+, A, A-, B+, B, B-, C+, C = Yes ; All other marks = No

TRANSFER LEVEL MATH COURSES   Total Math Lab Users Non-Users Number % 1479 100.0 337 22.8 1142 77.2 Gender Male 719 48.6 170 50.5 549 48.1 Female 746 50.4 166 49.3 580 50.8 N/A 14 1.0 1 0.3 13 1.1 Fee Waiver Yes 1044 70.6 255 75.7 789 69.1 No 435 29.4 82 24.3 353 30.9 Other Services 235 15.9 96 28.5 139 12.2 1244 84.1 241 71.5 1003 87.8 Race African-American 25 1.7 9 2.7 16 1.4 Asian 44 3.0 10 34 Hispanic 911 61.6 220 65.3 688 60.3 Multi-Ethnicity 97 6.6 21 6.2 76 6.7 White Non-Hispanic 373 25.2 67 19.9 304 26.6 Unknown 15 1.2 First Semester at COS 413 27.9 73 21.7 340 29.8 1066 72.1 264 78.3 802 70.2 Users Mean Std. Dev. Spring 2017 Accumulated GPA 3.03 0.61 3.16 0.54 2.99 0.62 Age at Term 21.75 5.54 23.10 7.40 21.35 4.78

TRANSFER LEVEL MATH COURSES   Total Math Lab Users Non-Users Effect Size Number % 1479 100.0 337 22.8 1142 77.2 Gender Male 719 48.6 170 50.5 549 48.1 Female 746 50.4 166 49.3 580 50.8 N/A 14 1.0 1 0.3 13 1.1 Fee Waiver Yes 1044 70.6 255 75.7 789 69.1 +6.6% No 435 29.4 82 24.3 353 30.9 Other Services 235 15.9 96 28.5 139 12.2 +16.3% 1244 84.1 241 71.5 1003 87.8 Race African-American 25 1.7 9 2.7 16 1.4 Asian 44 3.0 10 34 Hispanic 911 61.6 220 65.3 688 60.3 +5.0% Multi-Ethnicity 97 6.6 21 6.2 76 6.7 White Non-Hispanic 373 25.2 67 19.9 304 26.6 -6.7% Unknown 15 1.2 First Semester at COS 413 27.9 73 21.7 340 29.8 -8.1% 1066 72.1 264 78.3 802 70.2 Users Mean Std. Dev. Spring 2017 Accumulated GPA 3.03 0.61 3.16 0.54 2.99 0.62 0.29 Age at Term 21.75 5.54 23.10 7.40 21.35 4.78 0.32

Meaningful Methods For Outcomes Assessment What Does it all Mean? (Lab Users Vs. Non-Users) Fee waiver recipient: +6.6% Use of other student services: +16.3% Hispanic: +5.0% White, Non-Hispanic: -6.7% First Semester at COS: -8.1% GPA: +0.17 Grade points Age: +1.75 Years

Providing a Context for the Assessment Process Are there any differences in outcome variables? Are the differences significant? Are the differences meaningful? What do these differences and results mean with regard to the overall student success?

Thank You!