Surprise. Look who’s engaged Surprise! Look who’s engaged? (CCSSE Results) November 16th & 17th, 2017 Laura Blasi, Ph.D., Director, Institutional Assessment Nichole Jackson, Assistant Director, Learning Assessment

improvements or declines comparison to top schools We asked the question— if we offered a follow-up meeting, what would you like to know more about? You responded— improvements or declines comparison to top schools degree of importance of findings changes made www.valenciacollege.edu/via (click on CCSSE tab, left side) the screen that opens has a link to the interactive data with all filters, like gender. No special software is needed...

While we know that “the college is what the student experiences”….

…we also believe that the positive change we are seeing is because of what the staff and faculty have been doing. This is evident in the positive change we see when comparing the 2017 to the 2015 CCSSE results.

What are two things that research says has a positive influence on earnings? Type in the chat box-- Hu, Shouping and Gregory C. Wolniak. (2009). Student engagement in college and early career earnings: Is there a linkage? Annual Meeting. American Educational Research Association (AERA), San Diego, CA.

…working harder than expected …participating in community service What are two things that research says has a positive influence on earnings? …working harder than expected …participating in community service Hu, Shouping and Gregory C. Wolniak. (2009). Student engagement in college and early career earnings: Is there a linkage? Annual Meeting. American Educational Research Association (AERA), San Diego, CA.

Best from 2015--Take the poll!

Compared to 2015, which of the following do Valencia students more often report doing in 2017? A. Reading on their own for personal enjoyment or academic enrichment B. Participating in a community based project as part of a regular course C. Discussing ideas from readings or classes with others outside of class D. Preparing for class

Compared to 2015, which of the following do Valencia students more often report doing in 2017? A. Reading on their own for personal enjoyment or academic enrichment *B. Participating in a community based project as part of a regular course C. Discussing ideas from readings or classes with others outside of class D. Preparing for class

CCSSE 2017: Service Learning More students participated in a service-learning activity as part of a regular course, and East Campus showed the highest improvement over 2015. Michelle Foster, Executive Dean, East Campus Susan Howard, Coordinator, Academic Affairs, East Campus Kenneth Kuk, Coordinator, Academic Affairs, East Campus CCSSE Item 9b Never participated in a community based project during the current academic year CCSSE 2017 Academic year 2016-2017 CCSSE 2015 2014-2015 East Campus 63.2% 72.9% College-wide 66.5% 73.9%

CCSSE 2017: Service Learning More students participated in a service-learning activity as part of a regular course, and East Campus showed the highest improvement over 2015. Michelle Foster, Executive Dean, East Campus Susan Howard, Coordinator, Academic Affairs, East Campus Kenneth Kuk, Coordinator, Academic Affairs, East Campus CCSSE Item 9b Never participated in a community based project during the current academic year CCSSE 2017 Academic year 2016-2017 CCSSE 2015 2014-2015 East Campus 63.2% 72.9% College-wide 66.5% 73.9% Service Learning Enrollment (# of students) Fall 2016 & Spring 2017 Fall 2014 & Spring 2015 College-wide 1,207 355

Areas where Valencia changed most dramatically since CCSSE 2015. Students are more often engaged in active learning in class. Participating in a community-based project as part of a regular course Making a class presentation Working with other students on projects in class

Lowest compared to Nationwide--Take the poll!

Valencia scores higher than other top-performing colleges on all of the following except _____________ ? A. Satisfaction with library services B. Students working with classmates outside of class to prepare class assignments C. Students working with other students on projects in class D. Contacting struggling students

Valencia scores higher than other top-performing colleges on all of the following except _____________ ? A. Satisfaction with library services B. Students working with classmates outside of class to prepare class assignments C. Students working with other students on projects in class *D. Contacting struggling students

Comparing our data to top-performing, extra-large community colleges.

Areas where Valencia scores lower than top-performing, extra large community colleges Students are… Less often contacted by the college if they are struggling More likely to withdraw due to being academically unprepared Less often reading on their own for personal enjoyment or academic enrichment.

Findings and magnitude: Do students feel supported? Valencia provides strong support for students, but students who are struggling may not feel supported. Colleges across the nation are doing more to reach out to those students. 21. Someone contacts students who are struggling with their studies (Yes) 9d. College emphasizes helping students cope with non-academic responsibilities (Quite a Bit or Very Much) 9f. College emphasizes providing the financial support needed (Quite a Bit or Very Much) 9b. College emphasizes providing the support needed to succeed (Quite a Bit or Very Much) 36. Overall experience at this college (Good or Excellent) Valencia base sample (N=1,369) 11.6% 32.3% 51.5% 77.4% 88.8% Valencia base and oversample (N=3,863) 12.4% (-0.6 points from 2015) 37.0% (+1.6 points from 2015) 56.5% (-3.3 points from 2015) 83.9% (0.0 point from 2015) (+0.9 points from 2015 5 top-performing extra-large community colleges (N=5,851) 18.6% 32.9% 55.5% 77.0% 87.5% CCSSE 2017 cohort (N=177,771) 20.7% 29.1% 51.6% 75.0% 86.2% Difference between Valencia base sample and CCSSE cohort (-9.1 points) (+3.2 points) (-.1 points) (+2.4 points) (+2.6 points)

Findings and magnitude: Do students feel supported? Valencia provides strong support for students, but students who are struggling may not feel supported. Colleges across the nation are doing more to reach out to those students. 21. Someone contacts students who are struggling with their studies (Yes) 9d. College emphasizes helping students cope with non-academic responsibilities (Quite a Bit or Very Much) 9f. College emphasizes providing the financial support needed (Quite a Bit or Very Much) 9b. College emphasizes providing the support needed to succeed (Quite a Bit or Very Much) 36. Overall experience at this college (Good or Excellent) Valencia base sample (N=1,369) 11.6% 32.3% 51.5% 77.4% 88.8% Valencia base and oversample (N=3,863) 12.4% (-0.6 points from 2015) 37.0% (+1.6 points from 2015) 56.5% (-3.3 points from 2015) 83.9% (0.0 point from 2015) (+0.9 points from 2015 5 top-performing extra-large community colleges (N=5,851) 18.6% 32.9% 55.5% 77.0% 87.5% CCSSE 2017 cohort (N=177,771) 20.7% 29.1% 51.6% 75.0% 86.2% Difference between Valencia base sample and CCSSE cohort (-9.1 points) (+3.2 points) (-.1 points) (+2.4 points) (+2.6 points)

CCSSE 2017: Changes to Curriculum What changes are being made in curriculum to improve student performance? Marcia Roman, Counselor, Osceola Campus Based on 2015 CCSSE data, Counselors chose to focus on trying to move the needle on item 9b “The college emphasizes providing the support needed to succeed.” We detected differences in how males and females, disaggregated by ethnicity, felt support and responded with the “Green Bag Campaign.” Surprising to us, Valencia’s data showed that white males and females in 2015 reported feeling significantly less supported than other groups. CCSSE Item 9b Quite a bit & Very much 2015 African American males 87.5% Caucasian males 82.8% Hispanic males 86.0% ALL males 85.1% CCSSE Item 9b Quite a bit & Very much 2015 African American females 82.6% Caucasian females 77.8% Hispanic females 87.2% ALL females 83.4%

CCSSE 2017: Changes to Curriculum What changes are being made in curriculum to improve student performance? Marcia Roman, Counselor, Osceola Campus Valencia outperformed the 2017 CCSSE cohort (75% Quite a bit and Very Much) and also other Top Performing Extra-Large Colleges (77% Quite a bit and Very Much). Our own data show that males, across all ethnicities, showed a decrease between 2015 and 2017. This is concerning as the changes are significant. CCSSE Item 9b Quite a bit & Very much 2017 2015 African American males 82.6% 87.5% Caucasian males 82.4% 82.8% Hispanic males 84.3% 86.0% ALL males 83.3% 85.1% CCSSE Item 9b Quite a bit & Very much 2017 2015 African American females 83.9% 82.6% Caucasian females 82.9% 77.8% Hispanic females 86.0% 87.2% ALL females 84.6% 83.4%

CCSSE 2017: Changes to Curriculum What changes are being made in curriculum to improve student performance? Marcia Roman, Counselor, Osceola Campus We are discussing changes to the Counselor curriculum that include possible programming specifically for males, especially African American and Hispanic males, and explore how to link with other services and outreach to expand the net of support. CCSSE Item 9b Quite a bit & Very much 2017 2015 African American males 82.6% 87.5% Caucasian males 82.4% 82.8% Hispanic males 84.3% 86.0% ALL males 83.3% 85.1% CCSSE Item 9b Quite a bit & Very much 2017 2015 African American females 83.9% 82.6% Caucasian females 82.9% 77.8% Hispanic females 86.0% 87.2% ALL females 84.6% 83.4%

CCSSE 2017: How supportive is your immediate family of your attending Valencia? African American males experience the lowest levels of support from their immediate family. Extremely 72.4% Extremely 65.5% College-wide African-American Males

Findings and magnitude: What are students doing in class? Since 2015, students are more often engaged in active learning in class and less often say Valencia contributes to their Gen Ed skills (though well above CCSSE cohort). 4b. Made a class presentation (Often or Very Often) 4f. Worked with other students on projects in class (Often or Very Often) 11e. Valencia contributes to their solving numerical problems (Quite a bit or Very Much) 11d. Valencia contributes to their thinking critically and analytically (Quite a bit or Very Much) 4d. Worked on a paper or project integrating ideas from various sources (Often or Very Often) Valencia base sample (N=1,369) 50.2% 58.1% 63.3% 76.0% 72.3% Valencia base and oversample (N=3,863) 58.2% (+4.7 points from 2015) 59.9% (+ 4.2 points from 2015) 61.5% (-2.4 points from 2015) 75.4% (-1.3 points from 2015) 79.4% (+2.6 points from 2015) 5 top-performing extra-large community colleges (N=5,851) 47.1% 56.7% 58.8% 74.4% 72.0% CCSSE 2017 cohort (N=177,771) 34.2% 52.2% 55.1% 70.4% 66.4% Difference between Valencia base sample and CCSSE cohort (+16 points) (+5.9 points) (+8.2 points) (+5.6 points) (+5.0 points)

Findings and magnitude: What are students doing in class? Since 2015, students are more often engaged in active learning in class and less often say Valencia contributes to their Gen Ed skills (though well above CCSSE cohort). *2016-17 Gen Ed Assessments also showed decreases in Critical Thinking and Quantitative Reasoning. 4b. Made a class presentation (Often or Very Often) 4f. Worked with other students on projects in class (Often or Very Often) 11e. Valencia contributes to their solving numerical problems (Quite a bit or Very Much) 11d. Valencia contributes to their thinking critically and analytically (Quite a bit or Very Much) 4d. Worked on a paper or project integrating ideas from various sources (Often or Very Often) Valencia base sample (N=1,369) 50.2% 58.1% 63.3% 76.0% 72.3% Valencia base and oversample (N=3,863) 58.2% (+4.7 points from 2015) 59.9% (+ 4.2 points from 2015) 61.5% (-2.4 points from 2015) 75.4% (-1.3 points from 2015) 79.4% (+2.6 points from 2015) 5 top-performing extra-large community colleges (N=5,851) 47.1% 56.7% 58.8% 74.4% 72.0% CCSSE 2017 cohort (N=177,771) 34.2% 52.2% 55.1% 70.4% 66.4% Difference between Valencia base sample and CCSSE cohort (+16 points) (+5.9 points) (+8.2 points) (+5.6 points) (+5.0 points)

Findings and magnitude: What are students doing after class? Since 2015, students are less often reading on their own and otherwise have not changed their out of class behaviors by much. Valencia remains well above it’s peers in engaging students to work with each other outside of class. 4e. Came to class without completing readings or assignments (Sometimes, often, or Very Often) 4m. Discussed ideas from readings or classes with instructors outside of class (Never) 6b. Number of books read on your own (not assigned) for personal enjoyment or academic enrichments (None) 4g. Worked with classmates outside of class to prepare class assignments (Never) 9a. Valencia encourages spending significant amounts of time studying (Very Little or Some) Valencia base sample (N=1,369) 66.0% 45.6% 34.7% 25.6% 22.2% Valencia base and oversample (N=3,863) 68.9% (+0.7 points from 2015) 43.2% (-2.0 points from 2015) 35.3% (+3.5 points from 2015) 24.1% (+0.8 points from 2015) 21.4% (+1.5 points from 2015) 5 top-performing extra-large community colleges (N=5,851) 43.6% 30.2% 30.3% 23.1% CCSSE 2017 cohort (N=177,771) 66.2% 44.1% 35.6% 36.3% 25.3% Difference between Valencia base sample and CCSSE cohort (-0.2 points) (+1.5 points) (-0.9 points) (-10.7points) (-3.1 points)

Findings and magnitude: What are students doing after class? Since 2015, students are less often reading on their own and otherwise have not changed their out of class behaviors by much. Valencia remains well above it’s peers in engaging students to work with each other outside of class. 4e. Came to class without completing readings or assignments (Sometimes, often, or Very Often) 4m. Discussed ideas from readings or classes with instructors outside of class (Never) 6b. Number of books read on your own (not assigned) for personal enjoyment or academic enrichments (None) 4g. Worked with classmates outside of class to prepare class assignments (Never) 9a. Valencia encourages spending significant amounts of time studying (Very Little or Some) Valencia base sample (N=1,369) 66.0% 45.6% 34.7% 25.6% 22.2% Valencia base and oversample (N=3,863) 68.9% (+0.7 points from 2015) 43.2% (-2.0 points from 2015) 35.3% (+3.5 points from 2015) 24.1% (+0.8 points from 2015) 21.4% (+1.5 points from 2015) 5 top-performing extra-large community colleges (N=5,851) 43.6% 30.2% 30.3% 23.1% CCSSE 2017 cohort (N=177,771) 66.2% 44.1% 35.6% 36.3% 25.3% Difference between Valencia base sample and CCSSE cohort (-0.2 points) (+1.5 points) (-0.9 points) (-10.7points) (-3.1 points)

What are two things that research says makes students more likely to succeed? Type in the chat box-- Center for Community College Student Engagement. (2014). A matter of degrees: Practices to pathways (High-impact practices for community college student success). Austin, TX: The University of Texas at Austin, Program in Higher Education Leadership

What are two things that research says makes students more likely to succeed? …an advisor helps a student develop an academic plan …participating in an internship Center for Community College Student Engagement. (2014). A matter of degrees: Practices to pathways (High-impact practices for community college student success). Austin, TX: The University of Texas at Austin, Program in Higher Education Leadership

CCSSE 2017: Careers 8a. CCSSE 2017 cohort 16.9% 41.5% 12b. Used Career Counseling one or more times (46.2% are very satisfied; 55.3% say it is very important). 8.9% 8a. Enrolled in or completed an internship, field experience, co-op experience, or clinical assignment.

CCSSE 2017: Careers The majority of Valencia students make career plans, get career information, and acquire job or work-related skills, but less than half use career counseling and very few complete an internship. 92.6% Goals 11h. Valencia contributed some, quite a bit, or very much to their developing clearer career goals 89.4% Information 11i. Valencia contributed some, quite a bit, or very much to their gaining information about career opportunities 83.3% Plans 4l. Talked sometimes, often, or very often about career plans with an instructor or advisor 78.8% Skills 11a. Valencia contributed quite a bit, or very much to their acquiring job or work-related knowledge and skills. 41.5% Counseling 12b. Used Career Counseling one or more times (46.2% are very satisfied; 55.3% say it is very important). 8.9% 8a. Enrolled in or completed an internship, field experience, co-op experience, or clinical assignment.

Findings and magnitude: How satisfactory are services? Since 2015, students who used services at the college & say they are “very” satisfied has gone up. (Students who selected “Not Applicable” were removed from the sample for this question) 12.2k Satisfaction with library resources and services (Very) 12.2e Satisfaction with skill labs (Very) 12.2g Satisfaction with financial aid advising 12.2a Satisfaction with academic advising and planning 12.2b Satisfaction with career counseling Valencia base sample (N=1,369) 66.8% 57.5% 50.5% 47.3% 43.5% Valencia base and oversample (N=3,863) 70.2% 58.0% (+7.9 points from 2015) 54.0% (+5 points from 2015) 52.1% (+8.7 points from 2015) 46.2% (+8.3 points from 2015) 5 top-performing extra-large community colleges (N=5,851) 63.0% 49.4% 41.7% 39.1% CCSSE 2017 cohort (N=177,771) 61.9% 47.8% 48.5% 45.7% 38.6% Difference between Valencia base sample and CCSSE cohort (+4 points) (+9.7 points) (+2 points) (+1.6 points) (+4.9 points)

Findings and magnitude: How satisfactory are services? Since 2015, students who used services at the college & say they are “very” satisfied has gone up. (Students who selected “Not Applicable” were removed from the sample for this question) 12.2k Satisfaction with library resources and services (Very) 12.2e Satisfaction with skill labs (Very) 12.2g Satisfaction with financial aid advising 12.2a Satisfaction with academic advising and planning 12.2b Satisfaction with career counseling Valencia base sample (N=1,369) 66.8% 57.5% 50.5% 47.3% 43.5% Valencia base and oversample (N=3,863) 70.2% 58.0% (+7.9 points from 2015) 54.0% (+5 points from 2015) 52.1% (+8.7 points from 2015) 46.2% (+8.3 points from 2015) 5 top-performing extra-large community colleges (N=5,851) 63.0% 49.4% 41.7% 39.1% CCSSE 2017 cohort (N=177,771) 61.9% 47.8% 48.5% 45.7% 38.6% Difference between Valencia base sample and CCSSE cohort (+4 points) (+9.7 points) (+2 points) (+1.6 points) (+4.9 points)

CCSSE 2017: Changes to Support Services What changes are being made in learning support to improve student performance? Michael Blackburn, Manager, Learning Support Services, Lake Nona Campus CCSSE results are used in combination with tutoring survey results at Lake Nona to improve all of the following: --Tutor training --Hours of operation --Content for classroom visits to explain tutoring --Supplemental learning materials for students to use outside of the Tutoring Center

CCSSE 2017: Changes to Support Services What changes are being made in learning support to improve student performance? Michael Blackburn, Manager, Learning Support Services, Lake Nona Campus --Training tutors to provide students with success skills like asking more questions (and the right type of questions) in class. 4a. How often have you asked questions in class or contributed to class discussions

CCSSE 2017: Changes to Support Services What changes are being made in learning support to improve student performance? Michael Blackburn, Manager, Learning Support Services, Lake Nona Campus --Providing student perspective information to our tutors during their training. 12.3d. How important is peer or other tutoring to you at Valencia?

CCSSE 2017: What did we learn? Results: --Students have increasing satisfaction with services --Classrooms are engaging students in active learning --Valencia could do more to reach out to struggling students You can use results: to design training to inform curriculum to improve services at the college Thank you to Kenneth, Marcia, Michael, Michelle, and Susan www.valenciacollege.edu/via (click on CCSSE tab, left side) the screen that opens has a link to the interactive data with all filters, like gender. No special software is needed...