Download presentation
Presentation is loading. Please wait.
1
Assessment Day 2018 New Student Experience
Presented by Heather Ramsier Kim Foster Jenny Lee Gaye Simpkins
2
Agenda Assessment Overview Data Review Revisit ‘Closing the Gap’
Next Steps for Assessment Year Data Review: We’re going to be looking at our general education outcomes from Fall 2017 and Spring 2018, comparing them to previous years. We’re also going to share data as it relates to our role with helping with the college initiative to increase the graduation rates of at-risk populations.
3
Why Assessment Day? Opportunity to discuss the NSE course as related to student learning The purpose of assessment is to improve learning. The college is what the student experiences. NSE class is highly based on experiences – most for the assignments are linked to experiences during the semester. Small group discussion and then share out: What assignments do your students report that they find most beneficial?
4
Why Assessment Day? The purpose of assessment is to improve learning.
The college is what the student experiences. What assignments or in class activities do your students report that they find most beneficial? NSE class is highly based on experiences – most for the assignments are linked to experiences during the semester. Small group discussion and then share out: What assignments do your students report that they find most beneficial?
5
Implement Changes: 2018-2019 Academic Year
Evaluate Student Work Faculty score student work with rubrics SFI surveys completed Tabulate and Analyze Results: Rubrics are pulled and evaluated Reflect for Improvement: Assessment Day Create a Plan: Work Teams Implement Changes: Academic Year Assessment Cycle Engage in discussion to reflect on the last academic year and determine the areas for improvement for the following academic year.
6
The purpose of assessment is to improve learning.
Assessment Day is the foundation where many changes have originated. The purpose of assessment is to improve learning. The college is what the student experiences.
7
What are the Valencia General Education Student Learning Outcomes
What are the Valencia General Education Student Learning Outcomes? Which outcomes do we asses for in NSE?
8
Questions that we often are asked outside of Assessment Day:
Why do we have to assess for these 3 areas? Yes, Part of our Assessment Plan. Can we change what Gen Ed Outcomes we assess? After June Can we change how we assess? Yes Can we change what assignments we use to assess? Yes
9
Data Review
10
Assessment Plan Related Accomplishments: Changes implemented during the Academic Year Rubrics for mandatory assignments were revised during Summer 2017 Changes based on decision of faculty on Assessment Day 2017 Reflect 3 consistent level of achievement Standards range from high to low Rubrics were updated in Blackboard prior to the start of the term Mid-Year Rubric pull to address issues with rubric usage Rubrics from Fall 2017 were pulled in January 2018 Faculty that were making changes to rubrics or not using the rubrics for scoring were contacted by Deans of Learning Support in early Spring 2018 Closing the Gap Committee
11
Conversation from Personal Reflection Question: Upon reviewing your gradebook you notice that several students have missed 2 or more assignments and/or class sessions. What is your current practice for addressing this concern, if any? Have faculty record strategies/activities on index cards. Assessment Team will be sharing strategies in to connect with students related to attendance and work completion. Did you try anything during the past academic year to connect more deeply with our students that have been identified as at-risk?
12
Critical Thinking Indicator: Use of evidence
Fall 2016: Academic Blueprint Rubric Data Last year, the data for Critical Thinking reflected: Increase in students scoring Satisfactory or Developing on Part 4 in Fall 2016 Fall % to Fall % Rubric usage remaining consistent: Fall 2015:57% Fall 2016: 55% Spring 2017: 58% Faculty use of AB rubric at highest level Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2874 75% Developing 591 15% Unsatisfactory 361 9% *Total students n= 3864 55% of enrolled 90% Spring 2017: Academic Blueprint Rubric Data Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2616 67% Developing 745 19% Unsatisfactory 545 14% *Total students n= 3906 58% of enrolled 86%
13
Assessed in Academic Blueprint Part 3B and 4
Critical Thinking Indicator: Use of evidence Fall 2016: Academic Blueprint Rubric Data Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2874 75% Developing 591 15% Unsatisfactory 361 9% *Total students n= 3864 55% of enrolled Assessed in Academic Blueprint Part 3B and 4 90% Spring 2017: Academic Blueprint Rubric Data Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2616 67% Developing 745 19% Unsatisfactory 545 14% *Total students n= 3906 58% of enrolled 86%
14
Critical Thinking Indicator: Use of evidence
Requests were made last year for Part 3B data Fall 2016: Academic Blueprint Rubric Data Fall 2017: Academic Blueprint Rubric Data Part 3B: What do I need? Term by Term Academic Plan Number of Students % of total scored in rubrics Satisfactory 2892 75% Developing 719 19% Unsatisfactory 253 7% *Total students n= 3864 56% of enrolled Part 3B: What do I need? Term by Term Academic Plan Number of Students % of total scored in rubrics Excellent 3125 66% Satisfactory 1019 22% Developing 569 12% *Total students n= 4713 56% of enrolled 94% 88% Spring 2017: Academic Blueprint Rubric Data Spring 2018: Academic Blueprint Rubric Data Part 3B: What do I need? Term by Term Academic Plan Number of Students % of total scored in rubrics Satisfactory 2637 70% Developing 764 20% Unsatisfactory 381 10% *Total students n= 3782 56% of enrolled Part 3B: What do I need? Term by Term Academic Plan Number of Students % of total scored in rubrics Excellent 2573 67% Satisfactory 783 21% Developing 470 12% *Total students n= 3790 57% of enrolled 90% 88%
15
Comparing 2016-17 to 2017-18 Fall 2016: Academic Blueprint Rubric Data
Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2874 75% Developing 591 15% Unsatisfactory 361 9% *Total students n= 3826 55% of enrolled Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Excellent 3161 72% Satisfactory 928 21% Developing 326 7% *Total students n= 4415 52% of enrolled 90% 93% Spring 2017: Academic Blueprint Rubric Data Spring 2018: Academic Blueprint Rubric Data Activity 1: Jot down on the note card what you see, think, know… discuss with the person next to you (Two Minutes) Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2616 67% Developing 745 19% Unsatisfactory 545 14% *Total students n= 3906 58% of enrolled Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Excellent 2585 67% Satisfactory 693 19% Developing 479 14% *Total students n= 3757 57% of enrolled 86% 86%
16
Your Insights: What do you notice? What stands out to you?
What are your personal interpretations? Fall 2016: Academic Blueprint Rubric Data Fall 2017: Academic Blueprint Rubric Data Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2874 75% Developing 591 15% Unsatisfactory 361 9% *Total students n= 3826 55% of enrolled Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Excellent 3161 72% Satisfactory 928 21% Developing 326 7% *Total students n= 4415 52% of enrolled 90% 93% Spring 2017: Academic Blueprint Rubric Data Spring 2018: Academic Blueprint Rubric Data Activity 1: Jot down on the note card what you see, think, know… discuss with the person next to you (Three Minutes) Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2616 67% Developing 745 19% Unsatisfactory 545 14% *Total students n= 3906 58% of enrolled Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Excellent 2585 67% Satisfactory 693 19% Developing 479 14% *Total students n= 3757 57% of enrolled 86% 86%
18
Oral Communication Fall 2016: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2815 72% Acceptable 968 25% Unacceptable 147 4% *Total students n= 3930 57% of enrolled Last year, the data for Oral Communication reflected: Increased percentage overall of students scoring in Accomplished/Acceptable Increased percentage of faculty using the rubric for scoring for Final Story Project 77% of Fall 2016 classes used the rubric for assessment 97% Spring 2017: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2651 69% Acceptable 1001 26% Unacceptable 165 4% *Total students n= 3906 58% of enrolled 95%
19
Assessed in Final Story Project Presentation Oral Communication
Fall 2016: Final Story Project Rubric Data Assessed in Final Story Project Presentation Language\Delivery Number of Students % of total scored in rubrics Accomplished 2815 72% Acceptable 968 25% Unacceptable 147 4% *Total students n= 3930 57% of enrolled 97% Spring 2017: Final Story Project Rubric Data Note: 77% of the course sections used the rubric in Fall 2016 (76% in Fall 2017 and 74% in Spring 2018) Transition, now we want you to compare Language\Delivery Number of Students % of total scored in rubrics Accomplished 2651 69% Acceptable 1001 26% Unacceptable 165 4% *Total students n= 3906 58% of enrolled 95%
20
Comparing to Fall 2016: Final Story Project Rubric Data Fall 2017: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2815 72% Acceptable 968 25% Unacceptable 147 4% *Total students n= 3930 57% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 3111 68% Satisfactory 1230 27% Developing 221 5% *Total students n= 4562 54% of enrolled 97% 95% Spring 2017: Final Story Project Rubric Data Spring 2018: Final Story Project Rubric Data Activity 2: Jot down on the note card what you see, think, know… discuss with the person next to you (Three Minutes) Language\Delivery Number of Students % of total scored in rubrics Accomplished 2651 69% Acceptable 1001 26% Unacceptable 165 4% *Total students n= 3817 55% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 2384 68% Satisfactory 879 25% Developing 235 7% *Total students n= 3498 53% of enrolled 95% 93%
21
Your Insights: What do you notice? What stands out to you?
What are your personal interpretations? Fall 2016: Final Story Project Rubric Data Fall 2017: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2815 72% Acceptable 968 25% Unacceptable 147 4% *Total students n= 3930 57% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 3111 68% Satisfactory 1230 27% Developing 221 5% *Total students n= 4562 54% of enrolled 97% 95% Spring 2017: Final Story Project Rubric Data Spring 2018: Final Story Project Rubric Data Activity 2: Jot down on the note card what you see, think, know… discuss with the person next to you (Three Minutes) As noted on Critical Thinking and Oral Communication, fewer faculty are using rubrics – what happened? Why might this be occurring/? Language\Delivery Number of Students % of total scored in rubrics Accomplished 2651 69% Acceptable 1001 26% Unacceptable 165 4% *Total students n= 3817 55% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 2384 68% Satisfactory 879 25% Developing 235 7% *Total students n= 3498 53% of enrolled 95% 93%
23
Interpersonal Communication
Fall 2016: CC Personal Connection Language\Delivery Number of Students % of total scored in rubrics Mastery 1748 75% Competent 432 19% Beginning 148 6% *Total students n= 2328 45% of enrolled 94% Last year, the data for Interpersonal Communication reflected: Increased percentage overall of students scoring in Mastery/Competent Reduced percentage of faculty using the rubric for scoring for Interpersonal Communication Spring 2017: CC Personal Connection Language\Delivery Number of Students % of total scored in rubrics Mastery 1750 78% Competent 344 15% Beginning 159 7% *Total students n= 2253 39% of enrolled 93%
24
Interpersonal Communication
Fall 2016: Career Interview (online) Language\Delivery Number of Students % of total scored in rubrics Mastery 189 72% Competent 51 19% Beginning 24 9% *Total students n= 264 32% of enrolled Assessed in Place Co-Curricular (F2F, Mixed Mode) or Career Interview (Online) 91% Spring 2017: Career Interview (online) Language\Delivery Number of Students % of total scored in rubrics Mastery 183 66% Competent 61 22% Beginning 33 12% *Total students n= 277 30% of enrolled 88%
25
Interpersonal Communication
Fall 2016: CC Personal Connection Fall 2016: Career Interview (online) Language\Delivery Number of Students % of total scored in rubrics Mastery 1748 75% Competent 432 19% Beginning 148 6% *Total students n= 2328 45% of enrolled Language\Delivery Number of Students % of total scored in rubrics Mastery 189 72% Competent 51 19% Beginning 24 9% *Total students n= 264 32% of enrolled 94% 91% Spring 2017: CC Personal Connection Spring 2017: Career Interview (online) Language\Delivery Number of Students % of total scored in rubrics Mastery 1750 78% Competent 344 15% Beginning 159 7% *Total students n= 2253 39% of enrolled Language\Delivery Number of Students % of total scored in rubrics Mastery 183 66% Competent 61 22% Beginning 33 12% *Total students n= 277 30% of enrolled 93% 88%
26
Interpersonal Communication
Fall 2017: CC Place Fall 2017: Career Interview (online) Language\Delivery Number of Students % of total scored in rubrics Excellent 2312 69% Satisfactory 582 17% Developing 442 13% *Total students n= 3336 46% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 278 61% Satisfactory 130 28% Developing 49 11% *Total students n= 457 38% of enrolled 86% 89% Spring 2018: CC Place Spring 2018: Career Interview (online) Interpersonal Communication Broken Down by Assignment Fall Co-Curricular: 69% course sections ---- Spring Co-Curricular: 64% course sections Fall Career Interview: 83% course sections Spring Career Interview: 67% Language\Delivery Number of Students % of total scored in rubrics Excellent 1745 69% Satisfactory 466 18% Developing 314 12% *Total students n= 2525 45% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 280 73% Satisfactory 60 16% Developing 45 12% *Total students n= 385 37% of enrolled 87% 89%
27
Comparing to Fall 2016: CC Personal Connection and Career Interview (combined) Fall 2017: CC Place and Career Interview (combined) Language\Delivery Number of Students % of total scored in rubrics Mastery 1937 75% Competent 483 19% Beginning 172 7% *Total students n= 2592 43% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 2590 68% Satisfactory 712 19% Developing 491 13% *Total students n= 3793 45% of enrolled 94% 87% Activity 3: Jot down on the note card what you see, think, know… discuss with the person next to you (Three Minutes) Spring 2018 CC Place and Career Interview (combined) Spring 2017: CC Personal Connection and Career Interview (combined) Language\Delivery Number of Students % of total scored in rubrics Mastery 1933 76% Competent 405 16% Beginning 192 8% *Total students n= 2530 38% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 2025 81% Satisfactory 106 4% Developing 359 14% *Total students n= 2490 38% of enrolled 92% 85%
28
Your Insights: What do you notice? What stands out to you?
What are your personal interpretations? Fall 2016: CC Personal Connection and Career Interview (combined) Fall 2017: CC Place and Career Interview (combined) Language\Delivery Number of Students % of total scored in rubrics Mastery 1937 75% Competent 483 19% Beginning 172 7% *Total students n= 2592 43% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 2590 68% Satisfactory 712 19% Developing 491 13% *Total students n= 3793 45% of enrolled 94% 87% Activity 3: Jot down on the note card what you see, think, know… discuss with the person next to you (Three Minutes) Drop in student’s scoring as satisfactory or higher (scores on Place CC were lower than Personal Connection CC) Handout out sheet with questions Spring 2018 CC Place and Career Interview (combined) Spring 2017: CC Personal Connection and Career Interview (combined) Language\Delivery Number of Students % of total scored in rubrics Mastery 1933 76% Competent 405 16% Beginning 192 8% *Total students n= 2530 38% of enrolled Language\Delivery Number of Students % of total scored in rubrics Excellent 2025 81% Satisfactory 106 4% Developing 359 14% *Total students n= 2490 38% of enrolled 92% 85%
29
Let’s talk… What are the strengths of students as shown through the program assessment? What areas need to be strengthened? What next steps are suggested regarding NSE from the assessment process and outcomes? How do we know that students are learning? Are rubrics the best tool to use to assess our students? We wonder if assignments are accurately reflecting student learning?
30
Let’s talk… Which of these steps can be taken over the next year? How does this relate to our support of at-risk students? Which of these steps need to be taken over the long term? How does this relate to our support of at-risk students?
31
Looking forward… Where should the focus be placed for the Assessment Cycle? Critical Thinking Oral Communication Interpersonal Communication Why that Learning Outcome? Why that Learning Outcome is referring to the top pick
32
Looking forward… What kinds of faculty development would you find helpful related to assessment? Should the process of communicating the assessment process and results change for next year? If so, how? How should the process of assessing and reviewing the results change next year, if at all? What are the other learning outcomes for NSE and how are they being assessed?
33
Next Steps 2018-2019 Continued discussion at NSELT May 24
Please consider being part of the team to continue this discussion and begin formulating strategies for AY
34
We need to talk about RUBRICS… And Canvas.
One last thing… We need to talk about RUBRICS… And Canvas.
35
Rubrics are already embedded in the NSE shell you should be using to develop your Canvas courses.
36
Pilot of the Rubrics is being done this summer and changes will likely be made to the rubrics. Be aware that you will likely need to update your rubrics prior to the start of the fall term. It is highly advised that you build one class in a Sandbox and wait to load it into your fall 2018 until closer to the first day of classes.
Similar presentations
