MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:

Overview 1. Create program learning outcomes 2. Identify where each outcome is included in your curriculum 3. Determine where you can gather evidence of student performance for each outcome 4. Set an expected performance threshold for each outcome 5. Create a schedule for assessing each outcome 6. Describe your process for using the assessment data 7. Submit your assessment plan

1. Create Program Learning Outcomes What do you want your students to know, to be able to do, and (sometimes) to be when they graduate from your program? The answers to this question are the list of learning outcomes for your degree program.

1. Create Program Learning Outcomes Program learning outcomes are generally written in the form of statements starting with “Our graduates will…” Note: Many professional organizations have developed lists of expected competencies or student leaning outcomes.

Typical Program Learning Outcomes 1. Our graduates will have the knowledge required to be successful in their field. 2. Our graduates will be able to function in a professional manner in their field. 3. Our graduates will be able to analyze problems in their field and develop solutions or strategies to solve those problems. 4. Our graduates will be able to communicate effectively.

1. Create Program Learning Outcomes 1. Develop a list of learning outcomes for your degree program. 2. Assign every outcome a number or letter so that it can be easily identified.

2. Find Each Outcome in Your Curriculum 1. List all required courses 2. Remove courses outside of the faculty’s control (optional) 3. Create a grid showing remaining courses (rows) and learning outcomes (columns) 4. Use a highlighter to indicate where in the courses each outcome is addressed 5. Add a code indicating cognitive skill level to the highlighted cells, for example: I = introductory, D = developing, M = mastery

2. Find Each Outcome in Your Curriculum 1. List all required courses 2. Remove courses outside of the faculty’s control (optional) 3. Create a grid showing remaining courses (rows) and learning outcomes (columns) 4. Use a highlighter to indicate where in the courses each outcome is addressed 5. Add a code indicating cognitive skill level to the highlighted cells, for example: I = introductory, D = developing, M = mastery You are creating a curriculum map.

2.1 List All Required Courses ARCH 151--Design Fundamentals I BIOB 170IN--Principles of Biological Diversity CHMY 121IN--Intro to General Chemistry WRIT 101W--College Writing I M 145--Math for Liberal Arts BIOB 110CS--Introduction to Plant Biology HORT 131--Landscape Design, Hist/Theory HORT 105--Miracle Growing ENSC 245IN--Soils HORT 231--Woody Ornamentals HORT 232--Herbaceous Ornamentals EGEN 115--Engineering Graphics EGEN Engineering Graphics Lab HORT 225--Landscape Graphics I HORT 226--Landscape Graphics II Communication Electives HORT 310--Turfgrass Management HORT 331--Planting Design HORT 335--Site Development HORT 336--Landscape Construction Business Electives HORT 431--Tough Plants in Tough Places HORT 432--Advanced Landscape Design Technical Electives Horticulture Electives Core Electives Courses outside of department shown in color

2.3 Create a Grid of Courses and Outcomes Outcomes 1234 BIOB 170IN BIOB 110CS HORT 131 HORT 105 ENSC 245IN HORT 231 HORT 232 HORT 225 HORT 226 HORT 310 HORT 331 HORT 335 HORT 336 HORT 431 HORT 432

2.4 Highlight Courses that Include Outcome Outcomes 1234 BIOB 170IN BIOB 110CS HORT 131 HORT 105 ENSC 245IN HORT 231 HORT 232 HORT 225 HORT 226 HORT 310 HORT 331 HORT 335 HORT 336 HORT 431 HORT 432 Note: Example shown here is pure fiction!

2.5 Add Code for Cognitive Skill Level Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432I M

2.5 Add Code for Cognitive Skill Level Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432I M This outcome is not supported by the curriculum.

2.5 Add Code for Cognitive Skill Level Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432I M HORT 431 is not asking enough from the students, and students are never asked to demonstrate mastery in outcome 1.

2.5 Add Code for Cognitive Skill Level Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432I M Students are going to have a lot of difficulty in this outcome because of the inverted cognitive skill development.

2.5 Add Code for Cognitive Skill Level Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432I M We expect mastery in communications, but only have the students write in one course!

2.5 Add Code for Cognitive Skill Level Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432I M Two Possibilities: This course contributes nothing towards the program learning outcomes, - or - This course is contributing towards a learning outcome than has not been identified.

3. Where Can You Gather Data? The grid (curriculum map) shows where each outcome is covered. The courses with higher cognitive skill levels are typically good sources for assessment data. Notes: You can save faculty time by gathering data from courses taken by students in multiple programs. Knowledge of the discipline can also be demonstrated using a discipline-based proficiency exam.

3. Data Source Identification Outcomes 1234 BIOB 170IN I BIOB 110CS I HORT 131 I I HORT 105 I ENSC 245IN II HORT 231 I I HORT 232 I I HORT 225 II HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D D HORT 336 D M HORT 431 M HORT 432M D M

4. Set Performance Thresholds As long as students can “squeak by” and graduate with an overall GPA of 2.001, it is unreasonable to expect every student to demonstrate mastery in every outcome. Faculty need to decide what constitutes an acceptable performance threshold for each outcome. Example: At least 80% of students will be rated “Acceptable” or higher on every category of the scoring rubrics.

Example Scoring Rubric Graduates will have an ability to design a system that meets stated needs. Outcome CategoryUnacceptableMarginalAcceptableExceptional Clearly articulated need that is to be addressed by the design. No need is indicated. Need stated incompletely or ambiguously. Statement of need is made, but some improvement is possible. Clearly articulated statement of need. Does the proposed design meet the need? No evidence that the proposed design will meet the stated need. Reader must infer how the design will meet the need. It is apparent that the design will meet the stated need, but some improve- ments are possible. The utility of the design in meeting the stated need is well communicated as part of the presentation. Has the group assembled a logical and practical sequence of integrated unit operations? The proposed design cannot achieve the intended result. The proposed design will likely work, but design has significant shortcomings. The proposed design appears to be a reasonable approach to accomplishing the intended task. The proposed design exhibits a high degree of innovation.

5. Schedule for Assessing Each Outcome Outcome Year XX 2XX 3XX 4XX

6. Process for Using Assessment Data 1. Data is collected from identified courses. 2. Samples are scored by two faculty members using prepared scoring rubrics. 3. The assessment coordinator tabulates the scores. 4. The scores are presented to the faculty for assessment. 5. The faculty reviews the assessment results, and makes decisions on how to respond. 6. A report summarizing the year’s assessment activities and faculty decisions is submitted to the Provost’s Office.

7. Submit Assessment Plan Once you have an assessment plan with essential elements: Program learning outcomes Identified data sources Schedule for assessing each outcome Process for using assessment data then submit your completed plan to the Provost’s Office – and start working the plan.