M EASURABLE O UTCOMES AND M EANINGFUL M EASURES Catherine M. Wehlburg, Ph.D. Assistant Provost for Institutional Effectiveness Texas Christian University Northern Illinois University – October 16, 2009

Student learning outcomes (SLOs) are statements that specify what students will know, be able to do or be able to demonstrate when they have completed or participated in a program/activity/course/project. Outcomes are usually expressed as knowledge, skills, attitudes or values. W HAT ARE S TUDENT L EARNING O UTCOMES ?

SLO S S HOULD F OCUS ON : What you want your students to know at the end of a course, program, major, or degree What you want your students to understand at the end of a course, program, major, or degree What you want your students to have the ability to do at the end of a course, program, major, or degree

W HY ARE S TUDENT L EARNING O UTCOMES I MPORTANT ? Communicate expectations to learners Act as a template for course design Guide selection/design of appropriate assessments

W HY ARE S TUDENT L EARNING O UTCOMES I MPORTANT ? Allow educators to match teaching strategies to stated outcomes Allow faculty, staff, and Institutional researchers to assess the impact of instruction Clearly communicate graduates’ skills to prospective employers Provide benchmarks for formative, summative and prior learning assessment

C OMPONENTS OF A S TUDENT L EARNING O UTCOME Student Learning Behavior-Knowledge, skill, or attitude to be gained The Method of Assessment- conditions of performance Criteria for achievement- the levels of acceptable performance

From Peter Drucker, A RE Y OUR SLO S S.M.A.R.T.? S pecific -Clear and definite terms describing the abilities, knowledge, values, attitudes, and performance M easurable -It is feasible to get data: data are accurate and reliable; it can be assessed in more than one way A ggressive and A ttainable -The outcome has the potential to move the program or unit forward R esults – oriented -Describe what standards are expected from students or the functional area being assessed T ime-bound -Describe a specified time period for accomplishing the outcome

C REATING - E VALUATING - A NALYZING - A PPLYING - U NDERSTANDING - R EMEMBERING - BLOOM’S REVISED TAXONOMY C REATING -G ENERATING NEW IDEAS, PRODUCTS, OR WAYS OF VIEWING THINGS E VALUATING -J USTIFYING A DECISION OR COURSE OF ACTION A NALYZING -B REAKING INFORMATION INTO PARTS TO EXPLORE UNDERSTANDINGS AND RELATIONSHIPS A PPLYING -U SING INFORMATION IN ANOTHER FAMILIAR SITUATION U NDERSTANDING -E XPLAINING IDEAS OR CONCEPTS R EMEMBERING -R ECALLING INFORMATION

The student will be able to (specific student behavior) ____________________________________________________ as measured by (conditions of performance – could include time frame) ___________________________________________________ at the ______________________________________ level (performance criteria). T EMPLATE FOR W RITING SLO S

T HE M OBIUS S TRIP

S TAGES OF M EASURING O UTCOMES – T HE M OBIUS S TRIP Stage 1 – Measuring outcomes is a separated and “added on” responsibility. Stage 2 – Measuring outcomes becomes a part of teaching and learning but is separated from teaching and learning. Stage 3 – Teaching and learning is the center and Measuring outcomes surrounds it. Stage 4 – The Mobius Strip – integration of teaching, learning, and outcomes.

S TAGE 1 – M EASURING OUTCOMES IS A SEPARATED AND “ ADDED ON ” RESPONSIBILITY.

S TAGE 2 – M EASURING OUTCOMES BECOMES A PART OF TEACHING AND LEARNING BUT IS SEPARATED FROM TEACHING AND LEARNING.

S TAGE 3 – T EACHING AND LEARNING IS THE CENTER AND MEASURING O UTCOMES SURROUNDS IT.

S TAGE 4 – T HE M OBIUS S TRIP – INTEGRATION OF TEACHING, LEARNING, AND OUTCOMES.

O PERATIONAL M EASURES Measures must be aligned with the outcome that they are supposed to measure. Consider using an operational definition – define the term (“critical thinking”) by how you would measure it. What would you see? What would you expect a student to do? Observable measures are crucial – see “Words to Avoid” and “Phrases to Avoid”

B ACCALAUREATE G OALS Critical Thinking Communication Context

S MALL G ROUP Create several outcomes for your specific goal Use the template in your handout For each outcome suggest at least one measure that could be used

R EPORTING O UT What outcomes did you create?

Q UESTIONS ?