1. Developing Operational Outcomes for Your Unit Dr. Kim Yousey-Elsener, Associate Director of Assessment Programs

2. Goals of this session: Defining “operational” outcomes Connecting outcomes “up” Connecting outcomes with assessment types Writing effective outcomes Measuring outcomes

3. Defining “Operational” Outcomes

4. Program OperationalTargetMetrics Criteria for success

5. Success indicators “…are quantifiable measurements, agreed to beforehand, that reflect the critical success factors of an organization. They help an organization define and measure progress toward organizational goals.” (Bresciani et al., 2010)

6. Determine the type of Outcome: Examine what a student (or other stakeholders) is to know, think or be able to do, as a result of the program, course, service. Learning outcomes Examine what a program or process is to do, achieve or accomplish for its own improvement; generally needs/satisfaction driven. Operational outcomes

7. Connecting “Up”

8. Where is your inspiration? Program & Policy Creation or Improvement Improved Teaching and Learning Planning & Resource Allocation Accountability & Accreditation

9. Start with your “foundations” Strategic Plan Priorities Mission statement Resource Needs New programs/services Anything needing a change Political quandaries

10. Let’s get started… What is your source of inspiration? What do you need to find out?

11. Types of assessment: Assessment UsageNeeds Program effectiveness Environment Learning Comparison Cost

12. Writing effective outcomes

13. ABCD Structure of an Outcome (Heinich, et al, 1996) Who or what does the outcome pertain to? Audience/Who What do you expect to change? Learning – students do, think, feel Operational - need, effectiveness, etc. Behavior/What Under what conditions or circumstances will the change occur? Condition/How How much will be accomplished, and to what level? Degree/How much

14. Outcome Statement: A B C D Program/Service will …

15. Let’s Practice!! A B C D Program/Service will …

16. Measuring outcomes

17. Sources of evidence Data systems Tracking/Usage Operational data Trend/longitudinal data Local surveys National surveys Rubrics Objects

18. Evidence source: Data systems

19. Evidence source: Tracking systems

20. Evidence source: Operational data

21. Evidence source: Local survey

22. Evidence source: National survey

23. Evidence source: Rubric

24. Evidence Source: Objects

25. Let’s Practice!! Who is your audience? What kind of data will you need for that audience? In what format? What source would help you achieve that?

26. Questions? Kim Yousey-Elsener, PhD. Associate Director, Campus Labs 716-652-9400 press 1 kimye@campuslabs.com