“Outcomification”: Development and Use of Student Learning Outcomes Noelle C. Griffin, PhD Director, Assessment and Data Analysis Loyola Marymount University.

Slides:



Advertisements
Similar presentations
Outcomes and Standards. Outcome Curricular statements describing how students will integrate knowledge, skills, and values into a complex role performance.
Advertisements

Course Design: The Basics Monica A. Devanas, Ph.D. Director, Faculty Development and Assessment Programs Center for Teaching Advancement and Assessment.
Why We Are Here: Context for Curricular Design and Clinical Education Copyright 2008 by The Health Alliance of MidAmerica LLC.
Core Competencies Student Focus Group, Nov. 20, 2008.
International Outcomes Assessment Dr. Barbara Wheeling Montana State University Billings Coordinator for Institutional Assessment College of Business Director.
Creating an SLO or PLO Statement Presented by ORIE Team Summer 2013 Academy for Planning, Assessment, and Research.
Consistency of Assessment
NMT Gen Ed Learning Objectives An ability to communicate well An ability to reason well An ability to evaluate and apply information Development of analytical.
DEVELOPING DEPARTMENTAL OUTCOMES ASSESSMENT PLANS Jerry Rackoff Lois Huffines Kathy Martin.
Introduction to Student Learning Outcomes in the Major
PPA Advisory Board Meeting, May 12, 2006 Assessment Summary.
Assessing Student learning
Measuring Learning Outcomes Evaluation
WRITING STUDENT LEARNING OUTCOMES March 24, 2010.
FLCC knows a lot about assessment – J will send examples
Program Assessment Workshop Kathleen Harring. What is Assessment? Assessment is the systematic gathering and analysis of information to inform and improve.
Purpose Program The purpose of this presentation is to clarify the process for conducting Student Learning Outcomes Assessment at the Program Level. At.
Formulating objectives, general and specific
Learning Outcomes at the University of North Alabama Dr. Andrew L. Luna Institutional Research, Planning, and Assessment.
At the end of my physics course, a biology student should be able to…. Michelle Smith University of Maine School of Biology and Ecology Maine Center for.
MAINTAINING QUALITY IN BLENDED LEARNING: FROM CLASSROOM ASSESSMENT TO IMPACT EVALUATION PART I: DESIGNING AND EVALUATING LEARNING Suzanne Weinstein, Ph.D.
Spring 2012 Pilot Project Module Nine A New Texas Core Curriculum 1.
1 Module 1: Developing and Validating Learning Outcome Statements Presented at CSU San Marcos Peggy Maki April 25 and 25, 2007.
Evaluation: A Challenging Component of Teaching Darshana Shah, PhD. PIES
Outcomes Assessment 101 Assessment Showcase 2009: Best Practices in the Assessment of Learning and Teaching February 11, 2009 Gwendolyn Johnson, Ph.D.
Sheila Roberts Department of Geology Bowling Green State University.
Lesson Planning. Teachers Need Lesson Plans So that they know that they are teaching the curriculum standards required by the county and state So that.
Helping Your Department Advance and Implement Effective Assessment Plans Presented by: Karen Froslid Jones Director, Institutional Research.
LeMoyne-Owen College December 16, 2009 Mimi Czarnik, Professor of English and Dean of Humanities Becky Burton, Associate Professor of Biology Alverno College,
PEGGY MAKI, PH.D. EDUCATION CONSULTANT IN ASSESSING STUDENT LEARNING PRESENTED AT CCRI SEPTEMBER 21, 2012 Assessment at Three Levels: Institution, Program,
Writing Student Learning Outcomes Consider the course you teach.
Promoting and Communicating Learning Quality at NKU Mapping Student Learning Outcomes and Assessing Student Learning D. Kent Johnson, PhD.
Writing Learning Outcomes David Steer & Stephane Booth Co-Chairs Learning Outcomes Committee.
Assessing Student Learning Lynn Merklin Assistant Provost Office of Institutional Effectiveness August, 2014.
Using the Capstone Course to Generate Student Learning Outcomes Texas State University Thomas E. Castleberry Patricia M. Shields Hassan Tajalli.
Paul Parkison: Teacher Education 1 Articulating and Assessing Learning Outcomes Stating Objectives Developing Rubrics Utilizing Formative Assessment.
Sultan Qaboos University College of Education Course: Instructor:
1 Assessment Gary Beasley Stephen L. Athans Central Carolina Community College Spring 2008.
ED5545 Curriculum & Instruction Master Practicum II
Writing Student-Centered Learning Objectives Please see Reference Document for references used in this presentation.
Learning Objective A statement in specific and measurable terms that describes what the learner will know or be able to do as a result of engaging in.
Unit 5 Seminar D ESCRIBING Y OUR L EARNING. Agenda Unit Objectives Bloom’s Taxonomy Learning Statements Questions.
INSTRUCTIONAL OBJECTIVES
Assessing Student Learning Workshop for Department Chairs & Program Directors Workshop for Department Chairs & Program Directors January 9, 2007.
D ESCRIBING Y OUR L EARNING Unit 5 Seminar. Agenda Unit Objectives Bloom’s Taxonomy Learning Statements Questions.
Understanding Assessment The Basics Office for Institutional Effectiveness and Assessment.
Learning Outcomesas part of the Assessment Cycle Kirsten Ogden Faculty Assessment Coach Pasadena City College 2014.
Identifying Outcomes Peggy Maki Senior Scholar Assessing for Learning American Association for Higher Education
Assessment Workshop 2 Developing Student Learning Outcomes.
Developing and Linking Objectives at the Program and Course Levels Presentation to Fulton-Montgomery Community College October 5, 2006.
MU Core Revision Proposal The Atom Visual Structure Please read information provided in each slide as well as the notes under each slide.
PhD in Social Work and Social Policy at FPN UBG Prof dr Nevenka Zegarac Department of Social work and social policy Faculty of political sciences UBG TEMPUS.
QCC General Education Assessment Task Force March 21 and 22, 2016 Faculty Forum on General Education Outcomes.
CDIO: Overview, Standards, and Processes (Part 2) Doris R. Brodeur, November 2005.
©2007 RUSH University Medical Center Writing Effective Learning Objectives Chris Zakrzewski, MS Ningchun Han, EdD.
Faculty Senate Assessment Committee Facilitator: Katherine Cermak Associate Dean for Planning & Assessment April 2016.
Programming Assessment. Why Do We Assess?!? Because Paul said so?!?
1 IT/Cybersecurity - ICRDCE Conference Day Aligning Program, Course, and Class Objectives / Outcomes.
Learning Goals, Objectives, & Curriculum Mapping Linking curriculum & pedagogy to demonstrations of knowledge, skills, and abilities Dr. Marjorie Dorimé-Williams.
Writing and Revising SLOs with Best Practices in Mind
D2L Refresher Upload content into the Content section in a D2L course
Fullerton College SLOA Workshop:
SLOs: What Are They? Information in this presentation comes from the Fundamentals of Assessment conference led by Dr. Amy Driscoll and sponsored by.
EPAS Presentation. During one of your field seminars, you will present on your field experiences as they relate to CSWE core competencies and practice.
General Education Assessment Subcommittee Report
NJCU College of Education
مركز تطوير التدريس والتدريب الجامعي ورقة بعنوان
مركز تطوير التدريس والتدريب الجامعي ورقة بعنوان إعداد
Mapping Outcomes it’s not so bad.
Critically Evaluating an Assessment Task
Presentation transcript:

“Outcomification”: Development and Use of Student Learning Outcomes Noelle C. Griffin, PhD Director, Assessment and Data Analysis Loyola Marymount University

What are learning outcomes? A learning outcome is a brief, clear statement about what you expect students to demonstrate (in terms of knowledge, behavior, or values) due to their participation in a given learning activity.

Why are learning outcomes important? Communication Students Other faculty Outside of academe Planning Assessment (both micro and macro)

Fun with Terminology: Goals, Objectives, Outcomes Somewhat dependant on the source, but generally: Goals = Represent overall mission of the program, school, department etc. Objectives = Broader perspective on what generally students should know, value or do Outcomes = What students should demonstrate/represent relative to objective

Example Goal: The program will prepare students to consider the ethical implications of choices they make in their lives Objective: Students will be able to understand other's approaches to ethical decision-making Outcome: Students will be able to describe and analyze the ethical frameworks used by themselves and others in decision-making situations

Example Goal: The program will educate students in the basic methods and philosophy to conduct scientific research Objective: Students will be proficient in basic science research skills Outcome: Students will collect and organize data using both field techniques and archrival retrieval

Anatomy of an “Assessable” Learning Outcome Action WordLearning StatementCriterion/Condition AppliesAppropriate quantitative research methodology In designing an experiment AnalyzesA real-world ethical problem Using multiple philosophical theories’ approaches IntegratesMultiple sociological theories In describing the functioning or organizations or institutions

Well-defined learning outcomes Can be understood by students, faculty, and individuals outside of the discipline Are related to program and university goals Are specific enough to be evaluated (i.e., each examines something discrete) Are enough in number/scope to cover the entire program Reflect the unique strengths/character of the program

Bottom Line: No matter what terminology you use, ultimately you want to use your outcomes to describe how your students will show that program goals have been met.

Levels of Learning Outcomes Course Outcomes/Objectives Program Outcomes/Objectives General Ed/CORE Outcomes/Objectives

Mapping: Course Outcomes to Program Outcomes Course 101 Course 203 Course 205 Course 220 Course 323 Course 350 Course 402 LO1 XXXXX LO2 XXXXX LO3 XX LO4 XXXX

Mapping Process Multiple uses (outcome development, but also later assessment design) Bottom-up vs. Top down Too many links: Not specific enough? Too few links: Need for common understanding?

Mapping: CORE Objectives to Program Outcomes CORE 1 CORE 2 CORE 3 CORE 4 CORE 5 CORE 6 CORE 7 CORE 8 CORE 9 LO1XXXXX LO2XXXXX LO3XX LO4XXXX

Constructing Outcomes: Qualities Answer: What do our students’ gain from completing our program? Focus on results/ends of learning, not the means Represent the minimum performance needed to successfully complete a program Rely on action verbs Map to curriculum (macro & micro) Result from collaboration Lend themselves to quantitative or qualitative assessment Reflect equity/fairness (diverse learners) Reflect, not dictate, curriculum

Constructing Outcomes: Strategies Mission statements Professional organizations/licensing boards/scholarly organizations Analysis of courses/syllabi Examinations of culminating student work Ethnography: students and faculty

Organizing Concepts: Bloom’s Taxonomy of Learning Knowledge of terminology (define, identify, describe) Comprehension (discuss, explain, summarize) Application (apply, utilize, interpret) Analysis (analyze, compare, contrast) Synthesis (integrate, organize, construct) Evaluation (appraise, defend, judge)

“Values” as Learning Outcomes More difficult to directly tap into, but should not be left out for that reason “Value” will likely need to be “translated” into more concrete evidence for purposes of assessment You can’t directly observe a value, but can define evidence suggestive of that value

Example: Graduates will value the importance of their belief systems in their life choices. Translates…. Graduates are able to articulate and acknowledge their own deeply held beliefs in responding to ethical dilemmas or problems

Example Graduates will value the role that literature plays in shaping social change. Translates…… Graduates will be able to identify and explain historical instances of the impact and importance of literature in social change.

“Operationalization” or Defining Your Outcomes LOA’s “little secret”: Outcome is not the ending point! Next step after developing learning outcomes Before planning assessment tasks, you need to determine what specifically the outcome will “look like” in the context of student work

Example: LO: Students will be able to apply appropriate quantitative methodology in designing an experiment. What does this entail? Uses systematic sampling strategies Uses random assignment or matched control group Uses “blinding” strategies Etc.

Example: LO: Graduates are able to articulate and acknowledge their own deeply held beliefs in responding to ethnical dilemmas or problems What does this entail? Describes belief system Analyzes the factors involved in an ethical dilemma Identifies ways belief system influenced how they would respond to an ethical dilemma Etc.

Ways to get there Targeted analysis of student work (characteristics of “exemplary” projects) Grading criteria External professional criteria Faculty discussions Standardized tests/exams

References “Assessing for Learning” (2004). Peggy L. Maki, Stylus Press “Assessment Clear & Simple: A Practical Guide for Institutions, Departments, and General Education” (2004). Barbara E. Walvoord, Jossey-Bass.