Developing and Assessing Outcomes in the Co-Curricular Experience Prepared for Auburn University’s Division of Student Affairs A-Team April 2, 2013 Sandi.

Slides:



Advertisements
Similar presentations
The PRR: Linking Assessment, Planning & Budgeting PRR Workshop – April 4, 2013 Barbara Samuel Loftus, Ph.D. Misericordia University.
Advertisements

Assessment in Student Affairs at The University of Memphis Active learning: Comment at Twitter #umassess Polleverywhere = pollev.com; text from phone Take.
Bridging Research, Information and Culture An Initiative of the Research and Planning Group for California Community Colleges Your Name Your Institution.
Strategic Planning An Overview. General Definition The process of strategic planning involves deciding where you want to go, how you want to be positioned,
Assessment Plans Discussion Career Services Julie Guevara, Accreditation & Assessment Officer February 6, 2006.
Assessment of Learning at the Peralta Community Colleges Engaging the College Community in Assessment Opportunities and Transforming the Institutional.
NCCEA Annual Conference Waynesville, NC Assessment Basics: Implementing and Sustaining a Comprehensive, Outcomes-Based Assessment Plan October 19, 2006.
An Assessment Primer Fall 2007 Click here to begin.
ELAC SLO RETREAT 2009 Veronica Jaramillo, Ph.D. Mona Panchal Anthony Cadavid ELAC SLO RETREAT 2009.
ASSESSMENT WORKSHOP: SESSION 1 ADMINISTRATIVE SUPPORT SERVICES ACADEMIC AND STUDENT SUPPORT SERVICES PRESENTED BY THE DIVISION OF INSTITUTIONAL EFFECTIVENESS.
Are you Using Technology to Assess Learning or Assessing Learning to Improve Technology? Marilee J. Bresciani, Ph.D. Associate Professor, Postsecondary.
The Academic Assessment Process
Introduction to teaching and assessing so students will learn more using learner-centered teaching Phyllis Blumberg Warm-up activity How can instructor’s.
SURVEYS, OBSERVATIONS, AND RUBRICS OH MY! ASSESSING CAREER SERVICES Jessica M. Turos Bowling Green State University Career Center.
Writing an Effective Assessment Plan
Developing an Assessment Plan Owens Community College Assessment Day Workshops November 13-14, 2009 Anne Fulkerson, Ph.D. Institutional Research.
Student Services Assessment Lee Gordon Assistant Vice President for Student Services Purdue University.
Reaffirmation of Accreditation: Institutional Effectiveness Southern Association of Colleges and Schools February 2008 Stephen F. Austin State University.
NAVIGATING THE WATERS: USING ASSESSMENT TO MAKE A DIFFERENCE Amy Harper, Area Coordinator, Fordham University Greer Jason, PhD, Assistant Dean of Students,
Assessment 101: Back-to-Basics An Introduction to Assessing Student Learning Outcomes.
Outcomes Assessment and Program Effectiveness at Florida Atlantic University : Student Affairs Gail Wisan, Ph.D. July 13, 2010.
Mia Alexander-Snow, PhD Director, Office for Planning and Institutional Effectiveness Program Review Orientation 1.
Assessing Student Learning: What Kapi‘olani Community College is Doing Kristine Korey-Smith, Assessment Coordinator Louise Pagotto, Interim Vice Chancellor.
Adolescent Sexual Health Work Group (ASHWG)
Closing the Loop in Assessment.
Overhaul of a Graduate Program in Arts Administration Master of Arts in Arts Administration – Initiated in 2003 – Low-residency—one weekend per month (over.
Assessing Student Learning Outcomes in Student Development – Part I Student Development Division Meeting SUNY Oneonta May 9, 2008.
August 3,  Review “Guiding Principles for SLO Assessment” (ASCCC, 2010)  Review Assessment Pulse Roundtable results  Discuss and formulate our.
NASPA Presentation Practical Tools for Building Division-wide Assessment Capacity Adrienne Dumpe, Graduate Assistant, VPSA Katie O’Dair, Director of Assessment.
Evidence of Success: Assessing Student Learning Outcomes in International Education Dr. Darla K. Deardorff Association of International Education.
Focus on Learning: Student Outcomes Assessment and the Learning College.
Bill Knight Institutional Effectiveness Student Affairs Assessment: Developing an Effective Assessment Plan.
LEARNING OUTCOMES WORKSHOP Dr. Jan Hillman University of North Texas January 8, 2007.
Student Affairs Assessment: Using Student Learning Outcomes for Continuous Improvement Evaluating Institutional Learning-Centeredness Conference Center.
Closing the Loop: The Assessment Process from Outcomes to Academic Excellence, Budgetary Competence and Community Engagement.
Student Learning Outcome Assessment: A Program’s Perspective Ling Hwey Jeng, Director School of Library and Information Studies June 27,
2012 Regional Assessment Workshops Session 2 Dr. Maryellen Cosgrove, Dean School of Business, Education, Health and Wellness Gainesville State University.
Unit 1 – Preparation for Assessment LO 1.1&1.2&1.3.
Creating a Culture of Student Affairs Assessment Katie Busby, Ph.D. Jessica Simmons Office of Student Affairs Assessment & Planning University of Alabama.
Closing the Loop: The Assessment Process from Outcomes to Academic Excellence, Budgetary Competence and Community Engagement January 2012.
Assessing Student Learning Lynn Merklin Assistant Provost Office of Institutional Effectiveness August, 2014.
KATHY CLARK PETERSEN, PH.D. STUDENT DEVELOPMENT, ASSISTANT TO THE VICE PRESIDENT MICHELLE CHEATEM ASSOCIATE DEAN OF STUDENTS JASPA SUMMER INSTITUTE JULY.
Assessment Workshop College of San Mateo February 2006.
Foundations of Assessment I Understanding the Assessment Process.
Thinking Beyond Surveys: Developing an Assessment Plan for Your DS Office Kristie Orr, Ph.D. Director, Disability Services and Paul Harwell, M.A. Accommodations.
Allison Bridgeman Director of Residence Life Elizabethtown College.
Presenters: Erin Nunn, Jarrett Kealey, and Katelin Getz Ohio University.
Assessing Your Assessments: The Authentic Assessment Challenge Dr. Diane King Director, Curriculum Development School of Computer & Engineering Technologies.
Assessment in Student Affairs: Campus Life Programs Dan Bureau Mahauganee Shaw.
Strengthening Student Success Summit Strengthening Student Success Summit November 17, Student Services and Student Success Assessment, Dialogue.
A Basic Guide to Academic Assessment Presented by Darby Kaikkonen Director of Institutional Research.
Assessment of Student Learning in General Education AAHE/NCA 2003 Assessment Workshop Omaha, Nebraska ● June 2003.
Learning Goals at St. John Fisher College Peter J. Gray, Ph.D. Director of Academic Assessment United States Naval Academy May 2004.
What Your Program Needs to Know about Learning Outcomes Assessment at UGA.
2008 Spring Semester Workshop AN INTRODUCTION TO STRATEGIC PLANNING AND ASSESSMENT WORKSHOP T. Gilmour Reeve, Ph.D. Director of Strategic Planning.
1 Learning Outcomes Assessment: An Overview of the Process at Texas State Beth Wuest Director, Academic Development and Assessment Lisa Garza Director,
Intentionally Targeting Student Learning Outcomes through Course Assessment and Design Patty Roberts, Ph.D. Patricia Noteboom, Ph.D NASPA INTERNATIONAL.
Presentation on Outcomes Assessment Presentation on Outcomes Assessment toCCED Mohawk Valley Community College October 11, 2004.
2009 TACUSPA Fall Conference October 5, 2009 El Paso, Texas.
December 9, 2010 Laura A. Bayless, PhD Dean of Students St. Mary’s College of Maryland.
Assessment 101: Or Why and How to Assess ACRAO Spring Conference 2011 Presenter: Gladys Palma de Schrynemakers.
ASSESSING STUDENT LEARNING AND DEVELOPMENT By Dr. Clarice Ford.
Assessment Strategies for Student Affairs
Assessment in student life
Learning Without Borders: From Programs to Curricula
Consider Your Audience
Student Affairs Assessment
Effective Outcomes Assessment
Assessment & Evaluation workshop
Presented by: Skyline College SLOAC Committee Fall 2007
Presentation transcript:

Developing and Assessing Outcomes in the Co-Curricular Experience Prepared for Auburn University’s Division of Student Affairs A-Team April 2, 2013 Sandi Osters, Ph.D. Retired Director, Student Life Studies Texas A&M University 3001 Aztec Street College Station, TX

Workshop Overview Student integrative learning Outcomes-based assessment Learning outcomes – the heart of the matter Working sessions Assessment methods Working sessions Reflective dialogue

Today’s Program Outcomes The presenter will: Work on issues important to participants Provide a general understanding about the importance of outcomes based assessment in student affairs Emphasize the importance of alignment with division and university mission, goals and planning Emphasize the use of data to inform practice

Today’s Learning Outcomes Participants will: Describe learning and program outcomes for their own program, office or activity Employ assessment methods for their outcomes Develop initial action steps Articulate what they have learned and what they still need to know

Handouts PowerPoint Writing Outcomes Assessment Plan Template Rubrics Everything You Ever Wanted to Know about Assessment – on One Page

It’s All About Students’ Integrative Learning A strong emphasis on student learning is the primary key to retention through graduation Learning is the primary activity and goal of the college environment – both inside and outside of the classroom The integration of academic programs and co- curricular activities is important The ability of students to integrate their learning both inside and outside of the classroom – be responsible for their own learning – is of the greatest importance

What Is Student Learning in the Co-curricular? “ Learning Reconsidered defines learning as a comprehensive, holistic, transformative activity that integrates academic learning and student development, processes that have often been considered separate, and even independent of each other.” “Student learning produces both educational and developmental outcomes; distinguishing them is pointless and potentially harmful, and the goal of higher education should be the integration of all domains of learning and of the work of all educators.” Keeling, R. P. (Ed.) (2004). Learning Reconsidered. Washington, D.C.: NASPA and ACPA.

What is Assessment and Evaluation? “Assessment is any effort to gather, analyze, and interpret evidence which describes institutional, departmental, divisional or agency effectiveness.” “Evaluation is any effort to use assessment evidence to improve institutional, departmental, divisional, or agency effectiveness.” Upcraft, M. & Schuh, J. (1996). Assessment in student affairs: A guide for practitioners. San Francisco: Jossey-Bass.

The Purpose of Outcomes Based Assessment To answer some simple questions: What is it that we do? Why do we do it? How well do we do it? How do we know that we do it well? What improvements and changes do we make from what we learn? Do the improvements work? To genuinely engage faculty, staff and students in the day-to-day reflection of answering these simple questions To demonstrate a commitment to systematic examination of the quality of all we do to improve our programs and departments

The Purpose of Outcomes Based Assessment, continued To celebrate our successes and learn from our failures To inform our policy, programs, processes and resource allocations Increase our confidence that we are putting our time and energy into activities that results in the outcomes we and our students value To have the data to support why our programs generate the learning Auburn wants for its students in times of financial downsizing To be able to articulate exactly how student affairs professionals contribute to student learning and student development To gather and display data that will allow us to satisfy accrediting agencies and program reviews (CAS or your own)

Advantages of Using Outcomes Language in Student Affairs Make it clear to students who participate in our programs, activities and services what they can expect to gain from doing so Make it clear to others what the program will accomplish and, where appropriate, what students will learn Help staff select appropriate strategies and assessment measures/methods to reach the outcomes

Advantages of Using Outcomes Language in Student Affairs Apply the results of our assessments for meaningful improvement and/or change Move beyond student satisfaction and tracking the use of services as the sole means of describing student affairs effectiveness Connect Student Affairs to the academic enterprise – we all are about student learning – we all are educators

What Any Assessment is NOT Assessment does not exist for assessment’s sake It informs but does not drive where you want to go and what you want to be as an office, activity, program It is not used for personnel evaluation It is not a one time thing – but systematic and iterative It does not assess all things, all the time

Outcomes Based Assessment and Decision Making Most importantly, Outcomes based decision making and assessment should be Understood = by faculty/professionals and students Meaningful = faculty/professional (i.e., expert) driven Inclusive = involve as many faculty, student affairs professionals and students as possible Manageable = takes into account varying resources Flexible = takes into account assessment learning curves Truth-seeking/objective/ethical Iterative and systematic Inform decisions for continuous improvement or provides evidence of proof Promote a culture of accountability, of learning, and of improvement Bresciani, J. J., Zelna, C. L., & Anderson, J. A. (2004). Techniques for assessing student learning and development: A handbook for practitioners. Washington, D.C.: NASPA, Inc.

Mission/Purpose Goals Objectives/Outcomes Implement Methods to Deliver Outcomes and Methods to Gather Data Gather Data Interpret Evidence Make decisions to improve programs; enhance student learning and development; inform institutional decision- making, planning, budgeting, policy, public accountability Politics Scholarship Accountability Environment Assessment Cycle Budget

Writing Outcomes Outcomes – Detailed, specific, measurable or identifiable, and personally meaningful statements that are derived from goals and articulate what the end result of a unit, program, course, activity, or process is. Learning Outcomes – An easily identified action that a student is expected to demonstrate in terms of knowledge, skills, and attitudes upon completion of a program/activity/event. Program/process outcomes – The end result of what a program or process is to do, achieve, or accomplish. Write simply and with one outcome per statement

Bloom’s Taxonomy (1956) A structure for developing learning outcomes

Learning Outcomes? Students will be satisfied with the information received. Students will rate the service received positively. Students will create their own personal leadership philosophy based on three models taught in Lead 101 in the fall semester After the service project, students will be able to articulate the root cause of homelessness in Auburn, Alabama.

Disability Services Example Learning outcome Students will be able to describe their functional limitations in an academic setting Assessment method Pre-test/post-test (intake form) Rubric Criteria for success/achievement target Students post-scores will improve over pre-test

Disability Services Example Learning outcome Students will be able to describe how their disability may affect them in the workplace and what accommodations they may need to ask for from their employers Assessment method Exit interviews with graduating students Criteria for success/achievement target 80% of students in their graduating semester will be able to identify at least one way their disability might effect them in the workplace.

Program/Process Outcomes? Students will like the conference banquet The professional development sub-committee will offer two dining etiquette programs in the fall semester for graduating students Develop and expand the Student Health Services web page in order to increase student access to health information, patient services and educational programming

Examples of Program Outcomes The Department of Residence Life will be able to respond to maintenance requests within 24 hours of their walk-in time The Student Health Service will be able to admit students for check-ups within 24 hours of their walk-in time. The Financial Aid Office will have full award letters out to the on-time complete applicants by April 15th.

Program Outcome Example Program outcome Develop and expand the Student Health Services webpage in order to increase student access to health information, patient services, educational programming Assessment methods Data retrieval from webpage interactions Annual patient survey to determine student utilization of the web page Survey instruments by Health Education program to determine student utilization of web page Criteria for success/achievement target Increase in the utilization of the SHS webpage regarding health information, patient services and educational programming.

Common Mistakes in Writing Learning Outcomes The learning outcomes don’t align with department, division or university goals Outcomes include words that are hard or impossible to measure (understand, appreciate, know about, become familiar with, learn about, become aware of) Outcomes include too many skills in one statement Outcomes measure satisfaction or performance evaluation rather than learning of the student There are too many learning outcomes Only one person wrote, reviewed, edited and implemented the outcome

Working Session Work in small groups of two or three Develop at least two learning outcomes and two program outcomes for the Division of Student Affairs Global Service Initiative (mission provided) Don’t worry about being an expert on this initiative. Pretend you are. What’s important is working on the outcomes Share time

Assessment Methods Qualitative and quantitative One time and longitudinal Direct - requires students to display their knowledge, behavior or thought processes Indirect – asks students to reflect upon their knowledge, behaviors or though processes Local (Auburn developed) and national assessments (like the NSSE or CIRP)

Direct Measures Benefits of direct measures to Student Affairs Provides faculty and administrators more confidence in the measures and their results because it is the academic standard Helps with accreditors who are looking for student learning in the co-curricular and measures of same Challenges Time and expertise needed to develop Assessing the “fuzzies” – attitudes and values Small “n’s” and the validity of the studies Bottom line Use multiple indirect measures to offset the lack of direct measures

Common (and still viable) Assessment Measures Surveys to inform of needs and satisfaction Surveys to assess outcomes Focus groups/interviews to inform future assessments or to dig more deeply into existing survey results Tracking use and participation (numbers)

New Wave of Assessment Measures Exit Interviews Learning contracts Photography Pre and post tests of knowledge Observations with documentation One minute papers Rubrics Reflective journals Reflective conversations/writing Combination of the above

Working Session Working individually, develop at least two learning outcomes for a program or activity of interest to you. If you do not work directly with student learning, consider learning outcomes for your student workers Develop at least one assessment measure for each outcome and address how you will know if you have been successful (criteria for success/achievement target) Work in small groups and share your outcomes and measures. As a group, develop an action plan (see Assessment Plan Template, Implementation of Assessment Process) for one of the learning outcomes in your group Share

Sharing Your Assessment Data Have clear objectives/purpose Know who cares about your results Effectively analyze the data Effectively report/present results Determine the best format – written reports, websites, newsletters, publications, oral presentations Use the data yourself – role model to others Share with each other – assessment road shows/poster sessions at division meetings/monthly during the A-Team meetings Share with students!! What actions have you taken from what you have learned from them?

In Summation Be clear about who you are, why you do what you do, how well you do what you do, and how you improve and change Check in annually to be sure your program/activity and event outcomes align with your departmental mission/goals and that your departmental mission aligns with the division’s mission/goals and strategic plan and that your division mission/goals align with institutional mission/goals/strategic plan/QEP Be patient; you will get better at writing outcomes; you always will have more to learn! Practice, practice, practice and learn by teaching others Work with your students and student groups to articulate outcomes for their programs Work with colleagues, faculty and others with expertise Celebrate your accomplishments

Contact Information Sandi Osters, Ph.D. Retired Director, Student Life Studies Texas A&M University 3001 Aztec Street College Station, TX