Dr. Mary Ann Coughlin Associate Vice-President for Academic Affairs Providing Evidence of Educational Effectiveness: Processes, Opportunities, Challenges, and Next Steps Dr. Mary Ann Coughlin Associate Vice-President for Academic Affairs

Standard 8: Educational Effectiveness The institution demonstrates its effectiveness by ensuring satisfactory levels of student achievement on mission-appropriate student outcomes. Based on verifiable information, the institution understands what its students have gained as a result of their education and has useful evidence about the success of its recent graduates. This information is used for planning and improvement, resource allocation, and to inform the public about the institution. Student achievement is at a level appropriate for the degree awarded.

Springfield College Mission To educate students in spirit, mind, and body for leadership in service to others

Challenges & Opportunities Good News: Trying to measure those aspects of your educational experiences that are most important to your institution Bad News These important measures of institutional/educational effectiveness are complex

Challenges & Opportunities Good News: Sometimes simple measures provide robust measures of educational effectiveness Bad News Most of the times, those simple measures raise as many questions as they answer So you need to dig deeper

Simple Measure How does the institution address these differences? Talk about our next steps… Diversity and Inclusion efforts Strategic Planning working group to How does the institution address these differences? What are the next steps?

Challenges & Opportunities More Challenges: Sometimes the measures that seem so simple to measure are not commonly defined Many times important measures are not institutionally collected Remember: Not everything that can be counted counts, and not everything that counts can be counted.

Definitions!! What is a high-impact practice? Talk about our next steps… Diversity and Inclusion efforts Strategic Planning working group to What is a high-impact practice? How can you collect direct evidence of participation in high-impact practices?

Fifth Year Interim Report So How Do You Do That? Fifth Year Interim Report Reflective Essay

Reflective Essay Process Was able to leverage a group of individuals who report to AVPAA who are focused on student success: Coordinator of Institutional Research Director of Academic Advising Director of Academic Success Center Registrar Coordinator of Undergraduate and Graduate Research

Process Held retreat with Academic Success Group, shared and discussed guidelines for the essay: The essay should address four related but distinct areas having to do with student achievement and success: What students gain as a result of their education, Assessment of student learning; “what and how students are learning”, Measures of student success, including retention and graduation, and Satisfactory levels of student achievement on mission-appropriate student outcomes. The essay should address all student bodies. Created an outline for the essay.

Process Sharing and Reflection are Critical Shared draft outline with key constituent groups to provide input on the structure and elements of the essay. Groups included: Deans and Directors of Academic Affairs Outcomes Assessment Task Force First-year Experience Task Force Worked with the Coordinator of Institutional Research to collect data related to each of the four areas Wrote first draft of reflective essay. Draft was written by section, and Success group served as initial reviewers and contributors to essay.

Process Closing the Loop Draft of reflective essay was completed and shared back with the key constituent groups Groups included: Deans and Directors of Academic Affairs, Outcomes Assessment Task Force, and First-year Experience Task Force. Detailed discussions occurred with each group. Significant revisions and improvements were made to the draft. Essay was incorporated into draft of final report and review process continued.

Tips & Suggestions Use data to tell the story! Data provides evidence that supports your story Work data into the narrative as documentation for your description and findings

Sample Text When discussing the success of academic support initiatives: For example, when reviewing the data on participants in our Academic Progress Program from the Fall of 2014, the student’s semester GPA increased by an average of 1.41 and their cumulative GPA increased on average by 0.60. This data was subsequently used and shared with students in the orientation to this program. Over the past three years, we have also experienced a steady decrease in the number of students who are placed on academic probation. Comparing Fall 2011 Academic Progress Review data to Fall 2014, a 58 percent decrease was seen in the number of students who were placed on probation (Fall 2011 – 33, Fall 2014 – 16). A similar pattern was found when comparing data across the spring semesters; 33 percent decline (Spring 2012 – 21, Spring 2015 – 14).

Tips & Suggestions Use graphs appropriately! A picture is worth a thousand words (or numbers) But graphs take up a lot of space, so choose wisely If graph simply compares two groups, not worth the space. Write a sentence that documents the differences between the two groups. If graph is too complicated it is not readable and will not tell the story. What are the important aspects of the graph – simplify. Find the right balance.

Sample Graph

Continuing Challenges & Next Steps Discussions of what are high-impact practices at Springfield College Reviewing/revising outcomes assessment protocol for our institutional learning outcomes How do we code and document important elements that match our co-curricular philosophy? Do we consider co-curricular transcript? Do we consider use of eportfolio?

New Strategic Planning Process 9 out of 10 organizations fail to execute their strategic plan Data from: Kaplan and Norton | The Strategy-Focused Organization

The mission of Springfield College is to educate students Springfield College will be at the forefront of the changing needs of society by creating leaders who make meaningful contributions that improve the well-being of others. Strategic Growth & Visibility Academic Programs for the 21st Century The Springfield College Experience Sustainable Foundation Expand Our Academic Portfolio Consistent with Mission Mission Driven Innovative Partnerships Roll Out of Branding Strategy Foster a Culture of Inclusion Stakeholders Financial Efficiency & Sustainability Financial Efficiency Financial Efficiency Financial Efficiency Financial Resources Net Revenue Tuition Net Revenue Retention Net Revenue Retention / Tuition Net Revenue Fundraising Assess Current School Structure, Programs & Services Student Centered System for Increased participation in Engaged Learning Evaluate and Improve Enrollment Processes Integrated Technology Systems Internal Processes Objectives – Larger.. May have multiple initiatives associated with these objectives… Evaluate and Enhance Enrollment Strategies and Initiatives Refresh the General Education Program for Relevance Aligning Faculty & Staff Development with Strategic Initiatives Institutional Commitment to Constituency Development Organizational Capacity The mission of Springfield College is to educate students in spirit, mind, and body for leadership in service to others.

The mission of Springfield College is to educate students Springfield College will be at the forefront of the changing needs of society by creating leaders who make meaningful contributions that improve the well-being of others. Strategic Growth & Visibility Academic Programs for the 21st Century The Springfield College Experience Sustainable Foundation Website Development/ Messaging Consistency Explore New Academic Programs & Formats Diversity Plan Launch Center for Leadership and Civic Engagement Develop & Explore Strategic Partnerships Stakeholders Financial Efficiency & Sustainability Financial Efficiency Financial Efficiency Financial Efficiency Financial Resources Net Revenue Tuition Net Revenue Retention Net Revenue Retention / Tuition Net Revenue Fundraising Processes and Procedures for All Students (Graduate, Undergraduate, Transfer) Comprehensive Review of Academic Support Programs and Services Intentionally Integrate & Increase Participation in Engaged Learning and High Impact Practices Strengthen & Build Appropriate Bridges Between Technology Systems Internal Processes ACT / SAT Optional Financial Aid/Affordability Design/Build Center for Teaching & Learning Develop/Implement EE Training Systems Living Learning Communities Identify Key Constituencies and System for Peer to Peer Fundraising Increase Corporate/Foundation Giving & Government Grants General Education Review and Revision Organizational Capacity The mission of Springfield College is to educate students in spirit, mind, and body for leadership in service to others.

Questions / Discussion Contact Information: Mary Ann Coughlin Associate Vice-President for Academic Affairs mcoughlin@springfieldcollege.edu