1. Dr. Mary Ann Coughlin Associate Vice-President for Academic Affairs
Providing Evidence of Educational Effectiveness: Processes, Opportunities, Challenges, and Next Steps
Dr. Mary Ann Coughlin
Associate Vice-President for Academic Affairs

2. Standard 8: Educational Effectiveness
The institution demonstrates its effectiveness by ensuring satisfactory levels of student achievement on mission-appropriate student outcomes. Based on verifiable information, the institution understands what its students have gained as a result of their education and has useful evidence about the success of its recent graduates. This information is used for planning and improvement, resource allocation, and to inform the public about the institution. Student achievement is at a level appropriate for the degree awarded.

3. Springfield College Mission
To educate students in spirit, mind, and body for leadership in service to others

4. Challenges & Opportunities
Good News:
Trying to measure those aspects of your educational experiences that are most important to your institution
Bad News
These important measures of institutional/educational effectiveness are complex

5. Challenges & Opportunities
Good News:
Sometimes simple measures provide robust measures of educational effectiveness
Bad News
Most of the times, those simple measures raise as many questions as they answer
So you need to dig deeper

6. Simple Measure How does the institution address these differences?
Talk about our next steps…
Diversity and Inclusion efforts
Strategic Planning working group to
How does the institution address these differences?
What are the next steps?

7. Challenges & Opportunities
More Challenges:
Sometimes the measures that seem so simple to measure are not commonly defined
Many times important measures are not institutionally collected
Remember:
Not everything that can be counted counts, and not everything that counts can be counted.

8. Definitions!! What is a high-impact practice?
Talk about our next steps…
Diversity and Inclusion efforts
Strategic Planning working group to
What is a high-impact practice?
How can you collect direct evidence of participation in high-impact practices?

9. Fifth Year Interim Report
So How Do You Do That?
Fifth Year Interim Report
Reflective Essay

10. Reflective Essay Process
Was able to leverage a group of individuals who report to AVPAA who are focused on student success:
Coordinator of Institutional Research
Director of Academic Advising
Director of Academic Success Center
Registrar
Coordinator of Undergraduate and Graduate Research

11. Process
Held retreat with Academic Success Group, shared and discussed guidelines for the essay:
The essay should address four related but distinct areas having to do with student achievement and success:
What students gain as a result of their education,
Assessment of student learning; “what and how students are learning”,
Measures of student success, including retention and graduation, and
Satisfactory levels of student achievement on mission-appropriate student outcomes.
The essay should address all student bodies.
Created an outline for the essay.

12. Process Sharing and Reflection are Critical
Shared draft outline with key constituent groups to provide input on the structure and elements of the essay.
Groups included:
Deans and Directors of Academic Affairs
Outcomes Assessment Task Force
First-year Experience Task Force
Worked with the Coordinator of Institutional Research to collect data related to each of the four areas
Wrote first draft of reflective essay.
Draft was written by section, and
Success group served as initial reviewers and contributors to essay.

13. Process Closing the Loop
Draft of reflective essay was completed and shared back with the key constituent groups
Groups included:
Deans and Directors of Academic Affairs,
Outcomes Assessment Task Force, and
First-year Experience Task Force.
Detailed discussions occurred with each group.
Significant revisions and improvements were made to the draft.
Essay was incorporated into draft of final report and review process continued.

14. Tips & Suggestions Use data to tell the story!
Data provides evidence that supports your story
Work data into the narrative as documentation for your description and findings

15. Sample Text
When discussing the success of academic support initiatives:
For example, when reviewing the data on participants in our Academic Progress Program from the Fall of 2014, the student’s semester GPA increased by an average of 1.41 and their cumulative GPA increased on average by This data was subsequently used and shared with students in the orientation to this program. Over the past three years, we have also experienced a steady decrease in the number of students who are placed on academic probation. Comparing Fall 2011 Academic Progress Review data to Fall 2014, a 58 percent decrease was seen in the number of students who were placed on probation (Fall 2011 – 33, Fall 2014 – 16). A similar pattern was found when comparing data across the spring semesters; 33 percent decline (Spring 2012 – 21, Spring 2015 – 14).

16. Tips & Suggestions Use graphs appropriately!
A picture is worth a thousand words (or numbers)
But graphs take up a lot of space, so choose wisely
If graph simply compares two groups, not worth the space.
Write a sentence that documents the differences between the two groups.
If graph is too complicated it is not readable and will not tell the story.
What are the important aspects of the graph – simplify.
Find the right balance.

17. Sample Graph

18. Continuing Challenges & Next Steps
Discussions of what are high-impact practices at Springfield College
Reviewing/revising outcomes assessment protocol for our institutional learning outcomes
How do we code and document important elements that match our co-curricular philosophy?
Do we consider co-curricular transcript?
Do we consider use of eportfolio?

19. New Strategic Planning Process
9 out of 10 organizations
fail
to execute their strategic plan
Data from: Kaplan and Norton | The Strategy-Focused Organization

20. The mission of Springfield College is to educate students
Springfield College will be at the forefront of the changing needs of society by creating leaders who make meaningful contributions that improve the well-being of others.
Strategic
Growth
& Visibility
Academic Programs for the 21st Century
The
Springfield College
Experience
Sustainable
Foundation
Expand Our Academic Portfolio Consistent with Mission
Mission Driven Innovative Partnerships
Roll Out of
Branding Strategy
Foster a Culture
of Inclusion
Stakeholders
Financial Efficiency & Sustainability
Financial Efficiency
Financial Efficiency
Financial Efficiency
Financial Resources
Net Revenue
Tuition
Net Revenue Retention
Net Revenue Retention / Tuition
Net Revenue Fundraising
Assess Current School Structure, Programs & Services
Student Centered System for Increased participation in Engaged Learning
Evaluate and Improve Enrollment Processes
Integrated Technology
Systems
Internal Processes
Objectives – Larger.. May have multiple initiatives associated with these objectives…
Evaluate and Enhance Enrollment Strategies and Initiatives
Refresh the
General Education Program for Relevance
Aligning
Faculty & Staff Development with Strategic Initiatives
Institutional Commitment to Constituency Development
Organizational Capacity
The mission of Springfield College is to educate students
in spirit, mind, and body for leadership in service to others.

21. The mission of Springfield College is to educate students
Springfield College will be at the forefront of the changing needs of society by creating leaders who make meaningful contributions that improve the well-being of others.
Strategic
Growth
& Visibility
Academic Programs for the 21st Century
The Springfield College
Experience
Sustainable
Foundation
Website Development/ Messaging Consistency
Explore New Academic Programs & Formats
Diversity Plan
Launch Center for Leadership and Civic Engagement
Develop & Explore Strategic Partnerships
Stakeholders
Financial Efficiency & Sustainability
Financial Efficiency
Financial Efficiency
Financial Efficiency
Financial Resources
Net Revenue
Tuition
Net Revenue Retention
Net Revenue Retention / Tuition
Net Revenue Fundraising
Processes and Procedures for All Students (Graduate, Undergraduate, Transfer)
Comprehensive Review of Academic Support Programs and Services
Intentionally Integrate & Increase Participation in Engaged Learning and High Impact Practices
Strengthen & Build Appropriate Bridges Between Technology Systems
Internal Processes
ACT / SAT Optional
Financial Aid/Affordability
Design/Build Center for Teaching & Learning
Develop/Implement EE Training Systems
Living Learning Communities
Identify Key Constituencies and System for Peer to Peer Fundraising
Increase Corporate/Foundation Giving & Government Grants
General Education Review and Revision
Organizational Capacity
The mission of Springfield College is to educate students
in spirit, mind, and body for leadership in service to others.

23. Questions / Discussion
Contact Information:
Mary Ann Coughlin
Associate Vice-President for Academic Affairs