Meeting MSCHE Assessment Expectations

Slides:



Advertisements
Similar presentations
The Commissions Expectations for the Assessment of Student Learning and Institutional Effectiveness Beth Paul Interim Provost and Vice President for Academic.
Advertisements

The PRR: Linking Assessment, Planning & Budgeting PRR Workshop – April 4, 2013 Barbara Samuel Loftus, Ph.D. Misericordia University.
MSCHE Standards: Institutional Effectiveness (7) and Student Learning (14) Dr. Jo Allen, Senior Vice President & Provost Widener University.
1 Higher Education Opportunity Act: Implications for the PRR Ellie A. Fogarty – Vice President Barbara Samuel Loftus – Vice President MSCHE PRR Workshop.
Understanding MSCHE Expectations for Governance Ellie A. Fogarty, Vice President Middle States Commission on Higher Education 2010 Annual Conference Philadelphia,
Understanding Middle States Expectations for Assessment
Follow-up Reporting Expectations MSCHE Annual Conference 2009 Mary Ellen Petrisko.
MSCHE Follow-up Reporting Expectations MSCHE Annual Conference 2010 Mary Ellen Petrisko Linda Suskie.
Understanding MSCHE Expectations for Follow-Up Reports Linda Suskie Website:
1 Mid-Term Review of The Illinois Commitment Assessment of Achievements, Challenges, and Stakeholder Opinions Illinois Board of Higher Education April.
Graduation and Employment: Program Evaluation Using Dr. Michele F. Ernst Chief Academic Officer Globe Education Network.
SLO Assessment Departmental Tools and Examples from the Field Sacramento City College Fall Flex Workshop 8/21/08 8/21/08Presenters: Alan Keys Faculty Research.
What “Counts” as Evidence of Student Learning in Program Assessment?
Understanding MSCHE Expectations for Assessment Linda Suskie, Vice President Middle States Commission on Higher Education 3624 Market Street, Philadelphia.
Gwinnett Teacher Effectiveness System Training
Developing a State Strategy for Developmental Education Bruce Vandal, Education Commission of the States September 1, 2011.
The Board’s Role in Accreditation Michael F. Middaugh Associate Provost for Institutional Effectiveness University of Delaware Celine R. Paquette Trustee,
Best Practices in Assessment, Workshop 2 December 1, 2011.
How to Interpret and Apply the Characteristics of Excellence: A Framework for Determining Compliance Karen Stout, President Montgomery County Community.
Enhancing Excellence in Assessment: Being Successful with MSCHE Standards 7 & 14 Deborah Moeckel Nancy Willie-Schiff SUNY Council on Assessment November.
- Overview- Program Review and SLOs Preparing to Write the Self-Study Why? What? How? For more SLO resources see:
An Assessment Primer Fall 2007 Click here to begin.
Assessment: Expectations of Middle States Assessment Forum President’s Conference Room #1 May 14, 2009.
Understanding and Using Assessment Results Linda Suskie, Vice President Middle States Commission on Higher Education 3624 Market Street, Philadelphia PA.
Understanding Middle States’ Expectations for Assessment Linda Suskie, Vice President Middle States Commission on Higher Education 3624 Market Street,
ASSESSMENT SYSTEMS FOR TSPC ACCREDITATION Assessment and Work Sample Conference January 13, 2012 Hilda Rosselli, Western Oregon University.
Columbia-Greene Community College The following presentation is a chronology of the College strategic planning process, plan and committee progress The.
Program Assessment Workshop Kathleen Harring. What is Assessment? Assessment is the systematic gathering and analysis of information to inform and improve.
Welcome… The attendee will understand assessment basics with a focus on creating learning activities and identifying assessment expectations. Apply the.
Assessment 101: Back-to-Basics An Introduction to Assessing Student Learning Outcomes.
Accrediting Commission for Community and Junior Colleges of the Western Association of Schools and Colleges.
Student Achievement Teacher and Leader Effectiveness Principal Professional Growth and Effectiveness System Field Test Overview.
Periodic Program Review for Academics Affirming Excellence in Education LaMont Rouse Executive Director of Assessment, Accreditation & Compliance.
Helping Your Department Advance and Implement Effective Assessment Plans Presented by: Karen Froslid Jones Director, Institutional Research.
Alternative Pay Program Guidelines for Managers July 2012.
Documenting How WTCS Colleges Assess Learning Outcomes.
Assessing Student Learning Lynn Merklin Assistant Provost Office of Institutional Effectiveness August, 2014.
Organizing for General Education Assessment Linda Suskie, Vice President Middle States Commission on Higher Education 3624 Market Street, Philadelphia.
Developing a Teaching Portfolio for the Job Search Graduate Student Center University of Pennsylvania April 19, 2007 Kathryn K. McMahon Department of Romance.
Full-Time Faculty In-Service: Program and Student Learning Outcomes Fall 2005.
Designing Local Curriculum Module 5. Objective To assist district leadership facilitate the development of local curricula.
Improving the Institutional Effectiveness Process 1.
What Does Middle States Want? Linda Suskie, Vice President Middle States Commission on Higher Education 3624 Market Street, Philadelphia PA Web:
What could we learn from learning outcomes assessment programs in the U.S public research universities? Samuel S. Peng Center for Educational Research.
Lessons Learned about Going to Scale with Effective Professional Development Iris R. Weiss Horizon Research, Inc. February 2011.
Federal Update: Part II NASDTEC Allison Henderson, Westat June 7, 2015.
Practicing Meaningful Learning Outcomes Assessment at UGA Department of Crop and Soil Sciences August 10, 2015 Dr. Leslie Gordon Associate Director for.
Program Framework Review November 2011 Pamela Miller, Ph.D. AVP for Learning.
A Basic Guide to Academic Assessment Presented by Darby Kaikkonen Director of Institutional Research.
VT University Libraries: Identifying, Teaching, and Assessing What Matters Most Office of Academic Assessment Ray Van Dyke,
Assessment & Program Review President’s Retreat 2008 College of Micronesia - FSM May 13 – 15, 2008 FSM China Friendship Sports Center.
What Your Program Needs to Know about Learning Outcomes Assessment at UGA.
2008 Spring Semester Workshop AN INTRODUCTION TO STRATEGIC PLANNING AND ASSESSMENT WORKSHOP T. Gilmour Reeve, Ph.D. Director of Strategic Planning.
Accreditation Update and Institutional Student Learning Outcomes Deborah Moeckel, SUNY Assistant Provost SCoA Drive in Workshops Fall 2015
Committee on University Effectiveness Working Group on Institutional Assessment April 8, 2011.
Getting Ready for the Higher Learning Commission (NCA) July 2011 Dr. Linda Johnson HLC/Assessment Coordinator/AQIP Liaison Southeast Technical Institute.
A Commitment to Continuous Improvement in Teaching and Learning Michaela Rome, Ph.D. NYU Assistant Vice Provost for Assessment.
Institutional Effectiveness at MVCC Institutional Effectiveness at MVCC.
Incorporating Program Assessment into Your Annual Program Review June 29, 2006.
Model of an Effective Program Review October 2008 Accrediting Commission for Community and Junior Colleges.
Changing Expectations for Assessment Linda Suskie Assessment & Accreditation Consultant AICUP.
The Assessment Process: A Continuous Cycle
Effective Outcomes Assessment
Assessment Committee Meeting Continuous Program Improvement
Assessment Presentation
Assessment Leadership Day Continuous Program Improvement
Program Assessment Processes for Developing and Strengthening
Presented by: Skyline College SLOAC Committee Fall 2007
What to do with your data?
Fort Valley State University
Presentation transcript:

Meeting MSCHE Assessment Expectations Middle States Commission on Higher Education Self-Study Institute November 2011 Meeting MSCHE Assessment Expectations Linda Suskie, Vice President Middle States Commission on Higher Education http://Linda.Suskie.home.comcast.net Linda.Suskie@comcast.net

Standards 1, 2, and 7: The Planning-Assessment Cycle 2. Programs & Services 1. Goals 3. Assessment 4. Using Results 2

Standards 11, 12, and 14: The Teaching-Learning-Assessment Cycle 2. Learning Opportunities 1. Learning Goals 3. Assessment 4. Using Results 3

Understanding Standards 7 & 14 Six Rules

Read the directions. Tie assessments to important goals. Use more than one measure. Include some “direct” (explicit) evidence.

Direct Evidence Explicit, clear, & convincing Tests (local or published) Rubrics (local or published) Certification or licensure exams Field experience supervisor evaluations

Indirect Evidence Optional, implicit and insufficient by itself Job placement rates & salaries Retention & graduation rates Course grades & pass rates Transfer rates Surveys of students & alumni

Read the directions. Tie assessments to important goals. Use more than one measure. Include some “direct” (explicit) evidence. Keep it useful… and used. Keep doing something everywhere, every year.

What Might an Evaluator Ask?

1. What is your mission and environment?

2. What do you most want students to learn? Why? After they graduate What should they be prepared to DO? How should they USE what they learn? ...in your program or core requirement? 11

3. What else do you most want to achieve? Mission Strategic goals Other important goals 12

4. What evidence do you have that you and your students are achieving those goals? Outcomes – not just strategies & processes 13 13

5. Are you satisfied with your evidence? Why or why not? What are your standards for success? Are they appropriately rigorous? Are your results of sufficient quality that you can answer this? Systematic, not anecdotal or scattershot 14 14

6. If not, what are you doing about it? Strategic goals & plans based on assessment evidence Funding priority to requests supported by assessment evidence 15 15

Determining Compliance How much is enough? This is a subjective decision requiring judgement. Evaluators may consider the following. What Might an Evaluator Consider?

Compliance in “Substantial Measure” Does your institution demonstrate sufficient evidence of compliance with the standards? No A for effort! Past & present more important than future

Systematic Evidence of Compliance NOT just Assertions Anecdotes Plans

Consistent Evidence Undergrad & graduate programs Professional & liberal arts programs On- & off-campus locations Online & face-to-face programs Student learning & other aspects of institutional effectiveness

How Much Has Been Implemented? Any significant gaps or shortcomings? Why? How sizable are they? What is their impact? Do you recognize the gaps? What are you doing about them?

Does Everyone “Get It”? Is there a pervasive culture of evidence-informed planning & decision-making? Do assessment results inform important decisions? How often are assessment results discussed by Board Cabinet Departments Important decisions = money 21 21

Sustained Assessment Will momentum slow after this review? How do campus leaders support and facilitate assessment? Are you keeping things simple? Are time & money invested in proportion to value? Pat McGuire: “Compassionate rigor” 22 22

How to Report on Assessment Compliance Document Analyze Summarize

Your Goals Strategic/institutional goals Learning outcomes General education Program-level

For Each Goal... How you’re assessing it Assessment results Analysis: What the results are telling you How results have been used for improvement Where you’re going with assessment

Ideally... Make visible what you’re already doing. Documentation already on hand An overview An overall analysis

Ideally... Information and reports you already share A format that’s useful to you and your colleagues Information, not just data Analysis: Not just results but what they say to you What your board should be asking for!

Ideally... Meeting minutes/ e-mail streams documenting Analysis Discussion Decisions

Alternatively... For each strategic goal, gen ed requirement, academic program... One-page summary plus rubrics/criteria Analysis, not just numbers What are the results telling you? In an appendix, online, CD, flash drive Formats can be inconsistent. Reviewer may choose a representative sample. If you’re not working at the ideal institution... We don’t prescribe how an institution will document this, so be open to anything! May be any or all of the above.

Documenting Institutional Effectiveness Institutional (Strategic) Goal Key Strategies to Achieve It How Assessed (Performance Indicators?) Summary/ Analysis of Results Use of Results Plans/ Schedule Going Forward 1. 2. 3. Examples of institutional strategic goals: Meet regional employment needs Prepare students for success in a diverse, global society

Documenting Gen Ed Learning Assessment Gen Ed Requirement Learning Goal How/ Where Taught How Assessed * Summary/ Analysis of Results Use of Results Plans/ Schedule Going Forward 1. 2. 3. * Provide rubric, survey, etc., so reviewers can verify rigor & match to goal.

Documenting Program-Level Learning Assessment Program Learning Goal How/ Where Taught How Assessed * Summary/ Analysis of Results Use of Results Plans/ Schedule Going Forward 1. 2. 3. * Provide rubric, survey, etc., so reviewers can verify rigor & match to goal.

Evidence First, Then An Overview in Your Report Summary & overall analysis Charts Strategic goals Gen ed requirements Academic programs Links to each appendix Answers without links to evidence aren’t answers.

Resources at www.msche.org Click on Publications. Scroll down and click on “Guidelines for Institutional Improvement” Assessing Student Learning and Institutional Effectiveness: Understanding Middle States Expectations Evaluating Institutional Student Learning Assessment Processes (a rubric) Information on Assessment Models and Best Practices Suggested Readings and much more!