2012 West Texas Assessment Conference CREATING A CULTURE OF ASSESSMENT IN NON-INSTRUCTIONAL AREAS KARA LARKAN-SKINNER, DIRECTOR OF IR AND IE & KRISTIN MCDONALD-WILLEY, ASSESSMENTS COORDINATOR

Speaking Request: Discuss how Amarillo College (AC) addresses the following SACSCOC requirements:  Administrative Support Services  Academic and Student Support Services  Community/Public Service Within Mission  Note: Research is not applicable within our mission Focus Areas:  Discuss AC’s process for evaluating  Discuss AC’s accountability practices  Discuss how AC guides the institution toward improvement  Discuss how AC tackled the recent SACSCOC compliance demands in the 2012 reaffirmation reports and documentation SESSION OUTLINE

Give you a few ideas/tools to aid you in your assessment practices. Key Points:  One size does not fit all  Change is not instant  Considerations  Type of institution  Size of institution  Number of administrators/staff SESSION GOAL

AC’S PROCESS FOR EVALUATING PLANNING EVALUATION AND TRACKING (PET) PROCESS  Based on organizational chart, notify “people responsible”  Invite Non-Instructional (NI) area representatives to a training  Discuss Measurable Goals  Discuss Writing Good Outcomes and Direct Outcomes  Walk through PET Form Template  NI areas given a template called a PET form  Requirements:  Purpose Statement  1 Goal/Outcome from Strategic Plan  1 Goal/Outcome from Achieving the Dream (AtD) which is also called No Excuses  1 Direct Outcome  1 Set of Results and Analysis  1 Past Improvement and 1 Future Action Plan  PET form reminders/materials sent up until the due date  IE staff or NI committee offer assistance when needed  PET Form Submitted (See Sample PET Form Content: Next Slide)

 Goal Statement #1:  Outcome/Objective Statement #1A (Be sure to include audience, behavior, conditions, degree/benchmark, and evaluation method):  Results (If Applicable, Provide Numbers and Percentages for Quantitative Data)  Data: Numbers = ___ out of ____ and Percentage =s ____%  Data: Numbers = ____ out of ____ and Percentage =s ____%  Analysis  Provide Previous Data/Result Analysis (Include if benchmark was met and how results relate to outcome statement):  Improvements  List any Improvements Made in the (Last Academic) Year:  Evaluate Why Improvements Were Successful/Were Not Successful:  What Budget Implications Were Involved with this Improvement? (Please Provide Cost Estimate/Details):  Recommendations/Actions for  Person Responsible (Who will complete the action?):  Action Plan:  Expected Time Frame Needed to Implement Action Plan (Please provide specific deadline date):  What Budget Implications Are Involved with this Action? (Please Provide Cost Estimate/Details): AC’S PROCESS FOR EVALUATING SAMPLE PORTION OF PET TEMPLATE

AC’S PROCESS FOR EVALUATING PLANNING AND EVALUATION TRACKING (PET) PROCESS  PET Form Reviewed by NI Assessment Committee  Response Form Returned to Person Responsible  Needed Edits Made to PET Form by Person Responsible  Extent of Outcome Achievement Documented  Final PET Form Information Passed On For Improvements:  NI Assessment Committee  President’s Cabinet  Anyone Who Needs Access to Specialized Information

Use Your Verbal Judo Skills! To Get Compliance  Encourage wide representation, but have 1 primary person responsible  Copy supervisors on all PET-related communications  Clearly define in advance how the PET form will be used and who will see it  Small trainings with “like” groups help peer pressure into compliance To Get Cooperation (A.K.A. “Buy In”)  Simplify as Much as Possible  Make Process Fair  Clearly defined guidelines  Clearly defined evaluation process  Prove that the Process is Meaningful  Tie it to other institutional initiatives  Answer the “why” and the “so what?” questions To Get Collaboration (Ultimate Goal)  Involve NI people in Forming and Evolving Your Process  NI Assessment Committee (at AC, minimum 10 members)  Invite all NI staff/administration to “Chats and Stats” discussions ACCOUNTABILITY PRACTICES -HOW DO YOU GET PARTICIPATION?-

Improvement for NI Areas in Creating Outcomes/Objectives  Multiple Training Opportunities (Outside of “Assigned” Time)  Ability to Work with IE employees or NI Committee Members  Feedback Offered via NI Assessment Committee Response Forms  Opportunity to Edit and Improve Form Based on Feedback  Opportunity to Improve from NI Assessment Committee Recommendations  Improved Results (See Handout) Improvement for Institution as a Whole Based on PET Form Information  Budget – President’s Cabinet reviews to assess institutional needs.  Strategic Plan – President’s Cabinet can see where we are at on institutional priorities and avoid duplication of effort.  No Excuses – Identify how each area can help guide students toward success either directly or indirectly. GUIDE INSTITUTION TOWARD IMPROVEMENT -HOW DO YOU USE THE INFORMATION?-

Improvement for Those Who Oversee the Assessment Process  Use NI Assessment Committee Comments to Improve  Use SACSCOC Comments to Improve  For example, choose terminology you use in your responses very carefully  Use Collaboration with All Possible Stakeholders to Improve  For example, we now collaborate with Academic Affairs because they do oversee some of the student and academic support areas and thus have an invested interest in the process GUIDE INSTITUTION TOWARD IMPROVEMENT

 AC Identifies Expected Outcomes  Writing Outcomes: Audience, Behavior, Condition, Degree, Evaluation (A-E) Model  PET Process  Training and Training Support Information  AC Identifies the Extent to Which it Achieves These Outcomes  Brief overview on where and how the achievement of outcomes is identified  Information on methodology that outlines how outcomes will be assessed  AC Provides Evidence of Improvement Based on Result Analysis  Examples provided for key words identified in SACSCOC handbook  Information on reports that document improvements made by NI areas  Response Form Information  Information on Review Process After PET Submission SUMMARY: -HOW DID WE USE OUR PROCESS TO MEET SACSCOC GUIDELINESS?-

QUESTIONS Assessments Coordinator Amarillo College Kristin McDonald-Willey Director of Institutional Research and Institutional Effectiveness Amarillo College Kara Larkan-Skinner

 A-E Method for Writing Outcome Statements A-E Method for Writing Outcome Statements  Institutional Effectiveness Web site Institutional Effectiveness Web site  PET Form Template PET Form Template  Non-Instructional PET Forms PowerPoint Training Non-Instructional PET Forms PowerPoint Training  PET Response Form (Blank) and Response Letter Sample PET Response Form (Blank)Response Letter Sample  PET Methodology (Updated ) PET Methodology (Updated )  PET Web site PET Web site AMARILLO COLLEGE RESOURCES

 Bloom’s Taxonomy Action Verbs Chart Useful in writing outcome’s statements (Clemson University) Bloom’s Taxonomy Action Verbs Chart  SMART Goals Alternative to A-E Method (Top Achievement Web site) SMART Goals OTHER RESOURCES