Elena Payne-Wiens (CoAA) & Shonta LeMaster (CLAS) Assessment of Academic Advising Thursday, November 19, 2015 Elena Payne-Wiens (CoAA) & Shonta LeMaster (CLAS)

Goals Discuss basic principles of assessment of advising Consider tools for assessment Review current UNC Charlotte academic advising assessments Discuss best practices for assessment of academic advising Consider challenges of assessment

Assessment “Assessment is the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development.” Palomba and Banta (1999). Assessment Essentials.

What do we assess? Customer satisfaction Learning Outcomes/Objectives How satisfied with advising overall… Learning Outcomes/Objectives UNCC has 7 Advising Learning Outcomes Patterns/trends Numbers of contacts, survey data over time Expand here. Have example for each.

Why do we assess? Improve services Help students attain goals Understand strengths/barriers Continuous Improvement See research…

UNCC Advising Outcomes (1-3) As a result of the academic advising process at UNC Charlotte, students will be able to Evaluate personal interests and abilities leading to the creation of realistic academic and professional goals. Access and navigate the University online resources and processes. Develop an educational plan that leads to the timely completion of educational goals.

UNCC Advising Outcomes (4-7) As a result of the academic advising process at UNC Charlotte, students will be able to 4. Access University academic and student support services and resources. 5. Follow academic and administrative policies and procedures. Develop the critical thinking and independent decision- making skills to make and accept responsibility for academic decisions. 7. Discover and integrate co- and extra-curricular activities and programs that enhance the collegiate experience.

Current University Surveys SOAR surveys (every session) Response rate (2015): FR = 95%, TR = 85% (up over time) 6-7 questions on advising Nat’l Survey of Student Engagement - NSSE First-years and Seniors every other Spring (2014, 2016…) 2014 Response rate: FR= 17%, SR = 20% 11 questions on advising Sophomore Survey – every 3rd Spring (2013, 2016…) 13 questions on advising Graduating Senior Survey - every 3rd Spring (2013, 2016...) 2013 Response rate: 77% 6 questions on advising

Other advising surveys BCoB – email (9 Qs), certain weeks of advising – SurveyShare CoEng – email (5 Qs), annually (March) – Campus Labs CHHS – email (26 Qs), annually, after reg. – Qualtrics *CoAA – email (10 Qs), bi-annually, after reg. – Campus Labs UCOL – email (24 Qs), during advising – SurveyShare Criminal Justice – email (9 Qs), during advising– SurveyShare *CLAS – computer (14 Qs), after advising session – GoogleForm CoEd – computer, Seniors, required – TaskStream OASES – comp./email (16 Qs), during advising – Campus Labs *See examples provided

4 Common Question Categories 1. TIME sufficient quality availability 2. INFORMATION courses, requirements, degrees policies, procedures support options, referrals special opportunities career and grad school 3. DEMEANOR professional, courteous, friendly, approachable listened carefully, concerned 4. OVERALL SATISFACTION & Comments

How can the data be used? In several ways: Provide informal feedback to advisors Gauge effectiveness of services and processes Gain general understanding of student satisfaction Identify opportunities for new initiatives, training, technology, etc. 5. Test effectiveness of new initiatives, technology, etc. 6. Other?

Challenges? Feedback loop – sharing results Using results “Complainers” (how information is used) Other?

Brainstorm. Other ways to gather info on advising Brainstorm! Other ways to gather info on advising? What else are we curious about? Feedback from advisors, directors, other constituents besides students?

Resources Advising Redesign Report 2015: Academic Advising Assessment Questions and Longitudinal Data – UNC Charlotte, February, 2015 – includes data on all University surveys over time. (Ask Advising Steering Committee rep) Palomba, C.A., & Banta, T. W. (1999). Assessment essentials. San Francisco, CA: John Wiley & Sons, Inc. NACADA website – nacada.ksu.edu Assessment of Academic Advising Bibliography Assessment of Academic Advising Overview