Beyond the technology: intervention evaluation based on captured attendance data C.E.B. Freeman University of South Wales, Faculty of Computing, Engineering and Science

Introduction Retention is not a recent phenomenon Non-completion Caldwell1 (1922) calculated attrition of freshmen at 32% Non-completion 7% of all young full-time first degree entrants do not continue in HE after their first year academic year2 Complex Individual, Institutional, Societal Many approaches Monitoring attendance Increasing attendance means more time in class Classroom identified as key means for facilitating student-institution interaction Student interaction with peers/lecturers occurs in classrooms especially for non-traditional students Students displaying non-traditional characteristics most likely to leave Improving attendance theoretically improves retention Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition 1. Caldwell, H. (1922). The Mortality Rate in our Freshman Classes. American Association of Collegiate Registrars and Admissions Officers 2. www.hesa.ac.uk/stats - Accessed 9th April 2017

What is the data telling us? Aims & Objectives Design Implement Evaluate Electronic Attendance Monitoring System Radio-frequency identification (RFID) - connecting objects to the Internet Interactively engaging students and staff Lecturer workload is not increased Data captured - provide information To improve the structure to support teaching teams Across modules/courses Accurate What is the data telling us? Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Personal Coaching/Tutoring Organisational Data Capture Reports Personal Coaching/Tutoring SAFE Learner Analytics Tier 4 Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Organisational Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Year Rooms Campus Students Staff Courses Sessions 2013 1 70 120 2014 v1 15 2 239 27 29 1603 2015 v2 620 54 62 2201 2016 v3 42 1488 108 148 5708 Homepage Live Register Achievement Attendance Attrition

Timetable Student View Introduction Aims & Objectives Intervention Reports Outcomes Conclusion   Homepage Live Register Achievement Attendance Attrition Click session to access ‘Notes’

Live Register Before the class starts Introduction Aims & Objectives   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Live Register After class finished Introduction Aims & Objectives   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition Staff reported absence

Module Attendance Comparison Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Module Attendance Comparison Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Call-out indicates student note Student reported absence Homepage Live Register Achievement Attendance Attrition Staff reported absence

Course Report Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Individual Student Report Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Staff reported absence Homepage Live Register Student reported absence Achievement Attendance Attrition

Non Attendance Weekly Report Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Student Achievement Introduction Aims & Objectives Intervention   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Year Attendance Pass rate CW1 CW2 CW3 2014-15 47% 54% 49% 43% 2015-16 57% 56% 2016-17 63% 65% Not yet available Homepage Live Register Achievement Attendance Attrition

SAFE3 Introduction Aims & Objectives Intervention Reports Outcomes   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition 3. Dr Ross Davies USW

Attendance Introduction Aims & Objectives Intervention Reports   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Attrition Introduction Aims & Objectives Intervention Reports Outcomes   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Year Registered February All Projection % 2013 4282 114 195 2.66 2014 4535 111 165 2.45 2015 4430 125 205 2.82 2016 3929 100 124 162 2.55 Homepage Live Register Achievement Attendance Attrition

Key Lessons Learned System is well received. Students value the fact that we are taking an interest We monitor and evaluate but this is not always translated into real action Action responsibility should be clear. Who is responsible for what happens in response to data picture created? Both staff and students need to engage. Message. Attendance monitoring is used to trigger support if concerns are apparent Criteria for an authorised absence. Needs to be agreed by the team. A larger picture has emerged. We have policies and procedures but we still do not fully understand the problems.   Introduction Aims & Objectives Intervention Reports Outcomes Conclusion Homepage Live Register Achievement Attendance Attrition

Conclusion Introduction Aims & Objectives Intervention Reports Outcomes Conclusion It works!  100% students thought it acceptable to monitor attendance Helped with group work 89% thought attending had improved their marks Second year students requested they were included on the system Attendance Action Plan (Tier 4) Improved interactions with students and staff Hit home how much they had actually missed Homepage Live Register Achievement Attendance Attrition