Learning Analytics and Assessment Analytics and Feed Forward

Introduction » Supporting student development › Feedforward and a longitudinal view › Centralised view of feedback » Using data to inform the tutoring process › Learning analytics › Assessment analytics » Tutor and Student Support » Code of practice for learning analytics » Questions Technology to support 21 st century tutoring2

Longitudinal development: feeding forward 3 » Feed forward and ipsative approaches » Technology enhancements: › Using tools to analyse the timing of assessments › Developing tools to analyse and audit feedback › Creating conditions for student/staff dialogue › Storage of feedback across a programme CC BY-NC-ND 2.0 Waveneyavenue Technology to support 21 st century tutoring

Feedback is….. “Staff have found the dialogue with students energising and the acknowledgement that students are learning from the feedback satisfying. Tutors have also learned from students’ comments in the dialogue – demonstrating reciprocal learning” Technology to support 21 st century tutoring4 A conversation

Feedback is… » University of Edinburgh - aimed to view students experience as a 4 years long journey, n ot as one year repeated 4 times » Consisted of › Reflective online templates to support one-to-one meetings › Reflection prompting activities for group meetings Effective Learning Analytics 28/01/155 A conversation » Benefits › Enables the University to monitor students confidence around the Graduate Attribute statements › Tutors finding it useful in preparing for meetings and having more productive meetings › Tutees finding it useful to help collect their thoughts

Centralised view of feedback » A longitudinal and holistic approach to student development requires that past feedback is stored and accessible to staff and students » New developments › Moodle Assessment and Reporting Tool › Flourish tool » Emerging discussion through the Jisc Electronic Management of Assessment Project Technology to support 21 st century tutoring6

Using data to inform the tutoring process

Effective Learning Analytics Priority 1: Basic learning analytics solution, an interventions tool and a student Priority 2: Code of practice for learning analytics Priority 3: Learning analytics support and networks Effective Learning Analytics Network Meeting 20/02/158 Priority Areas for projects

Learning Analytics Prediction Tools – analysis of learning activity Technology to support 21 st century tutoring9 Image: BME Solutions LtdBME Solutions Ltd » Use data from student activity to provide actionable insights to predict potential outcomes. » Data sources – e.g. VLE, SRS, attendance, resource use, etc. » Range of approaches from simple bespoke spreadsheets to products based on VLEs, SIS and business intelligence packages. » Supporting retention, attainment, modules choices, employability, etc. » Early stage of development – many tracking rather than analysis.

Assessment analytics » Explored implications of using assessment data to support student development » Demonstrated that sharing the analytics offered something substantially different than for individual feedback alone » And…had a positive impact on motivation » But…needs careful supporting Effective Learning Analytics 28/01/1510 University of Huddersfield ‘…provided some compelling evidence to suggest that engaging with assessment analytics can support student learning by increasing their motivation to act on their feedback whilst also focusing their attention strategically on aspects of their feedback they might otherwise neglect’ EBEAM final report, p. 76

Basic Learning Analytics Effective Learning Analytics Network Meeting 20/02/1511

Tutor and Student Support

Shared approach to tutoring » TQFE-Tutor – a shared communication and tutoring system developed by the University of Dundee › Comprising blog, and twitter accounts › Shared record of communications around assignments and feedback › Enabling informed discussions around students longitudinal development Technology to support 21 st century tutoring13 Gaining efficiencies and enhancements » Benefits › Enhanced resilience › Staff development › Time savings › Improved student performance – Pass rate increased from 85% to 96%

Intervention Management Tools – supporting tutors Technology to support 21 st century tutoring14 » Managing actionable insights form learning analytics tools. » Collating and sharing good practice. » Example › Co-Tutor™ - Loughborough University. › Aimed at personal tutors › Collates data on student activity. › Tracks tutor interactions with students.

Student Success Planner Technology to support 21 st century tutoring15 » An open source tool from Unicon Ltd and Marist College » Features include › Alerts and intervention management › Student Indicators › Intervention Indicators

Student App Effective Learning Analytics Network Meeting 20/02/1516 Use cases Measuring engagement Measuring assessment performance Module choice Consent Use cases Measuring engagement Measuring assessment performance Module choice Consent management

Student app for learning analytics Technology to support 21 st century tutoring17  My assessments  My engagement  My reading lists  Check-in to event  Find a study buddy  Extra events  How am I feeling?  My consent what-do-students-want-from-a-learning- analytics-app/

Code of Practice for Learning Analytics – for institutions, learners, vendors. Technology to support 21 st century tutoring18 A policy, for institutions to adopt/adapt with fact sheets covering following areas » Responsibility – allocating responsibility for the data and processes of learning analytics within an institution » Privacy – ensuring individual rights are protected and data protection legislation is complied with » Validity – making sure algorithms, metrics and processes are valid » Access – giving students access to their data and analytics » Enabling positive interventions – handling interventions based on analytics appropriately » Minimising adverse impacts – avoiding the various pitfalls that can arise » Stewardship of data – handling data appropriately

Code of Practice for Learning Analytics – for institutions, learners, vendors. Technology to support 21 st century tutoring19 -of-practice-for-learning-analytics Available June 2015

Questions or Activity Effective Learning Analytics 28/01/1520

Contacts Contacts: Paul Bailey Lisa Gray Assessment Management blog Assessment resources Learner Analytics Blog Technology to support 21 st century tutoring21