Electronic Management of Assessment A tour of the UK landscape 09/09/2015 CC BY-NC-ND 2.0 Marius Kluzniak

Pre-departure 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Jisc Assessment & Feedback programme » University baseline reviews » Baseline review of landscape published 2012 CC BY-NC-ND 2.0 Nicole Hanusek

Travel advisory (1) 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Traditional culture stubbornly resistant to change » Devolved responsibility & varied practice » Limited opportunity for students to engage with process of making academic judgements » Issues with degree structure CC BY-NC-ND 2.0 Richard Lee

Travel advisory (2) 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Investment in technical infrastructure not yet delivering efficiencies » Preference for established technologies but innovation still difficult to scale up » Current practice not promoting employability CC BY-NC-ND 2. 0 Soilse

Travel essentials 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Lifecycle Model provides our ‘map’ & ‘phrase book’ » Academic model against which processes and systems can be mapped » Common framework for different stakeholders to discuss issues » Means of clarifying requirements for suppliers CC BY-NC 2.0 Marcus Ramberg

The Assessment and Feedback Lifecycle 09/09/2015 Electronic management of assessment: a tour of the UK landscape Based on an original idea developed by Manchester Metropolitan University

Starting point 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Educational principles eg REAP project University of Strathclyde; University of Hertfordshire Assessment for learning » Appreciative Inquiry approaches » University of Ulster Viewpoints project CC BY-SA 2.0 Michael Coglan

Principles at Queen’s University Belfast 09/09/2015 Electronic management of assessment: a tour of the UK landscape

Supporting longitudinal development 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Assessment for learning rather than of learning » More formative opportunities » Feed forward » Ipsative approaches » Assesment scheduling » Access to information CC BY-NC-SA 2.0 CrazyFast

Assessment timelines 09/09/2015 Electronic management of assessment: a tour of the UK landscape University of Dundee course redesign using University of Hertfordshire assessment timelines tool

The role of feedback 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Feedback is a ‘black box’ » Programme teams don’t discuss feedback » Useful analytical tools available CC BY-NC-SA 2.0 xdxd vs xdxd

What kind of feedback do you give? 09/09/2015 Electronic management of assessment: a tour of the UK landscape » P1 - Praise. Motivating but if used indiscriminately can appear insincere. » P2 - Recognising Progress (ipsative feedback). Can be motivating and informs students about their learning. Lack of progress serves as an early warning. » C - Critique. How work falls short of expectations or criteria; can be discouraging if not accompanied by information on how to improve. » A - Advice. Help students take future action to improve. » Q - Clarification requests. Asking learners to think more deeply about their work and generate actions themselves. » O - Unclassified statements. Neutral comments, for example that describe the piece of work but do not make any judgement. (adapted from Institute of Education feedback profile)

Electronic Management of Assessment 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Jisc EMA project » Heads of e-Learning Forum surveys » Questionnaire (65 HEIs) » Think tank & workshops » Interviews » Discussions on EMA blog » Landscape review report /1/EMA_REPORT.pdf /1/EMA_REPORT.pdf CC BY 2.0 acme

Localised initiatives 09/09/2015 Electronic management of assessment: a tour of the UK landscape

Pain points 09/09/2015 Electronic management of assessment: a tour of the UK landscape

Systems integration 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Limited range of core technologies » Integration loose & requiring manual intervention » More universities say their assessment systems are ‘completely separate’ than ‘highly integrated’ CC BY-NC-SA 2.0 Cesar Harada

Business processes 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Lots of local variation » Only 12% of universities have ‘highly standardised’ processes » Different interpretations of policy » Variation hidden till EMA tried

Top 10 EMA challenges 09/09/2015 Electronic management of assessment: a tour of the UK landscape

Top 20 EMA challenges 09/09/2015 Electronic management of assessment: a tour of the UK landscape

Working towards solutions 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Validation of priorities » Workshop to generate solution ideas » Validation and refinement of solutions » Talking to others: EUNIS, SURF, UNINETT » Toolkit in development

Project timeline 09/09/2015 Electronic management of assessment: a tour of the UK landscape EMA workflows project – mapping requirements Ongoing capture of resources – ‘EMA toolkit’ Landscape review – challenges prioritised Feedback hub scoping Single online resource Summer 2014 Spring/Summer 2015 October 2015 Pilots Autumn/Winter 2015 Electronic management of assessment: a tour of the UK landscape

Souvenir shop 09/09/2015 Electronic management of assessment: a tour of the UK landscape » A&F Baseline review: / mmes/elearning/Assessment/JISCAFBaselineReportMay2 012.pdf / mmes/elearning/Assessment/JISCAFBaselineReportMay2 012.pdf » A&F Final report: s_Report_Oct_2013_v2.pdf s_Report_Oct_2013_v2.pdf » EMA Landscape review: » Jisc EMA blog: CC BY-NC-ND-SA 2.0 ericalaspada

Prefer it gift wrapped? 09/09/2015 Electronic management of assessment: a tour of the UK landscape » Look out for our Assessment Toolkit due to launch in October 2015

jisc.ac.uk Except where otherwise noted, this work is licensed under CC-BY-NC-ND Stay in touch… Contact Lisa Gray Senior Co-Design Manager, Student Experience 09/09/2015 Electronic management of assessment: a tour of the UK landscape Gill Ferrell