1. Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell
A tour around the EMA landscape
18/3/2105
Jisc Assessment & Feedback activities Dr Gill Ferrell
Dr Gill Ferrell
CC BY-NC-ND 2. Marius Kluzniak

2. Pre-departure Jisc Assessment & Feedback programme 2011-2014
A tour around the EMA landscape 2
Pre-departure
Jisc Assessment & Feedback programme
HEI Baseline reviews
Baseline review of landscape published 2012
CC BY-NC-SA 2.0 tiff_ku1

3. Travel advisory (1) Traditional culture stubbornly resistant to change
A tour around the EMA landscape 3
Travel advisory (1)
Traditional culture stubbornly resistant to change
Devolved responsibility & varied practice
Limited opportunity for students to engage with process of making academic judgements
Issues with degree structure
CC BY-NC-ND 2. Richard Lee
CC BY-NC-SA 2.0 tiff_ku1

4. A tour around the EMA landscape4
Traditional culture stubbornly resistant to change
Travel advisory (2)
Investment in technical infrastructure not yet delivering efficiencies
Preference for established technologies but innovation still difficult to scale up
Current practice not promoting employability
CC BY-NC-ND 2. 0 Soilse

5. Travel essentials Lifecycle Model provides our ‘map’ & ‘phrase book’
A tour around the EMA landscape 5
Traditional culture stubbornly resistant to change
Travel essentials
Lifecycle Model provides our ‘map’ & ‘phrase book’
Academic model against which processes and systems can be mapped
Common framework for different stakeholders to discuss issues
Means of clarifying requirements for suppliers
CC BY-NC 2.0 Marcus Ramberg

6. The Assessment and Feedback Lifecycle
A tour around the EMA landscape 6
The Assessment and Feedback Lifecycle
Based on an original idea developed by Manchester Metropolitan University

7. A tour around the EMA landscape7
Starting point
Educational principles: REAP project Strathclyde; Hertfordshire Assessment for learning; NUS
Appreciative Inquiry approaches
Ulster Viewpoints project
CC BY-NC-SA 2.0 tiff_ku1
CC BY-SA 2.0 Michael Coglan

8. A&F principles at Queen’s University Belfast
A tour around the EMA landscape 8
A&F principles at Queen’s University Belfast
Easier to align tech once you have principles

9. Supporting longitudinal development
A tour around the EMA landscape 9
Supporting longitudinal development
Assessment for learning rather than of learning
More formative opportunities
Feed forward
Ipsative approaches
Assesment scheduling
Access to information
CC BY-NC-SA 2.0 CrazyFast

10. A tour around the EMA landscape10
Assessment timelines
Basic analytics MMU Bolton some Los assessed multiple times others not at all
University of Dundee course redesign using University of Hertfordshire assessment timelines tool

11. The role of feedback Feedback is a ‘black box’
A tour around the EMA landscape 11
The role of feedback
Feedback is a ‘black box’
Programme teams don’t discuss feedback
Useful analytical tools available
CC BY-NC-SA 2.0 xdxd_vs_xdxd

12. What kind of feedback do you give?
A tour around the EMA landscape 12
What kind of feedback do you give?
P1 - Praise. Motivating but if used indiscriminately can appear insincere.
P2 - Recognising Progress (ipsative feedback). Can be motivating and informs students about their learning. Lack of progress serves as an early warning.
C - Critique. How work falls short of expectations or criteria; can be discouraging if not accompanied by information on how to improve.
A - Advice. Help students take future action to improve.
Q - Clarification requests. Asking learners to think more deeply about their work and generate actions themselves.
O - Unclassified statements. Neutral comments, for example that describe the piece of work but do not make any judgement.
(adapted from IOE feedback profile)

13. Electronic Management of Assessment
A tour around the EMA landscape 13
Electronic Management of Assessment
Jisc EMA project
HeLF surveys
Questionnaire (65 HEIs)
Think tank & workshops
Interviews
Discussions on EMA blog/
Landscape review report
CC BY 2.0 acme

14. Localised initiatives
A tour around the EMA landscape 14
Localised initiatives

15. A tour around the EMA landscape15
EMA pain points

16. Systems integration Limited range of core technologies
A tour around the EMA landscape 16
Systems integration
Limited range of core technologies
Integration loose & requiring manual intervention
More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’
CC BY-NC-SA 2.0 Cesar Harada

17. Business Processes Lots of local variation
A tour around the EMA landscape 17
Business Processes
Lots of local variation
Only 12% of HEIs have ‘highly standardised’ processes
Different interpretations of policy
Variation hidden till EMA tried
CC BY-NC-SA 2.0 Cle0patra

18. Example: anonymity Necessary safeguard or ‘comfort blanket’ ?
A tour around the EMA landscape 18
Example: anonymity
Necessary safeguard or ‘comfort blanket’ ?
Avoids unconscious bias
Doesn’t support ipsative approach
Complicated by second marking processes
Can be lost when data transfers between systems
CC BY –NC 2.0 Pondspider

19. Urban Myths QAA says ‘No!’ It’s against institutional regulations
A tour around the EMA landscape 19
Urban Myths
QAA says ‘No!’
It’s against institutional regulations
Leads to change taking place ‘under the radar’ of formal QA processes
CC BY-NC-SA 2.0 jon jordan

20. What are your priorities? (1)
A tour around the EMA landscape 20
What are your priorities? (1)

21. What are your priorities? (2)
A tour around the EMA landscape 21
What are your priorities? (2)

22. Working towards solutions
A tour around the EMA landscape 22
Working towards solutions
Validation of priorities
Workshop to generate solution ideas
Validation and refinement of solutions
Projects getting under way
Photo: livework for Jisc

23. Next steps EMA requirements map: definition of common workflows
A tour around the EMA landscape 23
Next steps
EMA requirements map: definition of common workflows
EMA toolkit:
Feedback hub: feasibility study
Systems integration: support resources
CC BY –NC-ND 2.0 bendeavin

24. Highlights of the itinerary
A tour around the EMA landscape 24
Highlights of the itinerary
Educational principles: Hertfordshire, Queen’s Belfast
Curriculum Design: Ulster
Feedback: Dundee, Institute of Education
Employability: Exeter
EMA: Huddersfield
Reflection: Westminster
Student support: Manchester Met
Students as agents of change: Bath Spa; Winchester
CC BY-SA 2.0 Steve Cadman

25. A tour around the EMA landscape25
Souvenir shop
A&F Baseline review:
A&F Final report:
EMA Landscape review:
Jisc Design Studio:
Jisc EMA blog:
CC BY-NC-ND-SA 2.0 ericalaspada

26. Stay in touch Contact me: gill@aspire-edu.org
A tour around the EMA landscape 26
Stay in touch
Contact me:
Contact Jisc EMA lead:
Contribute to the blog
Get involved with the projects
Join the mailing list:
CC BY-NC-SA 2.0 robin kaspar

27. Electronic Management of Assessment and Assessment Analytics
A tour around the EMA landscape 27
Join us in Dundee
Free one-day workshop
Electronic Management of Assessment and Assessment Analytics
Tues 9th June
University of Abertay
Contact for details
CC BY-NC-SA 2.0 William Murphy

28. Thanks and over to you… CC BY –NC 2.0 yuzu CC BY-NC-SA CrazyFast
A tour around the EMA landscape 28
Thanks and over to you…
CC BY –NC 2.0 yuzu
CC BY-NC-SA CrazyFast