1. 1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities 2011-2015 Dr Gill Ferrell A tour around the EMA landscape

2. 2 CC BY-NC-SA 2.0 tiff_ku1 Pre-departure Jisc Assessment & Feedback programme 2011-2014 HEI Baseline reviews Baseline review of landscape published 2012 A tour around the EMA landscape 2

3. 3 CC BY-NC-SA 2.0 tiff_ku1 Travel advisory (1) Traditional culture stubbornly resistant to change Devolved responsibility & varied practice Limited opportunity for students to engage with process of making academic judgements Issues with degree structure CC BY-NC-ND 2. Richard Lee A tour around the EMA landscape 3

4. 4 Traditional culture stubbornly resistant to change Travel advisory (2) Investment in technical infrastructure not yet delivering efficiencies Preference for established technologies but innovation still difficult to scale up Current practice not promoting employability CC BY-NC-ND 2. 0 Soilse A tour around the EMA landscape 4

5. 5 Traditional culture stubbornly resistant to change Travel essentials Lifecycle Model provides our ‘map’ & ‘phrase book’ Academic model against which processes and systems can be mapped Common framework for different stakeholders to discuss issues Means of clarifying requirements for suppliers CC BY-NC 2.0 Marcus Ramberg A tour around the EMA landscape 5

6. The Assessment and Feedback Lifecycle Based on an original idea developed by Manchester Metropolitan University A tour around the EMA landscape 6

7. 7 CC BY-NC-SA 2.0 tiff_ku1 Starting point Educational principles: REAP project Strathclyde; Hertfordshire Assessment for learning; NUS Appreciative Inquiry approaches Ulster Viewpoints project CC BY-SA 2.0 Michael Coglan A tour around the EMA landscape 7

8. A&F principles at Queen’s University Belfast A tour around the EMA landscape 8

9. 9 CC BY-NC-SA 2.0 CrazyFast Supporting longitudinal development Assessment for learning rather than of learning More formative opportunities Feed forward Ipsative approaches Assesment scheduling Access to information A tour around the EMA landscape 9

10. Assessment timelines University of Dundee course redesign using University of Hertfordshire assessment timelines tool A tour around the EMA landscape 10

11. 11 CC BY-NC-SA 2.0 xdxd_vs_xdxd The role of feedback Feedback is a ‘black box’ Programme teams don’t discuss feedback Useful analytical tools available A tour around the EMA landscape 11

12. What kind of feedback do you give? P1 - Praise. Motivating but if used indiscriminately can appear insincere. P2 - Recognising Progress (ipsative feedback). Can be motivating and informs students about their learning. Lack of progress serves as an early warning. C - Critique. How work falls short of expectations or criteria; can be discouraging if not accompanied by information on how to improve. A - Advice. Help students take future action to improve. Q - Clarification requests. Asking learners to think more deeply about their work and generate actions themselves. O - Unclassified statements. Neutral comments, for example that describe the piece of work but do not make any judgement. (adapted from IOE feedback profile) A tour around the EMA landscape 12

13. 13 CC BY 2.0 acme Electronic Management of Assessment Jisc EMA project HeLF surveys Questionnaire (65 HEIs) Think tank & workshops Interviews Discussions on EMA blog / Landscape review report A tour around the EMA landscape 13

14. Localised initiatives A tour around the EMA landscape 14

15. EMA pain points A tour around the EMA landscape 15

16. 16 CC BY-NC-SA 2.0 Cesar Harada Systems integration Limited range of core technologies Integration loose & requiring manual intervention More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’ A tour around the EMA landscape 16

17. 17 CC BY-NC-SA 2.0 Cle0patra Business Processes Lots of local variation Only 12% of HEIs have ‘highly standardised’ processes Different interpretations of policy Variation hidden till EMA tried A tour around the EMA landscape 17

18. 18 CC BY –NC 2.0 Pondspider Necessary safeguard or ‘comfort blanket’ ? Avoids unconscious bias Doesn’t support ipsative approach Complicated by second marking processes Can be lost when data transfers between systems Example: anonymity A tour around the EMA landscape 18

19. 19 CC BY-NC-SA 2.0 jon jordan Urban Myths QAA says ‘No!’ It’s against institutional regulations Leads to change taking place ‘under the radar’ of formal QA processes A tour around the EMA landscape 19

20. What are your priorities? (1) A tour around the EMA landscape 20

21. What are your priorities? (2) A tour around the EMA landscape 21

22. 22 Photo: livework for Jisc Working towards solutions Validation of priorities Workshop to generate solution ideas Validation and refinement of solutions Projects getting under way A tour around the EMA landscape 22

23. 23 CC BY –NC-ND 2.0 bendeavin Next steps EMA requirements map: definition of common workflows EMA toolkit: Feedback hub: feasibility study Systems integration: support resources A tour around the EMA landscape 23

24. 24 Highlights of the itinerary Educational principles: Hertfordshire, Queen’s Belfast Curriculum Design: Ulster Feedback: Dundee, Institute of Education Employability: Exeter EMA: Huddersfield Reflection: Westminster Student support: Manchester Met Students as agents of change: Bath Spa; Winchester CC BY-SA 2.0 Steve Cadman A tour around the EMA landscape 24

25. 25 Souvenir shop A&F Baseline review: http://www.webarchive.org.uk/wayback/archive/2 0140614114153/http://www.jisc.ac.uk/media/doc uments/programmes/elearning/Assessment/JISCA FBaselineReportMay2012.pdf http://www.webarchive.org.uk/wayback/archive/2 0140614114153/http://www.jisc.ac.uk/media/doc uments/programmes/elearning/Assessment/JISCA FBaselineReportMay2012.pdf A&F Final report: http://repository.jisc.ac.uk/5450/4/Jisc_AF_Final_S ynthesis_Report_Oct_2013_v2.pdf http://repository.jisc.ac.uk/5450/4/Jisc_AF_Final_S ynthesis_Report_Oct_2013_v2.pdf EMA Landscape review: http://repository.jisc.ac.uk/5599/ http://repository.jisc.ac.uk/5599/ Jisc Design Studio: http://jiscdesignstudio.pbworks.com http://jiscdesignstudio.pbworks.com Jisc EMA blog: http://ema.jiscinvolve.org/wp/ http://ema.jiscinvolve.org/wp/ CC BY-NC-ND-SA 2.0 ericalaspada A tour around the EMA landscape 25

26. 26 Stay in touch Contact me: gill@aspire-edu.org gill@aspire-edu.org Contact Jisc EMA lead: lisa.gray@jisc.ac.uk Contribute to the blog Get involved with the projects Join the mailing list: TECH-ENHANCED-ASSESSMENT@JISCMAIL.AC.UK CC BY-NC-SA 2.0 robin kaspar A tour around the EMA landscape 26

27. 27 Join us in Dundee CC BY-NC-SA 2.0 William Murphy Free one-day workshop Electronic Management of Assessment and Assessment Analytics Tues 9 th June University of Abertay Contact gill@aspire-edu.org for detailsgill@aspire-edu.org A tour around the EMA landscape 27

28. 28 CC BY-NC-SA CrazyFast Thanks and over to you… CC BY –NC 2.0 yuzu A tour around the EMA landscape 28