1 Dr Gill Ferrell CC BY-NC-ND 2. Marius Kluzniak 18/3/2105 Jisc Assessment & Feedback activities Dr Gill Ferrell A tour around the EMA landscape

2 CC BY-NC-SA 2.0 tiff_ku1 Pre-departure Jisc Assessment & Feedback programme HEI Baseline reviews Baseline review of landscape published 2012 A tour around the EMA landscape 2

3 CC BY-NC-SA 2.0 tiff_ku1 Travel advisory (1) Traditional culture stubbornly resistant to change Devolved responsibility & varied practice Limited opportunity for students to engage with process of making academic judgements Issues with degree structure CC BY-NC-ND 2. Richard Lee A tour around the EMA landscape 3

4 Traditional culture stubbornly resistant to change Travel advisory (2) Investment in technical infrastructure not yet delivering efficiencies Preference for established technologies but innovation still difficult to scale up Current practice not promoting employability CC BY-NC-ND 2. 0 Soilse A tour around the EMA landscape 4

5 Traditional culture stubbornly resistant to change Travel essentials Lifecycle Model provides our ‘map’ & ‘phrase book’ Academic model against which processes and systems can be mapped Common framework for different stakeholders to discuss issues Means of clarifying requirements for suppliers CC BY-NC 2.0 Marcus Ramberg A tour around the EMA landscape 5

The Assessment and Feedback Lifecycle Based on an original idea developed by Manchester Metropolitan University A tour around the EMA landscape 6

7 CC BY-NC-SA 2.0 tiff_ku1 Starting point Educational principles: REAP project Strathclyde; Hertfordshire Assessment for learning; NUS Appreciative Inquiry approaches Ulster Viewpoints project CC BY-SA 2.0 Michael Coglan A tour around the EMA landscape 7

A&F principles at Queen’s University Belfast A tour around the EMA landscape 8

9 CC BY-NC-SA 2.0 CrazyFast Supporting longitudinal development Assessment for learning rather than of learning More formative opportunities Feed forward Ipsative approaches Assesment scheduling Access to information A tour around the EMA landscape 9

Assessment timelines University of Dundee course redesign using University of Hertfordshire assessment timelines tool A tour around the EMA landscape 10

11 CC BY-NC-SA 2.0 xdxd_vs_xdxd The role of feedback Feedback is a ‘black box’ Programme teams don’t discuss feedback Useful analytical tools available A tour around the EMA landscape 11

What kind of feedback do you give? P1 - Praise. Motivating but if used indiscriminately can appear insincere. P2 - Recognising Progress (ipsative feedback). Can be motivating and informs students about their learning. Lack of progress serves as an early warning. C - Critique. How work falls short of expectations or criteria; can be discouraging if not accompanied by information on how to improve. A - Advice. Help students take future action to improve. Q - Clarification requests. Asking learners to think more deeply about their work and generate actions themselves. O - Unclassified statements. Neutral comments, for example that describe the piece of work but do not make any judgement. (adapted from IOE feedback profile) A tour around the EMA landscape 12

13 CC BY 2.0 acme Electronic Management of Assessment Jisc EMA project HeLF surveys Questionnaire (65 HEIs) Think tank & workshops Interviews Discussions on EMA blog / Landscape review report A tour around the EMA landscape 13

Localised initiatives A tour around the EMA landscape 14

EMA pain points A tour around the EMA landscape 15

16 CC BY-NC-SA 2.0 Cesar Harada Systems integration Limited range of core technologies Integration loose & requiring manual intervention More HEIs say their A&F systems are ‘completely separate’ than ‘highly integrated’ A tour around the EMA landscape 16

17 CC BY-NC-SA 2.0 Cle0patra Business Processes Lots of local variation Only 12% of HEIs have ‘highly standardised’ processes Different interpretations of policy Variation hidden till EMA tried A tour around the EMA landscape 17

18 CC BY –NC 2.0 Pondspider Necessary safeguard or ‘comfort blanket’ ? Avoids unconscious bias Doesn’t support ipsative approach Complicated by second marking processes Can be lost when data transfers between systems Example: anonymity A tour around the EMA landscape 18

19 CC BY-NC-SA 2.0 jon jordan Urban Myths QAA says ‘No!’ It’s against institutional regulations Leads to change taking place ‘under the radar’ of formal QA processes A tour around the EMA landscape 19

What are your priorities? (1) A tour around the EMA landscape 20

What are your priorities? (2) A tour around the EMA landscape 21

22 Photo: livework for Jisc Working towards solutions Validation of priorities Workshop to generate solution ideas Validation and refinement of solutions Projects getting under way A tour around the EMA landscape 22

23 CC BY –NC-ND 2.0 bendeavin Next steps EMA requirements map: definition of common workflows EMA toolkit: Feedback hub: feasibility study Systems integration: support resources A tour around the EMA landscape 23

24 Highlights of the itinerary Educational principles: Hertfordshire, Queen’s Belfast Curriculum Design: Ulster Feedback: Dundee, Institute of Education Employability: Exeter EMA: Huddersfield Reflection: Westminster Student support: Manchester Met Students as agents of change: Bath Spa; Winchester CC BY-SA 2.0 Steve Cadman A tour around the EMA landscape 24

25 Souvenir shop A&F Baseline review: / uments/programmes/elearning/Assessment/JISCA FBaselineReportMay2012.pdf / uments/programmes/elearning/Assessment/JISCA FBaselineReportMay2012.pdf A&F Final report: ynthesis_Report_Oct_2013_v2.pdf ynthesis_Report_Oct_2013_v2.pdf EMA Landscape review: Jisc Design Studio: Jisc EMA blog: CC BY-NC-ND-SA 2.0 ericalaspada A tour around the EMA landscape 25

26 Stay in touch Contact me: Contact Jisc EMA lead: Contribute to the blog Get involved with the projects Join the mailing list: CC BY-NC-SA 2.0 robin kaspar A tour around the EMA landscape 26

27 Join us in Dundee CC BY-NC-SA 2.0 William Murphy Free one-day workshop Electronic Management of Assessment and Assessment Analytics Tues 9 th June University of Abertay Contact for A tour around the EMA landscape 27

28 CC BY-NC-SA CrazyFast Thanks and over to you… CC BY –NC 2.0 yuzu A tour around the EMA landscape 28