1. Principles of good assessment: theory and practice David Nicol, Project Director, Re-Engineering Assessment Practices, University of Strathclyde, Scotland www.reap.ac.uk International Online Conference, Assessment Design for Learner Responsbility 29-31 st May 2007

2. 29-31 May 2007 Assessment Design for Learner Responsibility 2 Plan The purposes of assessment Who is involved in assessment and how Why are assessment principles important? What makes a good principle? Ten assessment and feedback principles Dimensions and dynamics of implementation Application of principles to first year courses Issues and reflections on principles

3. 29-31 May 2007 Assessment Design for Learner Responsibility 3 The purpose of assessment Assessment for and of learning (Black and Wiliam, 1998) Student-centred assessment My definition: assessment should support the development of learner self-regulation (or autonomy in learning). Students should learn to monitor, manage, self-assess their own learning. In practice, professionals formulate their own criteria and assess their performance against them

4. 29-31 May 2007 Assessment Design for Learner Responsibility 4 Some research findings Students are always engaged in self-assessment/self- regulation of their own learning (Winne, 2005; Black & Wiliam, 2005). Logically entailed by constructivist thinking. The act of using teacher feedback implies that self- assessment must be present (Sadler, 1983, Nicol and Macfarlane-Dick, 2006) The question is: how can we scaffold students’ learning so they become better at self-regulation? (Lajoie, 2005)

5. 29-31 May 2007 Assessment Design for Learner Responsibility 5 Why are principles important? Guide and inform teaching practice. Original seven linked to research + included tips and strategies for implementation (see Nicol and Macfarlane-Dick, 2006) Inform institutional assessment strategies for assessment (e.g. Universities of Melbourne and Strathclyde) Used to inform application of technology to support assessment (e.g. Nicol and Milligan, 2006: Nicol, 2007, JISC Guide, 2007)

6. 29-31 May 2007 Assessment Design for Learner Responsibility 6 What makes a good principle? 1.Capture a core idea from published research 2.Broad relevance – many ways of implementing 3.Minimal overlap with each other 4.Effectiveness higher the when more principles are operationalised in same learning design 5.Support design and evaluation of or implemention

7. 29-31 May 2007 Assessment Design for Learner Responsibility 7 Ten assessment and feedback principles 1.Help clarify what good performance is (goals, criteria, standards) 2.Encourage time and effort on challenging learning tasks 3.Deliver high quality teacher feedback information that helps learners self-correct 4.Encourage positive motivational beliefs and self-esteem 5.Encourage interaction and dialogue around learning (peer and teacher-student) 6.Facilitate the development of self-assessment and reflection in learning 7.Give learners choice in the topic, methods, criteria or timing of assessment tasks 8.Involve learners in decision-making about assessment policy and practice 9.Support the development of learning communities 10.Provide information to teachers that can be used to help shape the teaching.

8. 29-31 May 2007 Assessment Design for Learner Responsibility 8 EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE ENGAGEMENT (Fit student to Institution) Figure 1: Assessment and feedback practices: dimensions of implementation ACADEMIC EXPERIENCE

9. 29-31 May 2007 Assessment Design for Learner Responsibility 9 Engagement-empowerment dimension P1: Help clarify what good performance is: Provides examples of completed assignments (essays from previous cohorts) Organises session where student examines examples of assignments and identify which is better and why Students organise their own session online

10. 29-31 May 2007 Assessment Design for Learner Responsibility 10 EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE ENGAGEMENT (Fit student to Institution) ACADEMIC EXPERIENCE Figure 1: Formative assessment and feedback practices: dimensions of implementation

11. 29-31 May 2007 Assessment Design for Learner Responsibility 11 First Year: The academic experience What is important? Coping with transition Understanding what is required Engagement with academic programmes Support and feedback Experiences of success Agents in own learning Belief in self (ability) and motivation Social dynamics of learning (belonging) Based on research by Yorke (UK) and Tinto (US)

12. 29-31 May 2007 Assessment Design for Learner Responsibility 12 Involve learners in decision- making about assessment policy and strategy Give choice in assessment - content and processes Facilitate reflection and self- assessment in learning Encourage positive motivational beliefs & self- esteem Deliver quality feedback that helps learners self-correct Encourage time & effort on challenging learning tasks Help clarify what good performance is EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE Encourage interaction and dialogue around learning (peer and teacher-student) ENGAGEMENT (Fit student to Institution) Support the development of learning communities Adapt teaching to student needs ACADEMIC EXPERIENCE Figure 2: A framework and ten principles for assessment and feedback in the first year

13. 29-31 May 2007 Assessment Design for Learner Responsibility 13 Encourage positive motivational beliefs & self- esteem Deliver quality feedback that helps learners self-correct Encourage time & effort on challenging learning tasks Help clarify what good performance is EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE ENGAGEMENT (Fit student to Institution) Adapt teaching to student needs ACADEMIC EXPERIENCE Figure 2: A framework and ten principles for assessment and feedback in the first year

14. 29-31 May 2007 Assessment Design for Learner Responsibility 14 Encourage positive motivational beliefs & self- esteem Deliver quality feedback that helps learners self-correct Encourage time & effort on challenging learning tasks Help clarify what good performance is EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE Encourage interaction and dialogue around learning (peer and teacher-student) ENGAGEMENT (Fit student to Institution) Adapt teaching to student needs ACADEMIC EXPERIENCE Figure 2: A framework and ten principles for assessment and feedback in the first year

15. 29-31 May 2007 Assessment Design for Learner Responsibility 15 Involve learners in decision- making about assessment policy and strategy Give choice in assessment - content and processes Facilitate reflection and self- assessment in learning Encourage positive motivational beliefs & self- esteem Deliver quality feedback that helps learners self-correct Encourage time & effort on challenging learning tasks Help clarify what good performance is EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE Encourage interaction and dialogue around learning (peer and teacher-student) ENGAGEMENT (Fit student to Institution) Adapt teaching to student needs ACADEMIC EXPERIENCE Figure 2: A framework and ten principles for assessment and feedback in the first year

16. 29-31 May 2007 Assessment Design for Learner Responsibility 16 Involve learners in decision- making about assessment policy and strategy Give choice in assessment - content and processes Facilitate reflection and self- assessment in learning Encourage positive motivational beliefs & self- esteem Deliver quality feedback that helps learners self-correct Encourage time & effort on challenging learning tasks Help clarify what good performance is EMPOWERMENT/ SELF-REGULATION (Adapt institution to student) SOCIAL EXPERIENCE Encourage interaction and dialogue around learning (peer and teacher-student) ENGAGEMENT (Fit student to Institution) Support the development of learning communities Adapt teaching to student needs ACADEMIC EXPERIENCE Figure 2: A framework and ten principles for assessment and feedback in the first year

17. 29-31 May 2007 Assessment Design for Learner Responsibility 17 Discussion (1) 1.The groupings in the lower left quadrant are subject to qualifications discussed regarding implementation – but they do highlight the importance of structuring learning in the first year – students may not have this skill on entry 2.The academic and social dimensions are always inter- related but structure even more necessary to gain some mutual benefit in learning 3.It is not about implementing single principles but their combination in the same learning design that gives power.

18. 29-31 May 2007 Assessment Design for Learner Responsibility 18 Discussion (2) 4.Conflict across the principles in implementation eg creating structure (principle 2) and giving choice and flexibility in study (principle 7 5.And in giving freedom and encouraging group working

19. 29-31 May 2007 Assessment Design for Learner Responsibility 19 Conclusion 1.Are the principles described here useful in thinking about assessment and feedback practices? 2.What are the gaps or omissions? 3.How could they be improved?

20. 29-31 May 2007 Assessment Design for Learner Responsibility 20 Relevant papers Nicol, D (2007), Principles of good assessment practice: A conceptual analysis, Paper to be presented at the REAP International Online Conference on Assessment, May 29-31 st. Nicol, D (2007), Formative assessment and feedback for first year success: Enhancing academic and social integration, Report prepared for QAA Scotland under its First Year Enhancement Theme. Nicol, D (in press), Laying the foundation for lifelong learning: cases studies of technology supported assessment processes in large first year classes, British Journal of Educational Technology (to be published July 2007). Nicol, D (2007) E-assessment by design: using multiple-choice tests to good effect, Journal of Further and Higher Education. Nicol, D. & Milligan, C. (2006), Rethinking technology-supported assessment in relation to the seven principles of good feedback practice. In C. Bryan and K. Clegg, Innovations in Assessment, Routledge. Nicol, D (2006), Increasing success in first year courses: assessment redesign, self- regulation and learning technologies, Paper prepared for ASCILITE conference, Sydney, Australia, Dec 3-6. Nicol, D, J. & Macfarlane-Dick (2006), Formative assessment and self-regulated learning: A model and seven principles of good feedback practice, Studies in Higher Education, 31(2), 199-218.