Liverpool John Moores University Assessment matters 20 November 2013 Sally Brown Emerita Professor, Leeds.

Slides:



Advertisements
Similar presentations
Peer-Assessment. students comment on and judge their colleagues work.
Advertisements

Personal Development Plans (PDPs) Subject-specific PDPs in Economics.
Enhancing Induction: Principles for Improving the Student Experience Engaging the learner: Why did I get 37%? Professor Brenda Smith Goldsmiths, University.
Assessment in Higher Education: where next? GEES conference Sally Brown PVC (Academic) Leeds Metropolitan University.
Completing the cycle: an investigation of structured reflection as a tool to encourage student engagement with feedback Jackie Pates Lancaster Environment.
Self- and Peer-Assessment
Peer peer-assessment & peer- feedback
Can technology help absorb the shock of the first undergraduate assessment in HE? Kate Kirk, National Teaching Fellow, Manchester Metropolitan University.
School Based Assessment and Reporting Unit Curriculum Directorate
Assessing large groups: engaging first year students
Assessing more students: ways of using productive assessment with large numbers of students Professor Sally Brown.
Colleen Connor, Dean of Learning and Teaching LEARNING & TEACHING WORKSHOP- ASSIGNMENT FEEDBACK.
Principles of Assessment and Feedback for Learning CHEP Strategic Work-stream Assessment and Feedback for Learning Dr Alan Masson.
Principles of Assessment and Feedback for Learning Ulster Principles of Assessment and Feedback for Learning School Board Briefing [School/Dept name] [Facilitator.
Assessment: where is the learning? EIS conference Aberdeen 5 November 2011 Sally Brown Emeritus Professor, Leeds Metropolitan University,
Cork Institute of Technology Using smarter feedback to improve student engagement and retention 15 th November2012 Sally Brown Emerita.
Assessment matters: What guides might we use as individuals, teams and institutions to help our assessment endeavours? A presentation to Wolverhampton.
Do we need to Assess for Learning? Concordia University Michael Pellegrin, MEESR March 2015.
Imaginative approaches to assessment South Bank University 18 January 2006 Sally Brown Pro-Vice-Chancellor, Assessment, Learning and Teaching Leeds Metropolitan.
Contention: assessment is the most important thing we do for HE students Sally Brown Pro-Vice-Chancellor and Professor of HE Diversity in Learning and.
Improving Students’ understanding of Feedback
Introducing Assessment
Assessment in Higher Education Linda Carey Centre for Educational Development Queen’s University Belfast.
What should be the basis of
Oxford Centre for Staff and Learning Development Developing a variety of assessment methods Chris Rust Oxford Centre for Staff and Learning Development.
Groupwork in the Art & Design context University of the Arts January 16 th 2013 Sally Brown Emerita Professor, Leeds Metropolitan University Adjunct Professor,
Assessing for learning University of Utrecht December 2013 Sally Brown Emerita Professor, Leeds Metropolitan University Adjunct Professor, University of.
Developing key skills Letterkenny Institute of Technology March 2013 Sally Brown Emerita Professor, Leeds Metropolitan University,
University of the Arts workshop Fair Assessment 16 January 2012 Sally Brown Emerita Professor, Leeds Metropolitan University, Adjunct.
Jeremy Hall Nicholas Jones Wouter Poortinga An Exploration of Assessment Practices at Cardiff University’s Schools of Engineering, Psychology and the Centre.
External Examiners’ Briefing Day Assessment Policy Tuesday 6 th January 2015.
Improving small group teaching Sally Brown Emeritus Professor, Leeds Metropolitan University, Adjunct Professor University of Sunshine Coast, Central Queensland.
(SJS[date]) 1 (Assessment and) Feedback - introduction The role of assessment: –Extract from ALOE resource –Assessment audit tool Receiving.
Marion Webb January  By the end of the session, participants will be able to:  Discuss the role of assessment for learning  Describe key assessment.
Emeritus Professor, Leeds Metropolitan University,
Principles of good assessment: theory and practice David Nicol, Project Director, Re-Engineering Assessment Practices, University of Strathclyde, Scotland.
Improving feedback, & student engagement with feedback.
Supporting Teachers New and 'Old' to Psychology. Objectives By the end of the session you will be able to: Understand how to use active teaching and learning.
Enhancing student learning through assessment: a school-wide approach Christine O'Leary, Centre for Promoting Learner Autonomy Sheffield Business School.
Transformative assessment in higher education Dublin City University School of Nursing and Human Science January 2013 Sally Brown Emerita Professor, Leeds.
Effective and inclusive assessment design in the Art & Design context University of the Arts January 16 th 2013 Sally Brown Emerita Professor, Leeds Metropolitan.
Making a marked improvement: using assessment to promote engagement Keele University January 2014 Sally Brown Emerita Professor, Leeds Metropolitan University.
Assessing students in large groups Cork IT May 2013 Sally Brown Emerita Professor, Leeds Metropolitan University, Visiting Fellow,
etools.massey.ac.nz Tools to help lecturers mark assignments John Milne Eva Heinrich.
Sally Brown Emerita Professor, Leeds Metropolitan University Adjunct Professor, University of the Sunshine Coast, University of Central Queensland and.
Centre for Academic Practice University of Strathclyde
Assessment Introduction Unit for the Enhancement of Learning and Teaching.
Lecture 7. The Questions: What is the role of alternative assessment in language learning? What are the Reasons.
A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,
Assessment for learning
Human Resources Brookes Assessment Compact Dr Chris Rust, Head, Oxford Centre for Staff and Learning Development Deputy Director, ASKe.
Inclusive Assessment External Examiners Conference 2015 Professor Pauline Kneale and Jane Collings Educational Development.
The selection of appropriate assessment methods in a course is influenced by many factors: the intended learning outcomes, the discipline and related professional.
Total Teaching (Feedback and assessment ) Paul Gibson.
Programme design and student assessment David Baume 1.
Re-engineering Assessment Practices in Scottish Higher Education [REAP] Dr David Nicol, Project Director Centre for Academic Practice and Learning Enhancement.
Unit for the Enhancement of Learning and Teaching Assessment Development.
PGCE Evaluation of Assessment Methods. Why do we assess? Diagnosis: establish entry behaviour, diagnose learning needs/difficulties. Diagnosis: establish.
Assessing more students: ways of using productive assessment with large numbers UEA 20 th January 2012 Sally Brown Emeritus Professor, Leeds Metropolitan.
Assessment for Learning Centre for Academic Practice Enhancement, Middlesex University.
Good teaching for diverse learners
Supporting student partnerships
Emerita Professor, Leeds Beckett University
Ensuring fair assessment of students in groups
Assessment and Feedback – Module 1
NQT Mentor and Tutor Seminar
Looking at assessment dilemmas
University of Greenwich Emerita Professor, Leeds Beckett University
Teacher Roles and Responsibilities
Providing feedback to learners
Presentation transcript:

Liverpool John Moores University Assessment matters 20 November 2013 Sally Brown Emerita Professor, Leeds Metropolitan University, Visiting Professor, University of Plymouth and Liverpool John Moores University

Why is assessment such a big issue? Good feedback and assessment practices are essential to student learning; Student satisfaction surveys frequently highlight significant dissatisfaction around these issues; In tough times, staff often find the pressure of achieving fast and formative feedback a heavy chore; QAA and professional, Regulatory and Subject bodies require a systematic and organised approach to assessment.

Good feedback practice : 1. Helps clarify what good performance is (goals, criteria, expected standards); 2. Facilitates the development of self-assessment (reflection) in learning; 3. Delivers high quality information to students about their learning; 4. Encourages teacher and peer dialogue around learning; 5. Encourages positive motivational beliefs and self- esteem; 6. Provides opportunities to close the gap between current and desired performance; 7. Provides information to teachers that can be used to help shape the teaching.

To give feedback more effectively & efficiently, we can: Use model answers; Use assignment return sheets; Write an assignment report; Feedback to groups of students; Use statement banks; Use computer-assisted assessment; Involve students in their own assessment.

Strategies for ensuring assessment is for rather than of learning It needs to be built-in rather than bolt-on; Assignments need to be authentic, that is, assessing learning that is identified in the learning outcomes; Learning outcomes need to be designed to be specific, measurable, achievable, realistic and time- constrained (SMART); The assessment strategy should make sure that assignments are fit-for-purpose.

To integrate assessment we need to realign it with the curriculum by: Exploring ways in which assessment can be made integral to learning. Constructively aligning (Biggs 2003) assignments with planned learning outcomes and the curriculum taught; Providing realistic tasks: students are likely to put more energy into and play fairer with assignments they see as authentic and worth bothering with.

Encouraging students to take assessment more seriously All assessment needs to be seen to be fair, consistent, reliable, valid and manageable; Many assessment systems fail to clarify for students the purposes of different kinds of assessment activity; Low-stakes early formative assessment helps students, especially those from disadvantaged backgrounds, understand the rules of the game.

Making assessment work well Intra-tutor and Inter-tutor reliability need to be assured; Practices and processes need to be transparently fair to all students; Cheat and plagiarisers need to be deterred/punished; Assessment needs to be manageable for both staff and students; Assignments should assess what has been taught/learned not what it is easy to assess.

Students benefit if we can make feedback timely Aim to get feedback on work back to students very quickly, while they still care and while there is till time for them to do something with it. The longer students have to wait to get work back, especially if they have moved into another semester by the time they receive their returned scripts, the less likely it is that they will do something constructive with lecturer’s hard-written comments.

Can we provide opportunities for multiple assessment? Consider allowing resubmissions of work as part of a planned programme; Students often feel they could do better once they have seen the formative feedback and would like the chance to have another go; Particularly at the early stages of a programme, we can consider offering them the chance to use formative feedback productively; Feedback often involves a change of orientation, not just the remediation of errors.

Using formative assessment to promote independence and learning Investigate how learning can be advanced in small steps using a ‘scaffolding’ approach; Provide lots of support in the early stages when students don’t understand the ‘rules of the game’ and may lack confidence; This can then be progressively removed as students become more confident in their own abilities.

Play fair with students by avoiding using ‘final language’ (Boud) Avoid destructive criticism of the person rather than the work being assessed. Try not to use language that is judgmental to the point of leaving students nowhere to go. Words like “appalling”, “disastrous” and “incompetent” give students no room to manoeuvre. However, words like ”incomparable” and “unimprovable” don’t help outstanding students to develop ipsatively either.

Play fair by giving feedback to students with diverse abilities Students at the top end of the ability range sometimes feel short changed by minimal feedback; Students with many weaknesses easily become dispirited if there is too much negative feedback; Consider giving an assessment sandwich. Start with something positive, go into the detailed critique and find something nice to say at the end (to motivate them to keep reading!); Explore ways to incentivise reading of feedback; Consider which medium to use for students with disabilities (e.g. don’t use bad handwriting for those with visual impairments or dyslexia!).

Twelve questions on assessment. You can: Use these to help to design an authentic assessment approach at course design stage; Use them also as an aid to curriculum refreshment activity and prior to periodic review.

1.Assessment for learning: is assessment fully integrated within learning activities or is it an add- on that adds nothing to student engagement? 2.Preparation: are you developing students’ assessment literacy, so they understand fully what is required of them and can optimise their performances in a range of assessment contexts? Are staff inducted so they all share understandings of assessment practice. 3.Purpose: are you clear about why on each occasion you are assessing? Is it to give students guidance on how to improve or remediate work, or it is a scoring exercise to determine final grades? Is it focussing on theory or practise (or an integration of the two)?

4.Pacing and timing: are you offering feedback and assessment opportunities throughout the learning period or are assignments bunched together (particularly right at the end of the module)? Are you ensuring that students don’t have multiple assignments from different modules with the same submission date? 5.Volume of assessment: are you offering sufficient opportunities for students to learn through assessment without exhausting staff and putting excessive pressure on students in terms of workload? 6.Constructive alignment: is it clear how the assignments link to the learning outcomes, and do you offer good coverage of subject material and capabilities (or are you encouraging guessing of topics and risk taking activities)?

7.Variety: are you enabling students to demonstrate capability in diverse ways or are you reusing the same methods (essays, reports, unseen time- constrained exams) over and over again? 8.Inclusivity: Are students’ special needs in terms of assessment designed into assignments from the outset or do you have to make special arrangements for students with dyslexia, visual or aural impairments or other disabilities responsively rather than proactively? 9.Agency: is all your assessment undertaken by tutors or do you also use peers, students themselves, employers and clients?

10.Feedback: how fast can you provide it and what assurances can you give to students about its usefulness and ability to feed into future assignments? 11.Quality assurance: are you able to demonstrate that your assessment is fair, consistent and reliable? Will external scrutineers recognise the integrity of the assessment process? 12.Technology: are you using computer aided assessment where it is most useful (for drills and checking learning) enabling assessor time to be used most effectively where judgment is required?

Conclusions Assessment impacts highly on student learning so we need to rethink how we can best do this, taking account of new contexts, new technologies and new opportunities; Efficient and effective feedback is just about the most important thing we do to enhance student learning, progression and success.

These and other slides will be available on my website at

Useful references: 1 Biggs J (2003) Teaching for Quality Learning at University (Maidenhead: SRHE & Open University Press) Bowl, M (2003) Non-traditional entrants to higher education ‘they talk about people like me’ Stoke on Trent, UK, Trentham Books Brown, S. Rust, C & Gibbs, G (1994) Strategies for Diversifying Assessment Oxford Centre for Staff Development. Boud, D. (1995) Enhancing learning through self-assessment London: Routledge. Brown, S. and Glasner, A. (ed.) (1999) Assessment Matters in Higher Education, Choosing and Using Diverse Approaches, Maidenhead: Open University Press. Brown, S. and Knight, P. (1994) Assessing Learners in Higher Education, London: Kogan Page. Brown, S. and Race, P. (2012) Using effective assessment to promote learning, in University teaching in focus: A learning-centred approach, Chalmers, D and Hunt, L. (eds), Melbourne: Australian Council for Educational Research.

Useful references 2 Brown, S. (2011) First class: how assessment can enhance student learning in Blue Skies: new thinking about the future of higher education, London: Pearson. Carroll J and Ryan J (2005) Teaching International students: improving learning for all Routledge SEDA series Falchikov, N (2004) Improving Assessment through Student Involvement: Practical Solutions for Aiding Learning in Higher and Further Education, London: Routledge. Gibbs, G (1999) Using assessment strategically to change the way students learn, In Brown S. & Glasner, A. (eds.), Assessment Matters in Higher Education: Choosing and Using Diverse Approaches Maidenhead: SRHE/Open University Press. Kneale, P. E. (1997) The rise of the "strategic student": how can we adapt to cope? in Armstrong, S., Thompson, G. and Brown, S. (eds) Facing up to Radical Changes in Universities and Colleges, London: Kogan Page.

Useful references 3 Knight, P. and Yorke, M. (2003) Assessment, learning and employability Maidenhead, UK: SRHE/Open University Press. McDowell E & Brown S 1998 Assessing students: cheating and plagiarism, Red Guide 10/11 University of Northumbria, Newcastle Nicol, D J and Macfarlane-Dick: Formative assessment and self- regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education (2006), Vol 31(2), Price, M, Rust, C., Donovan, B., and Handley, K. with Bryant, R. (2012) Assessment Literacy: the foundation for Improving student learning, Oxford, Oxford Centre for Staff and learning Development. Sadler, D R (1989) Formative assessment and the design of instructional systems Instructional Science 18, Sadler, D R (1998) Formative assessment: revisiting the territory Assessment in Education: Principles, Policy and Practice 5, Pickford, R. and Brown, S. (2006) Assessing skills and practice London: Routledge.

Useful references 4 Race, P. (2001) A Briefing on Self, Peer & Group Assessment in LTSN Generic Centre Assessment Series No 9 LTSN York. Race P. (2006) The lecturer’s toolkit (3rd edition) London: Routledge. Race P (2006) The Lecturers toolkit 3 rd edition London Routledge Race P and Pickford R (2007) Making Teaching work: Teaching smarter in post-compulsory education, London, Sage Rust, C., Price, M. and O’Donovan, B. (2003). Improving students’ learning by developing their understanding of assessment criteria and processes. Assessment and Evaluation in Higher Education. 28 (2), Sambell, K., McDowell, L. and Montgomery, C. (2012) Assessment for Learning in Higher Education Abingdon, Routledge Stefani L and Carroll J (2001)A Briefing on Plagiarism ess=full_record&section=generic&id=10 Yorke, M. (1999) Leaving Early: Undergraduate Non-completion in Higher Education, London: Routledge.